Xray - Pass a test without passing all steps

[Chris Kemp]

Hi,

Firstly, I am working for a large organisation that has implemented templates/workflows which are managed by a support team, not by the users.

This means my question will be theoretical, with the goal of asking for 'changes to the template', hopefully with a bit of knowledge.

Currently, when an XRay test is executed, we only have the option of (Not Started) Passed/In Progress/Failed for each Test Step.

In some instances, it is valid to mark a test step as N/A or Blocked, but still choose to Pass the overall test.  This is something very easy to do in ALM.

1) Is it correct that 'someone' can amend the Xray test settings (template) to give more Status for the Test Step?

I am assuming this is true as someone has amended the template to include Blocked and Descoped to the Overall Test Status since I last ran a test.

However, I have observed that when I choose Pass for the Overall test, Xray automatically Passes all steps.  I get that someone may have thought this may save a testers time, but in my opinion it is totally wrong.

2) Is it correct that it is an option for this behaviour, more so, that something can be changed to maintain the status of the step but also Pass the test?

(surely xray have not dictated that by choosing to pass a test that all steps must be passed?)

Many thanks