How to add test set to my Story

[serge calderara]

Dear all,

I have build a Test Set which contains 3 test, and I would like to add this 3 test to my story through the Test test.

Actually from my story I have only Create New Sub test Execution and Create New Test button but not Add test Set

As you probably understand, my goal is that I do not want to retype my all test which already existing in my Test Set .

If I follow the logic of The Story as shown above and click on Create New Test, then it create a new Xray Test named TEST A it is added to my Story.

Then if I open TEST A, only at that time I can add my Test Set by editing Test A as in my exemple below I can see I have added my Test Set and it contains 3 test .

Then from  TEST A I create a Test Plan and a Test Execution

Then when I go back to my Story, I can see only TEST A listed and not the tests list belonging to my Test set as seen below 

Due to that, when I go to the Xray board and report my created Test Plan, I can see only the status of TEST A as TODO  but not the status of all other test included from my Test Set

Did I do anything wrong in configuration or an other way to do which does not make this confuse as I should normally be able to see all my Test from the Test Set which are the real test I need to perform... Test A is seems to be here only to be able to add Test Set which is wierd

Thanks for clarification

regards

[Rawan Bardini · Accepted solution]

Hi Serge,

In the case you are describing here, you are basically trying to link Existing Tests you already have created to your Story, rather than writing a new Test.

To see proper test coverage of a Story and be able to execute Tests within a Story, you need to ensure all tests are directly linked to the Story. So rather than clicking on the Create New Test button in the Story (if you were to write a new test), instead you should just link the 3 Existing Tests to the story directly. You can do this via the Link Issues button at the top of your story. You can use the "is tested by" link type, and then add a link for each of your 3 tests. 

After doing this, you can then click on create new sub test execution, and Xray will create a sub test execution as a sub task of the story, with all 3 tests linked to the story in that sub test execution. This is how you can then run your tests (pass/fail etc) and see the results reflected on the test coverage section of the Story. 

Test Sets are really used as a way to organize the Tests, but not as a way to link Tests that you need to run or execute to a Story.

I would recommend reading through the Xray User Guide for more details on usage of Xray.

Hope that helps.
Thanks!

Rawan

[serge calderara]

Thanks for your reply and clarification.

I manage to made it differently without having to select all my existing set.

1. I have created a Sub task execution from my Story
2. From there I can Add Test from test set menu and can have them automatically added

And then I can see all 3 test from my story

Regards

serge

[Rawan Bardini]

Hi Serge,

Yes, this is another way to get to the same result of having your 3 tests within the sub test execution. Adding them within the sub test execution using a test set.

However, be aware that the test coverage calculations you see on the Story are driven by the tests linked to the story, along with the sub test execution results on the story. 

Glad you have this figured out now and I could help.

Thanks!

Rawan

[Rogério Paiva - Xray Xporter]

Hi @serge calderara 

You can test a Story (or any other configured Coverable Requirement) by setting up a link of type "is tested by" to the Test Set; it is the same that happens with Test cases.

The only difference, you don't have a "Create Test Set" button, but you may use the Jira option for this.

This procedure is described in this Xray documentation page: https://docs.getxray.app/display/XRAYCLOUD/Coverable+issues#Coverableissues-AssociatewithanexistingTest/TestSet

If you need further help, please contact Xray Support (http://xraysupport.xpand-it.com) so that we can help further.

Kind regards,
Rogério Paiva [Xray Support Team]