Imagine, you have a GitLab CI pipeline, when you run the pipeline you get a single output execution xml file. Now for defect management, I need to switch to Xray where I have 2 test case and I need to update both of them manually according to the output from the CI pipeline which is very tedious because I have 500 test now, but lets keep it simple and say I only have 2.
now according to this website : Import Execution Results - REST - Xray Server + DC - Xray (getxray.app)
Now when I run my test in the Gitlab CI pipeline, it will import the execution xml and update my Xray test case automatically. Yay. No more overnight updating test cases.
Now I have one issue.
One : multiple test case depends on the same execution xml. For example test case A, test case B both depend on the same execution xml. So if pipeline execution failed, both test case A and test case B need to update the status to fail.
But the current result shows that it will only update either test case A or test case B but not both (bcs it only create one test execution for either test A or test B but not both), which makes my tests in Xray unreliable. Nooo, my boss gonna fry my ass.
So my questions is are there any remedies for this or we need to figure out something else? Like creating my own tools and stuff.