Xray JSON - How to import execution result

[Vincent Goguet]

Hello,

I am trying to implement an automatic testing solution based on Xray. I export Cucumber tests (from test execution plan), run it in a Java / maven / junit / selenium solution. Then integrate the result using the "Import Execution result" button.

For the moment I have managed to export the test(s) form Xray, run the test(s) in my framework and generate a JSON file.

But the JSON file don't looks to pleased Xray. The problem is that I don't have access to logs, so I don't know what is wrong.

I have check all topics I have found without success.

I have even maid a manual json file based on this related article : https://docs.getxray.app/display/XRAYCLOUD/Import+Execution+Results+-+REST#ImportExecutionResultsREST-XrayJSONresults

But I the file don't work.

When the integration works, I have a message "Mismatched Result and Scenario" but all the lines of the test have been integrated and have a correct status.  

According to Xray support, we should use the "standard cucumber output". Apparently or an update is perturbing this comment, or the solution haven't been tested.

I have contacted the support of Xray, but they take time to answer.

So if you have any suggestions, configuration, documentation, I will be pleased to read it.

Best regards;

[Rogério Paiva - Xray Xporter]

Hi @Vincent Goguet ,

Your request for help was not sent directly to the support team using the support service desk portal (http://xraysupport.xpand-it.com). It is always best to contact the support directly through the portal so that the team receives the request right away.

Also, it is important to let you know that we have replied within the Standard Support Service, which is open during business hours, from 10 am to 7 pm CET (Central Europe Time), Monday through Friday.
If you need 24x7 support, we advise upgrading to the Premium support offer.

And once the support team got your request, it was resolved in a couple of days.

Kind regards,
Rogério Paiva [Xray Support Team]

[Vincent Goguet]

Yes,

Thank you for your help, I had a lot of different problems to fix.

Ana Teixira form support team took the time to explain me and guide me to a working solution.

For the community: the majority of my problems were, in fact, related to the writing of Cucumber tests in Xray (installed on a Jira cloud solution). For example, Scenario and Scenario Outline keywords must not be written in the text area. Xray figure by itself if it is facing a Scenario Outline and write the correct keyword in the export file.

I was confused because my framework was leading the test correctly and getting a correct result. But generate an understandable json file for Xray. 

So, thank to Ana and the support team.

Best regards;

[Rogério Paiva - Xray Xporter]

Hi @Vincent Goguet 

On behalf of everyone at the Xray Support Team, I wanted to thank you very much for your kind words.

Providing great products and support is our primary goal, and knowing that you appreciate our efforts helps keep us motivated.

Please feel free to contact us through our Service Desk portal (http://xraysupport.xpand-it.com) whenever you need our assistance.

Thank you.
Kind regards,
Rogério Paiva [Xray Support Team]