UI Test Reporting Bug

[Srijan Chapagain]

There seems to be a bug where it shows test reports in steps and also in Tests tabs. Earlier this was working fine and our setup has not changed at all. As you can see from the screenshot, it shows failed tests correctly but passed is no where correct..

[Ben]

Hi @Srijan Chapagain 

Please attach a screenshot and we will investigate further :) 

Cheers!

- Ben (Bitbucket Cloud Support)

[Srijan Chapagain]

@Ben Hi, this is intermittent and so random. Now again i saw same result. 
We have last step where we push the image to registry, the UI still shows how many tests passed, I am assuming it is taking from artifacts/test-results but we need artifacts from earlier steps for debugging. Isn't this a bug as the step which is just pushing image has no test runners nothing in artifacts at all

[Mark C]

Hi @Srijan Chapagain

Could you confirm if the same test cases was done inside the test results' supported path/location?

Regards,
Mark C

[Srijan Chapagain]

Yes they are in supported locations which is why it is displayed in the steps UI..but the results that is displayed in UI is not correct specially for cucumber tests that we have. For vitest and playwright it is displaying properly but for cucumber tests in some case the UI reflects data properly but randomly then it shows way more tests passed value like 50 is what it should be and it shows 250 or something....
But if we look closely on the build result, the xml has correct count... I am thinking is there some issue with stale or cached report data in container or?

[Ben]

Hi @Srijan Chapagain 

Can you attempt to use a different browser and clear the browser cache if you notice this occur? I would also like to know which browser you're currently using - we'd like to rule out any issues with display in the browser.

Cheers!

- Ben (Bitbucket Cloud Support)

[Srijan Chapagain]

I think i figured out the issue. So the unit test step generates reports and puts in the artifacts, the next step downloads those and merge that to show in the test result...well this is my hunch at least otherwise there is no other logical reason...but how to do this cleanly then? we do want to put test results in artifacts too for further investigations..

[Syahrul]

Hey @Srijan Chapagain 

I recommend investigating this further by submitting a support ticket. Could you please raise a support ticket on our support portal?

Thanks!
Syahrul

[Aron Gombas _Midori_]

@Srijan Chapagain Note that there is no screenshot attached to your question.

[Srijan Chapagain]

Hi, for some reason it was not attaching screenshots even though i had attached it. But here you go and to update, this is actually just working fine now...so perhaps some intermittent issue on your side.

Thanks,