Is it possible to get analytics on the search results of my Rovo agent?

[Stierman-Verstrijden_ Annette]

I am using a Rovo Agent and I would like to gain insights how successful it is in answering questions of our users.

There are feedback thumbs up / thumbs downs and text box available, but I cannot find the results in a comprehensive report anywhere. Does anybody have a solution?

[Rebekka Heilmann (viadee) · Accepted solution]

Hi @Stierman-Verstrijden_ Annette 

There is currently no way of analyzing the feedback for us. 

I feel like it doesn't even actually improve the agent but is similar to the product feedback options elsewhere in the product.

I found this, but the link doesn't work anymore. Sounds like the textbox may be analyzed by Atlassian which backs up my assumption.

As I've not found any official information on how the thumbs up/down work, I will try and escalate your question to Atlassian and see if we can get someone from the product team to answer that.

[Stierman-Verstrijden_ Annette]

Thanks Rebekka!

[Roberto M_ · Accepted solution]

Hey @Stierman-Verstrijden_ Annette 

Thank you for raising this issue with us on Atlassian Community.

Currently, there is no native feature for the creators of Rovo agents to collect and analyse user feedback. 

We have the following feature request submitted to our Product team to consider an improvement in this area:

• https://jira.atlassian.com/browse/ROVO-91 

After taking a look at the request, I’d suggest you cast your vote on it. It would be great to start watching the ticket so you can stay updated on any changes. Also, if you have any thoughts or insights to share, adding a comment over there would really help emphasize how important it is to complete this request.

I hope this clarifies the situation.

Stay safe and healthy!

Roberto D. M.
Cloud Support Engineer

[Rebekka Heilmann (viadee)]

Hi @Roberto M_ 

thank you for sharing the JAC Ticket... so was I right in my assumption that that feedback goes to Atlassian rather than being processed by the specific Agent?

[Stierman-Verstrijden_ Annette]

Thanks for sharing this ticket Roberto. Gathering votes!

[Roberto M_]

Hi @Rebekka Heilmann _viadee_ and @Stierman-Verstrijden_ Annette 

You're welcome 😊, thank you for the votes!

@Rebekka Heilmann _viadee_ Yes, you were right in your assumption!

The feedback provided via thumbs up or thumbs down in chat with a Rovo agent is typically sent to Atlassian for quality monitoring and product improvement. It is not directly processed by the specific agent you are chatting with; rather, it is aggregated and reviewed by Atlassian's product and engineering teams. This helps Atlassian improve the overall Rovo experience, rather than influencing the behavior of an individual agent in real time.

There is a note about this, in this support article: https://support.atlassian.com/rovo/docs/using-rovo-chat/#Submit-feedback 

Roberto D. M.
Cloud Support Engineer