This section of the Runs report offers data on the usage of Leo, an AI-powered chatbot that helps testers get relevant information quickly to complete testing. To get data on Leo usage, your workspace first needs to have activated Leo.
These metrics provide insights into the performance of Leo and engagement with it, highlighting Leo activity and the feedback it receives during test runs.
See Only the Data You Want
Each report offers you options for filtering the runs to show only data relevant to what you want to know.
You can choose from these options:
Dates (when the run happened)
Workspaces (if the engagement has multiple workspaces)
Test type (manual or automated)
Run labels (ways to group relevant runs together, such as versions or platforms)
The selected options apply to all data and graphs on the entire page.
Get a Summary
If you have LeoInsights available, you can get an executive summary highlighting key trends, changes, and correlations across the different metrics in the report. To get the summary, click Generate.
The summary is generated from all of the data on the page, taking into account any filters you have set.
Available Data
Workspaces where Leo is not activated see 0 for all values.
Indicator | What It Tracks | What Signals it Might Bring |
Leo Active in Runs | The total number of test runs where Leo was in use during the period. Automatically compares with the number during the prior period. | Low activity is a good indicator to look into how to grow adoption in your workspace. |
Leo Answers | The total number of answers provided by Leo during the period. Automatically compares with the number during the prior period. | This metric reflects Leo contributions to resolving questions or issues.
|
Leo Answers per Run | The average number of answers given by Leo in each test run. Automatically compares with the average during the prior period. | This metric provides insight into the frequency of Leo use.
|
Leo Answers by Feedback Type | A visual categorization of Leo answers based on feedback type (no feedback, positive feedback, negative feedback) over time. | This chart helps in assessing the quality and impact of Leo responses.
Ensure trends in feedback are reviewed to refine Leo accuracy and usefulness. |
Answer Engagement Rate | The percentage of Leo answers that received feedback (positive or negative) from testers. Automatically compares with the percentage during the prior period. | This metric helps in evaluating user interaction with Leo.
|
Negative Feedback | The number of answers rated positively by testers. Automatically compares with the number during the prior period. | This metric provides insight into Leo effectiveness in delivering helpful responses.
|
Positive Feedback | The number of answers rated negatively by testers. Automatically compares with the number during the prior period. | This metric helps in identifying areas for improvement in Leo functionality.
|