Skip to main content

Reviewing Analytics

Learn how to read every metric on the Analytics page, filter the data to the view you need, and drill into a single course to find exactly where learners struggled.

Platform access level: Org Admins, Managers, and Distributors (anyone who delivers courses and needs to prove they worked), plus Analysts, whose access is the Analytics page itself.


Analytics is where you find out whether a course worked. The Analytics page brings every metric Arist tracks into one place and takes you from an organization-wide snapshot down to a single learner's reply. This guide walks the page from top to bottom, from setting filters to reading each metric to finding the exact lesson where learners struggled.

Analytics reports on the lessons that arrived. If you have not verified delivery yet, start in the delivery tracker with Understanding Enrollment Statuses, then come back here.


1. Filtering the view to the data you need

Open the Analytics tab. The page opens on every enrollment you can see, across all your courses and cohorts at once, so narrow it first.

the Advanced filters panel expanded: Delivery methods, Channels, course type, schedule status, and user type

Filter by enrollment dates, content, cohort, schedule, or a specific learner. Click Advanced filters to also filter by delivery method, named Channel, course type, or schedule status.

Note: By default, Arist filters out data from anyone with a workspace role, since those users are usually trainers rather than the learners you want to track. If you are in a testing phase, or your users also take courses, toggle on include users with workspace roles in Advanced filters.

If your organization uses teams, this page shows only the team you have selected, for every role including Org Admins. The metric tiles, the enrollment graph, the breakdown tables, and even the learner and cohort filter options cover that team alone. A learner who belongs to another team appears in that team's data instead. Switch teams with the selector at the top of the sidebar, and select the Default team for organization-wide reporting. (Teams is in Beta.)


2. Reading the metrics on the Insights tab

The Insights tab reports how the enrollments you filtered to performed overall, one tile per metric, from completion to confidence. Every tile recalculates against the filters you set, so a tile only ever describes the slice of data on screen.

the Insights tab with its metric tiles and the enrollment-over-time graph

Before reading any tile, check whether the metric describes your learners or your content. Completion rate and engagement rate count learners. Answer accuracy and reply rate measure how the questions themselves performed. Each definition below is the text behind that tile's info icon.

Metric

What it measures

Completion rate

Shows the percentage of enrolled learners who have completed their entire course or nudge.

Progress rate

Indicates the overall progress of selected learners through their courses, averaged across all lessons.

Answer accuracy

Reflects the correctness of learners' responses to questions with predefined correct answers.

Reply rate

The percentage of questions sent that received a response. (Calculated as: total responses received / total questions sent)

Drop-off rate

The percentage of learners who stop progressing at any point in a course due to stopping, pausing, opting out, or encountering an error.

Engagement rate

The percentage of learners who responded to at least one question. (Calculated as: Learners who responded ÷ Total number of learners who received questions)

Confidence lift

The average increase in learner confidence from the start to the end of a course, a key indicator of behavior change. Calculated as: (Confidence at end - Confidence at start) / 10

Learner NPS

Presents the average Net Promoter Score from learner feedback, indicating their likelihood to recommend the course.

Learner sentiment

Reveals learners' likelihood to recommend their courses to colleagues, with higher scores suggesting better engagement potential.

In progress

Counts all learners currently enrolled in training, courses, or nudges, as per your selection.

The Learner NPS tile is hidden by default. Ask your Customer Success Manager to turn it on.

Below the tiles, the Enrollment over time graph plots a running total of enrollments over the dates you filtered to.

Answer accuracy counts only the chances a learner had to answer correctly or incorrectly. A learner who has not answered any multiple choice questions, and a course that has none, both show an accuracy of 100%. Check reply rate to see whether learners answered. Then check that the course has questions with correct answers.

Tip: An answer accuracy around 80% is a good benchmark. It shows the questions are challenging but not unclear.


3. Checking the breakdown tables lower on the page

Scroll past the tiles and the same filtered data is broken out by Enrollments, Content, Cohorts, and Responses, each in its own tab. These tabs are also where exports live. Click Download on any of them for a CSV that includes more data points than the page shows. Exporting Analytics Data covers every export and what each column means.


4. Analyzing one course lesson by lesson on the Engagement tab

Filter the page to a single course, then click the Engagement tab.

the Engagement tab for a single course showing per-lesson progress, drop-off, reply rate, and accuracy

The tab breaks performance down lesson by lesson. The Step column lists the lessons in order. Each remaining column measures one lesson rather than the whole course. These definitions come from the info icon in each column header.

Column

What it measures

Lesson progress

Number of all active enrollments that are on this step.

Drop-off

Number of enrollments that stopped, paused, opted out, or errored at this step.

Reply rate

The percentage of questions sent that received a response. (Calculated as: total responses received / total questions sent)

Answer accuracy

Percentage of enrollments that got this message and replied correctly.

Both Lesson progress and Drop-off count enrollments. Turn on show % in either column header to read them as percentages instead.

Click any question to read the exact responses your learners gave, or select Response summary for an overview of the responses to every question. When one lesson's numbers dip, you have found the concept to reinforce, or the prompt to rewrite, in your next iteration.

the Response summary window listing every lesson's questions with their answer options and response counts

The Correct column at the end of each response row is where you override the AI's grade. Select the tick or the cross to flip it. The course's answer accuracy updates with the change.

A multiple choice question shows its result and keeps it fixed. A question with nothing to grade reads N/A.

If your organization uses teams, changing a grade follows the team you are working in, the same way the rest of the page does. When the learner belongs to another team, the grade returns to what it was. Switch to that learner's team, or to the Default team, to change it. This applies to every role, Org Admins included.

Try it: Filter to a course you delivered recently, open the Engagement tab, and click into the question with the lowest answer accuracy. The replies tell you whether the concept or the question itself needs the work.


Related articles

Note: Need help at any point? Reach out to your Arist Customer Success contact, or email support@arist.co.

Did this answer your question?