Automated analysis, also known as automated or AI-powered coaching, helps enablement teams and managers to quickly and easily see where reps need coaching before they go to market. Trainers can enhance webcam, audio, and screen recording elements with automated analysis in order to identify:

Automated analysis generates a complete transcript of the user's recording and makes this transcript available to both the learner and their grader (if the question is graded).

Automated analysis solves at least two vexing problems, creating value for both managers and the employees they supervise. Here's how.

Enablement teams and managers have limited bandwidth and cannot easily scale feedback and coaching for all of their team members. With automated analysis, managers can quickly identify skills and practices on which reps need coaching.

Team members miss the opportunity to receive just-in-time feedback on soft skills as they acquire new abilities. Moreover, automated analysis gives reps the opportunity to see their results before a lesson is graded.

Navigate to the Settings menu by selecting the cog icon in the upper right corner of the Lessonly interface, then select Global Lesson Settings.

Under the In-Lesson heading, select the checkbox next to "Allow creators to add Automated Analysis on recorded practice elements."

Automated analysis can be added to Lessonly's recorded practice elements: webcam, screen, or audio recording.

To get started, navigate to the lesson builder, select Add Element, then select a Recorded Practice element to include in your lesson.

Automated Analysis settings can be found within the element itself, as pictured below.

You can provide learners four kinds of automatic feedback based on their responses: keyword matching, filler word usage, pace, and confidence. Each is discussed in greater detail below.

Keyword matching helps sellers stay on message by identifying correct and incorrect keywords in the transcript of a practice sales pitch. When keyword matching is enabled, learners will see exactly where and when they mentioned favored or disfavored keywords. This helps sellers speak a prospect's language, winning their trust in the process.

Once keyword matching has been enabled, you'll see two text fields, one for correct keywords or phrases and one for incorrect keywords. Add a string to either field, then press Enter to validate your choices. To delete a keyword, select the X on its label.

After learners record and submit a response to your prompt, the audio of that response will be transcribed and analyzed for correct and incorrect keywords. These will be displayed in the analysis results as pictured below.

The learner's transcript will be scored for accuracy based on the number of incorrect keywords and their incidence. This enables trainers to set targets for sellers to attain or surpass.

Note that keyword matching cannot identify keywords that were never spoken. Suppose it's imperative that Andy, a seller in training, uses the phrase "toner adhesion", but he plum forgets to mention it. Keyword analysis won't register the omission. Instead, use the practice element's answer key to bring such gaps to a learner's attention. Include a note like the one below, instructing graders to listen for and note any keywords a learner fails to mention.

Filler words, or hesitation markers, are words or phrases such as "um", "like", and "you know". These words add no meaning to the content of your speech. Worse, they make you sound unconfident and unprepared, and they may distract a prospect from the core of your message.

To help sellers avoid using filler words, analyze their responses for examples of these. This will help learners home in on the parts of a pitch that need more practice. Unlike keyword matching, you don't need to specify the filler words to be identified; Lessonly listens for and identifies filler words based on an internal catalog of such words.

After analysis, the filler words in a learner's submission will be rendered as a percentage of all words in a transcript.

It's been estimated that filler words make up 6 to 10 percent of what we say extemporaneously, but a sales pitch is anything but improvised! We recommend keeping filler words to 5 percent or less of a given transcript.

When the Pace checkbox is selected, learner audio is analyzed for the number of words spoken per minute. This information is displayed in the results window as pictured below.

It's been estimated that English speakers in the United States have an average speaking speed of about 150 words per minute. While there isn't an ideal pace of speech per se, you want to ensure that you're neither speaking too slowly, which may frustrate or bore your audience, or too quickly, which may impair their comprehension. Try aiming for a rate of speech that falls between 140-160 WPM.

Confidence measures learners' self-assurance by analyzing the audio of their recorded responses. It gauges the confidence of a given reply by analyzing speaking cues such as tone of voice, level of hesitation, and more. A proprietary machine learning model judges these variables and returns one of three confidence scores: low, moderate, or high confidence.

Because it leverages a machine learning model, Lessonly's confidence analysis will improve the more you train it. Graders can use a feedback mechanism to confirm whether they agree with the confidence scores that automated analysis returns.

Over time, this will increase your confidence... in Confidence!

After completing a practice activity to which confidence analysis has been added, learners can select a link to view automated analysis. This will launch a new window containing a Confidence widget that displays the learner's results.

Learners will also receive an email containing the results of their practice activity, including a confidence score.

Selecting the button that reads View Automated Analysis will navigate learners to the in-app results window pictured above.

Practice activities that include automated analysis are labeled as such. Learners can mouse over this label to read a brief description of automated analysis and the work it performs.

When learners complete automated analysis activities they're greeted by this message: "Your Automated Analysis results will finish processing soon. A transcript of the video you submit will be analyzed for things like correct and incorrect keywords, filler word usage, and words per minute. Results will be emailed to you when ready."

This email carries the subject line "Your results are in!" The message body includes a snapshot of the learner's performance according to whichever indicators were established when the practice activity was created.

Here's what a typical results email looks like.

See that View Automated Analysis button? When recipients select it they'll be navigated to their report card. If the question was set to be graded, learners will also see any feedback left by their evaluators.

When practice activities are set to be graded, learner submissions are sent to the Grading Station. Here, graders can watch recordings, review automated analysis results, and give learners feedback.

To see the results of an automated analysis, select the video thumbnail; this will open the recording in a new window. The results of any analyses you've enabled will be displayed beneath the video.

Keyword Matching shows the correct and incorrect keywords identified by automated analysis. Correct keywords and phrases are highlighted in green; incorrect ones are highlighted in red.

Pace shows a color-coded gauge measuring the speaker's words per minute. Responses that fall within the green range unfurl at an ideal pace, while the yellow and red zones may indicate areas for improvement.

Filler Word Usage indicates the percentage of filler words identified in a user's submission. Green indicates a response with little or no filler words, yellow indicates a response with a moderate level of discourse markers, and red indicates a response that may be negatively impacted by ums, ahs, and other hesitation words.

A complete transcript of the learner's submission is also included. This section contains a transcript accuracy score that reflects the number of unknown, uncertain, or anomalous words identified during speech-to-text transcription.

The right-hand pane of the video window contains the usual options for grading a learner's submission. Graders must mark a response correct or incorrect before they can submit the grade.

After completing lessons that include practice questions with automated analysis, learners' reports cards will be updated with a copy of the submission they recorded. Selecting "See Automated Analysis Results" will launch a window displaying their results. Note that lessons awaiting a grade may need to be graded before learners can review their submissions.

In the response window, users can review the results of the automated analysis, including a transcript of their recording, and any feedback left by the grader.

If the question is not graded, users will still see the same view; but the results will be made available immediately and no feedback will be included.

A. Only English is supported at this time.

A. It's not possible to disable the results email at this time. If this is an option you'd like to have, please share your feedback with the Lessonly product team.

A. Glad you asked! A list of best practices can be found in this article.