Because Large Language Models (LLMs) reason in ways that are different from humans, the criteria you set up may not always produce the exact type of feedback you expect. To make sure everything works as intended, we strongly recommend testing the feedback reports before opening it up to learners.
Start by running several sample conversations with the AI Character. To do this, you must launch the student view of the simulation by either selecting “Student View” in the Preview Panel on the right side of the Editor (see image below), or by selecting “LAUNCH” from the list of simulations (see Launch simulation image).
Student View from Preview Panel.
Launch simulation.
This is the exact view that learners will see (see image below).
Student View of simulation.
Select the “HOLD TO TALK” button or press down on the spacebar to start speaking with the AI Character. You may alternatively choose to type out your responses in the “...Or Type” box.
The sample conversations you have should reflect examples of weak, average, and strong performance. By varying the conversation across multiple attempts, you will see (1) whether the generated feedback matches your expectations and (2) how the feedback and integer scores change, if at all, depending on the skill level.
Once the sample conversation has wrapped up, select “END CONVERSATION” below the dialogue box (see image below).
Select “End Conversation”
It will take a few seconds to generate the feedback report (see image below).
Feedback report.
Based on your observations, you may need to adjust or refine the criteria to ensure the feedback is clear, accurate, and useful for learners. In order to get back to the Editor from the Student View:
Select the “CONTINUE” button at the bottom of the feedback report (see Continue from the feedback report image);
Select “RESTART” on the same simulation (see Restart simulation image); and lastly,
Select the “EDIT” button at the top left-hand corner of the Student View (see Going from Student View to Editor image).
Continue from the feedback report.
Restart simulation.
Going from Student View to Editor.
To view all reports, select “BACK TO PROGRAM” (see image below) and then “REPORTS” for the simulation of interest (see Viewing all feedback reports image).
Going from Editor to Program page.
Viewing all feedback reports.
In the “Reports” section, you can view all of the feedback reports individually. To see them displayed in one document, select EXPORT REPORTS for a CSV file to be generated (see image below).
Export feedback reports.