Set-up takes two steps: turn on Human in the Loop for the scorecard, then add the rules you need. Rules can only be configured in the new Scorecard builder. If you are in the classic builder, switch to the new builder first.
Step 1: Enable Human in the Loop
Open the scorecard settings.
Turn on Enable Human-in-the-Loop Scoring.
This unlocks the rules. On the Scorecard page, the scorecard type changes to Human in the Loop. Nothing else about the scorecard changes.
Step 2: Configure your rules
Using the new scorecard builder, add any combination of the three rules below.
Note: Human in the loop rules can only be configured in the new scorecard builder, not the classic builder.
Overall Score Rule
Use this to flag scores that fall above or below a set percentage for review.
On the main Scorecard builder page, open the AI Review Rules panel.
Next to Flag for review when the total score, choose a comparison (for example is less than or equal to).
Enter the percentage, for example 50%.
To add another threshold, select + Add condition.
Select Save.
Triggered scores are labelled Needs Review on the list page.
Answers that Flag for Review
Use this to hold scores where AI gives a particular answer on a particular question, such as a Fail on a compliance question.
In the Scorecard builder, select the question to open the question details sidebar.
Open the AI Rules tab.
Under Answers that flag for review, tick each answer that should flag the score (for example Fail and N/A).
Select Save.
Repeat for any other questions.
Triggered scores are labelled Needs Review on the list page.
Exclude from AI Scoring
Use this for questions you want a person to answer every time. AI scores the rest of the scorecard and leaves these unanswered.
In the Scorecard builder, select the question to open the question details sidebar.
Open the AI Rules tab.
Tick Exclude this question from AI scoring.
Select Save.
Triggered scores are labelled Needs Completion on the list page. While a question is excluded, its Answers that flag for review settings are not used.
Next step
Run a list against the scorecard. See How to review, complete and release scores.