Skip to main content

Build Audit Agent templates and scoring criteria

How to design practical Audit Agent templates, criteria, priorities, scoring, and thresholds.

Written by Dr. Harvinder Power

What an audit template contains

An Audit Agent template can include a name, description, objective, questions, criteria, priorities, categories, scoring settings, and thresholds.

Personal, organisation, and preset templates

  • Personal templates are available to you.

  • Organisation templates are shared across your organisation, where permissions allow.

  • Regulatory presets can be cloned and customised where enabled.

Criteria

Criteria are the specific checks Audit Agent applies to each session or note. Write criteria as observable documentation requirements.

Good criteria examples:

  • Red flags are documented where relevant.

  • Assessment includes working diagnosis or clinical impression.

  • Plan includes follow-up, onward referral, or discharge advice where appropriate.

  • Safety-netting advice is documented.

Priorities

Criteria can be priority weighted as critical, high, medium, or low. Use critical for items that should materially affect governance or safety conclusions.

Scoring modes

The current template builder supports binary, scale, and text-style scoring. Use binary for yes/no checks, scale for graduated quality, and text when you need explanatory judgement.

Scoring strategy

Templates can use:

  • Overall Verdict: pass rate is based on sessions rated adequate or strong.

  • Points-based: criteria contribute points, with pass and review thresholds.

Thresholds

Thresholds define when an audit passes or needs review. Current defaults in the builder are 80% pass for verdict-based scoring and 75% pass with 50% review threshold for points-based scoring, but templates can be configured.

Auto-fail rules

For points-based templates, category-level auto-fail rules can flag an audit if a category falls below a threshold. Binary criteria can also be configured to auto-fail if a criterion scores zero or is missing.

Template design advice

Keep templates focused. Too many vague criteria create noisy results. Use fewer, high-signal criteria and clear scoring labels.

Did this answer your question?