Skip to main content

Setting up AI Review playbooks

A guide to building and refining AI Review playbooks, including how to write rules and positions that flag the right terms.

Written by Henry Warner

A playbook is the reference AI Review uses when it checks a contract. It's a set of rules describing the positions you will and won't accept, and it's what lets the Agent decide whether a redline (on your own paper) or a clause (on a counterparty's paper) is acceptable. A review is only ever as good as the playbook behind it, so it's worth setting yours up with care.

This guide covers AI Review playbooks specifically. Juro's other AI features β€” AI Assistant, AI Extract, and Operator β€” each have their own separate playbooks, so nothing you set up here affects those.

πŸ’‘ NOTE: You must be a Workspace Admin or Editor to access AI playbooks β€” Users and Viewers won't see this feature. Playbooks can be written in any language.

Creating a playbook πŸ—οΈ


  1. Open the Playbook hub and click +Add Playbook.

  2. Select one of Juro's starter playbooks, click + Add own rules to build one from scratch, or upload an existing playbook (for example a Word document) as your starting point β€” Juro will convert it into rules for you.

  3. To add or edit rules, unpublish the playbook, click + Add rule, and fill in the fields. Starter playbooks come with preset rules you can update. When the playbook is ready, republish it so it can be used in a review.

πŸ’‘ NOTE: You'll need to unpublish a playbook to edit it again at any stage.

Before you write any rules, it's worth understanding how a review differs depending on whose paper you're reviewing β€” because that shapes what your rules need to catch.

How AI Review works differently on third-party paper (in Word) vs your own paper (in Juro) πŸ“„


AI Review behaves differently depending on whose paper you're reviewing, because the two situations call for different things.

  • On your own paper (first-party), the review runs natively in Juro. You've sent out a document built from your own template and the counterparty has redlined it, so the Agent reviews only those redlines β€” the changes they've suggested β€” against your playbook, and tells you which are acceptable and which aren't. It doesn't touch the rest of the document, because there's no reason to redline your own template against yourself. You run it from the External Comments tab once their suggestions come back.

  • On a counterparty's paper (third-party), the review runs in Word through Juro's Word plug-in. The document is someone else's, so there's no template of yours to compare against β€” the Agent reviews the whole document against your playbook and generates suggested redlines wherever the terms don't match your positions, broken out by priority. You then approve or reject each suggestion in Word before sending the document back.

In short: on your own paper the Agent looks only at what the other side changed; on a counterparty's paper it looks at everything.

How a rule works: anatomy of a rule 🧩


Every rule has four parts:

  • Rule name β€” what the Agent uses to match the rule to the right part of the document.

  • Priority ranking β€” a slider (low / medium / high) that groups results for triage.

  • Acceptable position β€” what you're happy to see.

  • Unacceptable position β€” what you're not.

The name decides whether a rule is applied to a given clause or redline, and the positions decide how it's judged once it matches. The priority ranking is cosmetic (more on that below).

Writing the rule name 🏷️


The name is the matcher. On counterparty paper it's matched against the document's clauses; on your own paper it's matched against the redlines the other side has made. Getting it right is the single biggest lever on whether a rule fires where you want.

  • Be descriptive, but broad. A good test: someone who knew nothing about the contract should be able to tell, from the name alone, which part of the document the rule applies to.

  • Avoid niche, single-term names. If a concept can be expressed several ways, list the alternatives rather than betting on one β€” for example Assignment / novation / transfer rather than just Novation. Broadening the name broadens what the rule catches.

  • Keep instructions out of the name. It's used only for matching, never to shape the redline itself, so there's no value in phrasing it as an instruction.

  • Don't go too broad, either. A sweeping name β€” something like "Obligations" β€” can cause the rule to fire in places you didn't intend. Aim for a name that's broad enough to catch the concept however it's worded, but specific enough to point at one part of the document.

A couple of examples of good rule names:

  • 'Limitation of liability / liability cap'

  • 'Auto-renewal / automatic extension'

  • 'Indemnification / hold harmless'

Writing acceptable and unacceptable positions βš–οΈ


The two position fields are read together as a single instruction β€” they're split in two purely to make them easier to think through. Once a rule matches, the Agent compares the clause or redline against these to decide whether it's in or out of bounds.

  • Define both positions. A rule works best when it knows what's acceptable and what isn't. You can leave the unacceptable position empty, but if something falls outside everything you've described, the rule may simply not react. (For a PHI rule, for instance: acceptable = "no mention of protected health information"; unacceptable = "protected health information is included".)

  • Cover the range, not just a point. Don't write "12 months" β€” write "12 months or longer", and mark "anything shorter than 12 months" as unacceptable, so the edge cases are handled.

  • Keep it black and white. Avoid soft qualifiers like "especially" or "conditional upon". Clear-cut positions produce far more predictable results.

  • Use plain, natural language. Write the positions as you'd brief a colleague who isn't familiar with your review process. Don't pack them with justification or step-by-step instructions β€” that tends to degrade how accurately the Agent assesses the position.

  • Describe the position, not the edit. State what a good clause looks like, not the redline you'd make. Write acceptable = "a clear disclaimer of warranty is present" rather than "remove the warranty disclaimer" β€” instruction-style wording confuses the assessment.

  • For verbatim wording, say so explicitly. This is one of the few times it's right to be prescriptive. If a clause must contain exact language β€” for a regulatory requirement, or a clause counterparties often leave out (a no-warranty section, say) β€” put the wording in quotation marks and state that it must match exactly. Otherwise the Agent uses its own discretion on the phrasing.

  • Mind differently-worded terms. If your rule describes, say, "presumed confidentiality, no marking required" but the document expresses the same idea in different words, it can be missed. Broaden the name (for example Confidentiality scope) and describe the position in natural language so the concept is recognised however it's written.

A couple of simple worked examples:

Rule name

Acceptable position

Unacceptable position

Governing law

England & Wales, or New York State

Any other governing law

Confidentiality term / survival period

12 months or longer after termination

Less than 12 months

Priority ranking 🎚️


The priority slider is currently a visual aid only. When a review returns its results, it groups them into high, medium, and low priority so the person checking the review can triage the important points first. It doesn't change how the Agent assesses a position β€” a low-priority rule is judged exactly as strictly as a high-priority one.

Do you need separate playbooks? πŸ”€


  • First-party vs third-party matching. A single playbook can be pointed at both workflows, but what you'd redline on your own template differs from what you'd flag on someone else's document, so the positions usually diverge enough that separate playbooks work better.

  • No conditional rules yet. Because rules can't be made conditional, materially different document types generally need their own playbooks β€” a client NDA versus an M&A NDA, for example, or a short facility-visit NDA versus a customer or vendor one. Commercial agreements are more likely to need distinct playbooks than NDAs.

  • Coverage strategy differs by direction. On your own paper, teams tend to build broader playbooks before going live, especially where a frontline sales team will run reviews β€” you don't want a rep to run it, hit a gap, and have a change wave through unflagged. On counterparty paper, it's usually better to start with just a few rules and grow: AI Review runs alongside your manual review and takes nothing away, so even a couple of rules already saves time.

Managing playbooks πŸ—‚οΈ


  • Publish and unpublish. A published playbook can be used in reviews; unpublish it to make changes, then republish. You can open a playbook from the Playbook hub, or from within a review (via the playbook link when you reopen the previous review cycle) to tweak it in context.

  • Copying between playbooks. You can't copy rules from one playbook into another yet, so you'll need to recreate them. Uploading an existing playbook document is the fastest way to seed a new one.

Common pitfalls ⚠️


  • A rule isn't firing β€” the name is probably too narrow. Broaden it and add alternative terms.

  • A rule fires where it shouldn't β€” the name is too broad. Tighten it toward the specific part of the document.

  • A differently-worded term is missed β€” broaden the name and describe the positions in natural language rather than exact phrasing.

  • A document-wide characteristic is missed β€” traits that run through the whole document (whether an NDA is mutual, for instance) are harder to catch than a single clause. Describe them in the rule as best you can, and always human-check these points.

πŸ’ As always, our Support Team is happy to help with anything further. Start a chat with us by clicking the Intercom button in the bottom-right-hand corner of this page, or email us at support@juro.com πŸš€

Did this answer your question?