Navigating the AI Grading Preferences Page
Search & Filters
The top part of the page includes dropdown filters and a search function for easy navigation:
Search for Rubric – Find existing rubrics by name.
New Rubric - Button for creating your new custom rubric
Source Dropdown – Filter rubrics based on lead sources.
Groups Dropdown – Filter by agent groups.
Agents Dropdown – Filter by individual agents.
Below these filters, users will find clickable tiles for custom AI grading rubrics.
Understanding Custom Rubrics
Each tile contains:
Title – The name of the rubric.
Edit, Duplicate, Delete Buttons – Modify or manage rubrics as needed.
Source, Group, and Agent Filters – Indicates which filters apply to the rubric.
Rubric Evaluation Sections – Detailed grading criteria categorized into four main areas. It contains the following columns:
Enabled: This column allows users to toggle each rule on or off. If enabled, the AI grading rubric will apply that specific evaluation criterion. If disabled, it will be ignored.
Prompt: This column contains the specific question or requirement the AI will assess.
Weight: This column defines how much each criterion contributes to the overall AI grading score. Users can adjust the percentage (from 1% to 100%) to reflect its importance. If a rule is disabled, the weight will be marked as N/A.
Rubric Evaluation Sections
1. Motivation and Rapport
Evaluates the agent's ability to establish motivation and build rapport with the client.
Agent asked for client's motivation?
Agent attempted rapport-building?
2. Transaction Details
Assesses the agent's attention in gathering key transaction details, including timeline, location, lead type, and property specifics. For sellers, it also covers viewings, listing scenarios, ownership, and relocation.
Agent asked for client's timeline?
Agent asked for client's locations of interest?
Agent asked for lead type?
Agent asked to identify if this was a 'double end' / 'both' lead type?
Did the agent ask about the property attributes?
Agent offered an in-home viewing/walkthrough? (IF SELLER)
Agent mentioned multiple sale/listing scenarios? (IF SELLER)
Agent verified ownership structure? (IF SELLER)
Agent asked about local relocation? (IF SELLER)
3. Client Validation
Measures the agent's efforts in verifying client information and readiness.
Agent asked if client is already represented by realtor?
Did agent ask if client is pre-qualified for a loan? (IF BUYER OR BOTH)
Did agent ask where the client heard about them or their brokerage?
4. Setting Appointments
Evaluates the agent's ability to secure appointments.
Did the agent ask to set an appointment with the client?
Did the agent get a specific appointment time scheduled with the client?
Did the agent discuss a Buyer's Agency Agreement? (IF BUYER OR BOTH)
Additional Features
Progress Bar – Displays overall percentage accumulated from configured rubric.
Save Rubric Button – Finalizes the rubric settings.
With this new customization feature, teams can fine-tune evaluation metrics to ensure agents are assessed accurately based on management needs.