Evaluation Builder
The new Evaluation Builder in Reviewr mirrors the submission form builder in structure and function, but with a key difference: Evaluation forms are used by judges to assess and score submissions. This tool allows you to build detailed evaluation criteria and assign point values to each question and answer choice.
If it’s past your live date and you still need to build your evaluation form, head to your Engage Checklist (within our third-party onboarding workspace), use the CSV template provided in the Evaluation section, and upload the attachment to the Reviewr team—either directly through the checklist or via chat.
Overview
Just like creating a submission form, you'll use the form builder interface to drag and drop fields, define your questions, and arrange your evaluation layout. However, evaluation forms generate scores as judges complete them—so scoring needs to be thoughtfully considered during form setup.
To get started:
Go to the Forms page.
You'll see all submission and evaluation forms listed.
If no evaluation form exists, click Add Form and select Evaluation Form.
Make sure you select EVALUATION FORM, all other form options will NOT work.
From there, start adding your questions and response options until your form is complete.
Building Your Evaluation Form
To get started, add all your evaluation questions into the form. As you build, decide:
How many total points each question should be worth
How much each individual response should contribute to the overall score
⚠️ Points can only be generated from multiple choice questions (e.g., radio buttons, checkboxes, dropdowns). Fields like text boxes or comment fields are commonly used for qualitative feedback but cannot contribute to the numerical score. Use them to capture judge insights, but don’t rely on them for scoring.
Example Evaluation Questions
Here are some commonly used questions with sample point values to help you get started:
Impact or Potential Benefit
Total: 15 Points
High potential impact — 15 pts
Moderate impact — 10 pts
Low impact — 5 pts
No clear impact — 0 pts
Clarity and Organization
Total: 5 Points
Very clear and well-organized — 5 pts
Somewhat clear — 3 pts
Disorganized — 1 pt
Unclear/incomplete — 0 pts
Generated Values
The Generated Values feature calculates scores for your evaluation form, including the Total score and any additional custom score calculations.
When using Generated Values, all evaluation question responses must use numerical values. The generator calculates scores by adding these values together. If you would like to use descriptive responses (such as “Excellent” or “Strong”) instead of numbers, contact the Reviewr team for assistance with configuring the scoring.
Once all evaluation questions have been created, navigate to the Generated Values page.
To edit the Total generator, hover over it and click the pencil icon. Then select the questions you want included in the total score (typically all evaluation questions).
For each question, you can configure:
Precision – The number of decimal places displayed in the score.
Multiplier – The weight of the question in the overall score.
To create an additional score calculation, click Add, enter a name for the generator, and select the questions you want included. You can also configure the precision and multiplier for each question.
After configuring your generators, test your evaluation form by assigning submissions to the Test Judge and completing an evaluation to ensure scores are calculating correctly.
Need Help with Form Setup?
Whether you're adding, deleting, or reordering questions, the following resources can help guide your workflow:
Form Builder: Guided Walkthrough
Form Builder: Informational Article
NOTE: If a newly created Evaluation Form is not showing up as available, someone from Reviewr must first publish your evaluation form to make it live.