Evaluation Builder
The new Evaluation Builder in Reviewr mirrors the submission form builder in structure and function, but with a key difference: Evaluation forms are used by judges to assess and score submissions. This tool allows you to build detailed evaluation criteria and assign point values to each question and answer choice.
If it’s past your live date and you still need to build your evaluation form, head to your Engage Checklist (within our third-party onboarding workspace), use the CSV template provided in the Evaluation section, and upload the attachment to the Reviewr team—either directly through the checklist or via chat.
Overview
Just like creating a submission form, you'll use the form builder interface to create your questions, and arrange your evaluation layout. However, evaluation forms generate scores as judges complete them—so scoring needs to be thoughtfully considered during form setup.
To get started:
Go to the Forms page.
You'll see all submission and evaluation forms listed.
If no evaluation form exists, click Add Form and select Evaluation Form.
Make sure you select EVALUATION FORM, all other form options will NOT work.
From there, start adding your questions and response options until your form is complete.
Building Your Evaluation Form
To get started, add all your evaluation questions into the form. As you build, decide:
⚠️ Points can only be generated from multiple choice questions (e.g., radio buttons, checkboxes, dropdowns). Fields like text boxes or comment fields are commonly used for qualitative feedback but cannot contribute to the numerical score. Use them to capture judge insights, but don’t rely on them for scoring.
Generated Values
The Generated Values feature calculates scores for your evaluation form, including the Total score and any additional custom score calculations.
Once all evaluation questions have been created, navigate to the Generated Values page.
To create an additional score calculation, click Add, enter a name for the generator, and select the questions you want included. You can also configure the precision and multiplier for each question.
To edit the Total generator, hover over it and click the pencil icon. Then select the questions you want included in the total score (typically all evaluation questions).
For each question, you can configure:
Precision – The number of decimal places displayed in the score.
Multiplier – The weight of the question in the overall score.
After configuring your generators, test your evaluation form by assigning submissions to the Test Judge and completing an evaluation to ensure scores are calculating correctly.