You create an evaluation form, also called a scorecard or rubric, on the Forms page. Click Add Form, choose Evaluation Form, then add your questions. Only multiple-choice questions (radio buttons, checkboxes and dropdowns) can carry point values; text boxes collect reviewer comments but never add to the score. Once the questions are in, set up the score under Generated Values and assign the form to your reviewer groups so judges can open it.
This applies to admins building an evaluation form in the Form Editor. You can build and edit evaluation forms at any time, even after your event's Live Date. Reviewers who can't find their assignments should see Reviewer - Why can't I see my evaluation assignments?.
Before you start
Decide what each question is worth. A common setup totals 100 points: with 10 questions, the top option of each question is worth 10 points (for example Excellent 10, Great 8, Good 6).
If you copied this event from last year, its evaluation form keeps last year's questions and point values. Review them before judging starts.
Steps
From the Admin Dashboard, hover over Forms (paper icon) and select Forms.
Click Add Form.
Select Evaluation Form. Important: Other form types will not work for judging.
Name the form: click the pencil icon in the top-left name box, type the name and click the green check mark.
Click Add Question and choose a radio button, checkbox or dropdown question for each scored criterion.
For each answer option, enter the number of points in its Point Value field, then click Save. See Adding Point Values to Evaluation Questions.
Add text-box questions for reviewer comments where you want qualitative feedback. These don't affect the score.
Open Generated Values and set up the Total score. Follow Admin - How do I set up weighted scores (Generated Values) on my evaluation form? for this step.
Assign the form to reviewers: go to Data Management › Groups & Divisions, open the Evaluation Group Assignments tab, and select this form for each group.
Create a test judge: add a reviewer user in your program named Test Judge. Use an email alias, not your own admin email, so it doesn't interfere with your admin permissions. For example, if your admin email is name@yourorg.com, use name+judge@yourorg.com. An alias like this is a valid email address, and anything sent to the Test Judge arrives in your own inbox so you can check it.
Add the Test Judge to a reviewer group and assign it a few submissions.
Log in as the Test Judge to see what judges see. Check that the assigned submissions show up, complete an evaluation, and confirm the score calculates as expected.
If that didn't work
Reviewers say they can't open or see the evaluation form
Every evaluation form is available as soon as you create it, and you can create as many as you need; there's no publish step. If reviewers still can't see one, it usually isn't assigned to the reviewers' group. Check Data Management › Groups & Divisions › Evaluation Group Assignments and select the form for that group. Also check that the evaluation deadline hasn't passed: submissions become unavailable to reviewers after that date.
The total score ignores a question or option I added
Every new question or new answer option needs a Point Value and must be included in the score generator under Generated Values. You can add it yourself; the Reviewr team doesn't need to. This applies to forms copied from a past event too. See Admin - How do I set up weighted scores (Generated Values) on my evaluation form?.
I want answers like "Excellent" instead of numbers to drive the score
Generated Values add up numeric point values only, so give each descriptive option its own Point Value (for example Excellent 10, Great 8, Good 6). Reviewers still see the words; the score uses the numbers. You can set this up yourself: see Adding Point Values to Evaluation Questions.
I have two awards and need a different scorecard for each
Create a separate evaluation form for each award. Then assign each form to the group for that award on the Evaluation Group Assignments tab, so reviewers only see the questions for their group.