Preparation:
Submit Evaluation CSV to Reviewr or Use the Form Editor
Ensure you have prepared the evaluation CSV file that contains the necessary details for the evaluation process. This file is critical as it serves as the foundation for your review setup, containing necessary data such as scoring criteria, points, etc.
You can build your evaluation form using the form editor. Just send us the point values for each question and response, and we’ll configure the scoring on the backend.
Create a Test Submission
NOTE: Ensure your test submission account is NOT tied to your admin credentials.
Navigate to the microsite where applications or submissions are accepted.
Complete the application process as if you were a real user, providing all necessary details and submitting the application.
Once submitted, ensure this test submission is available for review and can be used as a sample in the evaluation process.
Create a Test Judge Account
Log into the admin portal.
Go to Manage Users and then click on the Reviewers page.
Click "Add User" to create a new judge account.
Enter all required information for the test judge, such as name, email, role, and other necessary details.
Save the test judge account to finalize the process.
Create all Groups and Divisions
Decide on Group Structure:
Single Group: If you want all submissions to be in the same group, you can simply use the default "General Group" already created in the event.
Multiple Groups: If you want to classify submissions into different categories, you will need to create additional groups.
Create Groups and Divisions:
Go to the Manage Groups and Divisions page in your admin portal.
Click on "Add Group" to create a new group.
Name your new group (e.g., "Category A," "Youth Division," etc.).
Decide how submissions will be assigned to these groups:
Auto Assign Groups: If you want submissions to be automatically placed into groups by the system, select "Yes" for auto assignment. (This will typically assign submissions randomly to groups.)
Manual Assignment: If you prefer to manually assign submissions to specific groups, select "No" for auto assignment. (This gives you control over which submission goes into which group.)
Repeat these steps for each additional group you want to create.
Assigning Submissions:
Access the "Manage Submissions" Page:
Log into the admin portal and navigate to the "Manage Submissions" page.
Select Submissions to Assign:
Review the list of submissions.
To select submissions for assignment, click the checkbox on the far right of each submission you wish to assign to a group.
Note: If you are assigning different submissions to different groups, only select the submissions you wish to assign at this time. Make sure to select all submissions you want to categorize.
Use Bulk Actions to Assign to Groups:
Once you’ve selected the desired submissions, go to the "Bulk Actions" dropdown menu located at the bottom left corner of the page.
From the dropdown, select "Assign Group".
A dialog box will appear where you can choose the group to which you want to assign the selected submissions.
Finalize the Assignment:
Choose the appropriate group from the available options.
Confirm the assignment, and the selected submissions will now be categorized under the chosen group.
Managing Assignments:
Access the "Manage Groups and Divisions" Page:
Log into the admin portal and navigate to the "Manage Groups and Divisions" page.
Manage Assignments for Each Group:
On the "Manage Groups and Divisions" page, you will see all the groups you have created.
For each group, click on the "Manage Assignments" option next to the group name. This will take you to the page where you can manage which reviewers are assigned to the submissions within that group.
Review Submissions in Each Group:
Once you're on the "Manage Assignments" page for a group, you will see the list of submissions that have been assigned to that group.
Use the Dropdown to Manage Reviewer Assignments:
To assign or reassign reviewers, select the checkbox next to each submission you wish to assign.
In the bottom right corner, you'll find the dropdown menu. This menu provides you with four options for managing assignments:
Option 1: Auto-Assign Reviewers
This will randomly assign submissions to reviewers, based on the maximum and minimum number of reviewers per submission that you’ve set up.
Option 2: Clear Assignments
This will remove any existing assignments for the selected submissions.
Option 3: Manually Assign Reviewers
You can select specific reviewers (via checkboxes) and manually assign them to the submissions you’ve selected.
This option allows you to choose which reviewer gets which submission, or to unassign a reviewer.
Option 4: Assign All
This will assign every submission in the group to every reviewer in the group. This is useful if you want all reviewers to evaluate all submissions.
Finalize the Assignment:
After selecting the appropriate option for your assignments, click the "Go" button to execute the assignment process.
Adding Reviewers
Adding Reviewers Manually:
Navigate to the "Manage Users" page in the admin portal.
Go to the "Reviewers" page.
Click on "Add Reviewer" to manually enter a new reviewer.
Enter all the required information for the reviewer, such as name, email, role, and any other necessary details.
Click "Save" to ensure the reviewer is added to the system and saved properly.
Bulk Uploading Reviewers:
If you need to add a large number of reviewers, you can do so efficiently via bulk upload.
Click the "Management" button on the left sidebar in the admin portal.
Select the "Manage Reviewers" page.
In the dropdown menu at the bottom left corner, choose "Bulk Upload Reviewers".
Upload your .csv file that contains the reviewer information (ensure the file follows the required format).
Click "Go" to begin the upload process.
Assigning Reviewers to Groups:
Go to "Manage Reviewers":
Start by navigating to the "Manage Reviewers" section.
Decide How You Want to Assign Reviewers:
You can choose to assign reviewers to groups either one by one or multiple at a time. Here’s how you can do both:
Assign Reviewers to Groups One by One:
Click on the "Assign Group" button.
A menu will appear allowing you to select the specific group(s) you want to assign the reviewer to.
Select the desired group(s) and confirm the assignment.
Assign Reviewers to Groups Multiple at a Time:
Select the checkboxes on the far right side of each reviewer you want to assign.
Once the reviewers are selected, use the dropdown menu at the bottom left side of the page.
Click "Assign Group" in the dropdown.
Choose the group(s) you want to assign to all the selected reviewers.
Inviting Reviewers
Access the "Manage Reviewers" Page:
Log into the admin portal and navigate to the "Manage Reviewers" page.
Select Reviewers to Invite:
In the "Manage Reviewers" page, you will see a list of all your reviewers.
To select the reviewers you want to invite, click the checkbox on the far right of the reviewer’s row for each reviewer you wish to invite. If you want to invite all reviewers at once, click the checkbox at the top right of the reviewers table.
Use the Dropdown to Send Invitations:
After selecting the reviewers, go to the dropdown menu in the bottom left corner of the page.
From the dropdown, select "Invite" to send invitations to the selected reviewers.
Click "Go" to execute the invitation process.
Reviewers will be marked at “Invited” once the invitation process is complete.
Testing the Evaluation Process:
Log out of your admin account and log in using the reviewer account you’ve set up for testing purposes.
Once logged in as a reviewer, navigate to the reviewer dashboard or page where assigned submissions are listed.
Review the submissions assigned to you, which should appear based on the groups and assignments made earlier.
Open each submission assigned to you and review the details.
Follow the exact process the reviewer will go through, including any criteria or forms they need to fill out as part of the evaluation.
Follow this link for a guided walkthrough: https://reviewr.storylane.io/share/s9jsxpjdqdh6