Skip to main content

Review Groups: A Detailed Guide

This article covers creating and configuring review groups. For reviewing and denying applicants, see Bulk Denying Applicants During Review.

Review Groups add flexibility to the review process by allowing you to share scores across scholarships in the same group. The article below includes a full overview of this feature. If you'd prefer to learn about a specific step, feel free to click the links below:

Configure Review Groups in the Review tab.

The Review Groups page, with the Review item boxed in the left menu.

Creating a Review Group

To create a new Review Group, navigate to the Review tab and click Add New in the upper right-hand corner of the screen.

The Review Groups page with the Groups sub-nav item and the Add New button in the upper right corner highlighted.

The Details tab appears, allowing you to start building your review group. Begin by entering a name for the group in the Review Group Name field.

The Details tab of a new review group, with the Review Group Name field highlighted above the empty Associated Departments and Scholarships section.

Next, select which scholarships to include in the group. Click the Scholarship(s) field to view your list of scholarships, then check the checkboxes for those you want added.

Note: If you are utilizing the Departments feature, you can first select the department that you are creating the review group for, and that will populate a list of scholarships within that department only.

The Scholarship(s) dropdown open on the Details tab, showing an available scholarship to add, with the Department selector narrowing the list.

As you add scholarships to a review group, they will be removed from the dropdown (since they cannot be added to more than one group). Click Save to create the review group.

After you create the Review Group, you'll see additional tabs where you can configure its options—including Rubric Setup, where you can add optional instructions for your reviewers (such as a scoring rubric) that they'll see during scoring.

Note: You'll see the review deadline next to the review group name. You can edit/customize this under Settings > Award Cycles > Award Cycle End Date.

A saved review group showing the additional configuration tabs that appear after saving, with the review deadline shown beside the group name.

If you created the review group by mistake and need to delete it, on the Details tab of the review group, you'll find the Delete button under the list of scholarships that you've assigned to the review group.

The Details tab of a review group with the Delete button below the assigned scholarships list highlighted.

Options for Blinding Applicant Data

The Question Visibility tab allows you to hide applicant names and specific application questions from Reviewers within the selected review group. To access this tab, head to the Review tab and select a review group of your choice.

The Question Visibility tab of a review group, with the Profile Information Visibility controls and the new Hide AI Scores From Reviewers control.

Note: Blinding applicant names does not hide names in all areas where names may have been used (e.g., document uploads, letters of recommendation, etc.).

Below, in the Question Visibility for Reviewers section, you'll be able to configure which application questions will be visible to Reviewers when scoring applicants, each with its own checkbox and a visible-count indicator. Before you check anything, every section stays hidden, and the count reads zero.

The Question Visibility for Reviewers section with nothing made visible: each section and the Before-Applying question unchecked, both counts at zero.

Checking the checkbox next to a question or an entire application section makes it visible to Reviewers; anything left unchecked stays hidden. Changes save automatically—no need to click Save.

The Question Visibility for Reviewers section with Essay and the Before-Applying question checked, and the other sections left unchecked.

Configuring Score Cards

Reviewers use score cards to evaluate and score the applications they review. Select a review group (via the Review tab) and click the Rubric Setup tab to start creating scoring criteria.

The Rubric Setup tab with no score cards yet, and the Create New Card section with For Manual Review (boxed), For Auto-scoring and For AI-scoring.

To create a score card, click For Manual Review under the Create New Card section. Enter your Score Card Name (e.g., Financial Need) and a Points value (e.g., 5), then click Save to save your new score card in the review group.

The new score card form filled in with an example name (Financial Need) and points value (5), with Save and Cancel buttons.

You can add as few or as many score cards as you'd like, which will all populate under the Score Cards list, along with a running total of points.

Note: In order for applications to be visible to a Reviewer, you will need to create at least one score card in the review group.

The Score Cards list on the Rubric Setup tab, with Financial Need, GPA and Essay and a running Total of 20 points.

To remove a score card from a review group, expand it and click the Delete button.

An expanded score card on the Score Cards tab with its Delete button highlighted.

Configuring Reviewer Assignments

Use the Reviewer Assignment page to add reviewers to a review group and decide which applicants each reviewer scores.

To get started, go to Review, open a review group, and click Reviewer Assignment.

The Reviewer Assignment page, with Reviewer Assignment highlighted in the group menu beside the strategy, Reviewers and Needs reviewers panels.

First, add the reviewers. Click into the search field under Reviewers. A list of eligible staff is displayed. Scroll through the list or start typing a name, then click Add next to each reviewer you want in the group.

Note: If you cannot find a reviewer in the list, they are either already added to the review group or do not yet have an account. To learn how to create an account for them, click here.

The Add reviewer field on the Reviewer Assignment page, open to a list of eligible staff accounts with an Add button beside each name.

Next, choose how applicants are matched to your reviewers. Under Assignment strategy, select one of the three options:

  • All reviewers: every reviewer scores every applicant. This works best for small groups and committees. For example, with six applicants and two reviewers, both reviewers are assigned all six applications.

  • Random: each applicant is given a set number of reviewers, and applicants are spread evenly across your reviewers. For example, with six applicants, two reviewers and one reviewer per applicant, each reviewer is assigned three applicants. Use Reviewers per applicant to set the number.

  • Manual: you choose which reviewer scores which applicant. Nothing is assigned automatically.

Selecting a strategy creates a draft and nothing changes yet. For All reviewers and Random, a message shows how many assignments will be created. Click Review & apply to apply the strategy, or Discard to cancel. For Manual, click Save strategy.

The All reviewers strategy selected, with a note that applying it creates 12 assignments and the Review and apply and Discard buttons.

The row of numbers below the strategy shows Coverage, Fully covered, Needs reviewers and Reviews completed, so you can see at a glance how many applicants still need a reviewer.

Applicants who still need reviewers are listed under Needs reviewers. With Manual (or to adjust any other strategy), check the box next to an applicant, then click Assign to reviewer. To select everyone in the list, check Select all. To let the system spread the remaining applicants across your reviewers, click Auto-assign remaining.

Callahan, Owen ticked in the Needs reviewers list, with the 1 applicant selected bar and the Assign to reviewer button below the list.

Click the name of the reviewer who should score the selected applicant(s). A reviewer who already has all the selected applicants is not available.

The Assign 1 applicant to dialog listing the reviewers Anders, Wesley and Ashby, Dana, with a Cancel button.

The applicant leaves the Needs reviewers list, and the Assigned count for that reviewer goes up.

The Reviewer Assignment page after an assignment, with the Assigned count boxed at 1 for Anders, Wesley and coverage at 17 percent.

To see or change the applicants assigned to a reviewer, click the side panel icon in that reviewer's Actions column. The panel shows how many applicants are assigned, completed, and pending, and lists each assigned applicant.

Reviewer Assignment page with Anders, Wesley's panel open and an arrow pointing to the highlighted side panel icon in the Actions column.

To unassign an applicant, check the box next to their name and click Unassign selected. The applicant returns to the Needs reviewers list. To remove a reviewer from the group altogether, click Remove reviewer from group at the bottom of the panel.

Caution: Unassigning an applicant after a reviewer has started scoring, or removing a reviewer who has submitted scores, permanently deletes those scores and notes.

The reviewer side panel with Callahan, Owen ticked and the Unassign selected (1) button active.

Note: Once any applicant in the group has a score, the assignment strategy can no longer be changed. You can still make manual adjustments under Reviewers and Needs reviewers.

Applicants

This tab lists all applicants in the review group who need to be scored or are currently being scored. An applicant appears here once, even if they applied to one or more scholarships in the review group. Expanding an applicant shows their average score and a per-criterion breakdown, along with a Deny action that marks them denied for every scholarship in the group still in a neutral status.

The Applicants tab, with Callahan, Owen expanded to show an average score and a per-criterion breakdown, plus a Deny action.

Reviewer View with Review Groups

Reviewers can access only the applications assigned to them.

Under the Question Visibility tab in a review group, you'll find the option to display the applicant's full name to Reviewers.

The Profile Information Visibility toggle on the Question Visibility tab, unchecked by default so applicant names stay hidden from Reviewers.

List of applicants with blinded names:

A Reviewer's list of assigned applicants with names blinded, showing identifiers instead of applicant names so scoring stays anonymous.

List of applicants with their full names displayed:

The Reviewer applicant list with full names displayed, after the full-name option is enabled on the Question Visibility tab.

In order for Reviewers to score applicants, upon logging in, they will need to select a review group; there, they will find a list of applicants they were assigned to.

The screen a Reviewer sees after logging in, listing the review groups they belong to so they can pick one and see the applicants assigned to them.

Once they select an applicant, they'll have access to all application questions visible to them and the score board. Their score board includes an optional notes section. Once they finish scoring an applicant, they can click Next Applicant or the Next button.

A Reviewer view of one applicant, with the visible application questions, the score board, a notes area and the Next Applicant control.

On every applicant's page, they will also have access to the Instructions tab, where they can read the scoring instructions you've provided.

The Instructions tab on an applicant's page in the Reviewer portal, where a Reviewer reads the scoring guidance the administrator provided.

If you would like to impersonate a Reviewer user, click here to learn how.

Did this answer your question?