Skip to main content

Review Groups: A Detailed Guide

Review Groups add flexibility to the review process by allowing you to share scores across scholarships in the same group. The article below includes a full overview of this feature. If you'd prefer to learn about a specific step, feel free to click the links below:

Configure Review Groups in the Review tab (left navigation menu).

The Review Groups page with the left navigation menu in frame, with the Review nav item boxed (leaving its orange active-state accent bar visible) to orient a reader landing on this article.

Creating a Review Group

To create a new Review Group, navigate to the Review tab and click Add New in the upper right-hand corner of the screen.

The Review Groups page with the Groups sub-nav item and the Add New button in the upper right corner highlighted.

The Details tab appears, allowing you to start building your review group. Begin by entering a name for the group in the Review Group Name field.

The Details tab of a new review group, with the Review Group Name field highlighted, showing the empty Associated Departments and Scholarships section below it.

Next, select which scholarships to include in the group. Click the Scholarship(s) field to view your list of scholarships, then check the checkboxes for those you want added.

Note: If you are utilizing the Departments feature, you can first select the department that you are creating the review group for, and that will populate a list of scholarships within that department only.

The Scholarship(s) dropdown open on the Details tab, showing an available scholarship to add, with the Department selector narrowing the list.

As you add scholarships to a review group, they will be removed from the dropdown (since they cannot be added to more than one group). Click Save to create the review group.

After you create the Review Group, you'll see additional tabs where you can configure its options—including Rubric Setup, where you can add optional instructions for your reviewers (such as a scoring rubric) that they'll see during scoring.

Note: You'll see the review deadline next to the review group name. You can edit/customize this under Settings > Award Cycles > Award Cycle End Date.

A saved review group showing the additional configuration tabs that appear after saving, with the review deadline shown beside the group name.

If you created the review group by mistake and need to delete it, on the Details tab of the review group, you'll find the Delete button under the list of scholarships that you've assigned to the review group.

The Details tab of a review group with the Delete button below the assigned scholarships list highlighted.

Options for Blinding Applicant Data

The Question Visibility tab allows you to hide applicant names and specific application questions from Reviewers within the selected review group. To access this tab, head to the Review tab and select a review group of your choice.

The Question Visibility tab of a review group, showing the review group's sub-nav (Question Visibility already highlighted) alongside the Profile Information Visibility controls that determine what reviewers can see about each applicant. A new 'Hide AI Scores From Reviewers' control now sits below the original toggle.

Note: Blinding applicant names does not hide names in all areas where names may have been used (e.g., document uploads, letters of recommendation, etc.).

Below, in the Question Visibility for Reviewers section, you'll be able to configure which application questions will be visible to Reviewers when scoring applicants, each with its own checkbox and a visible-count indicator. Before you check anything, every section stays hidden, and the count reads zero.

The Question Visibility for Reviewers section before anything has been made visible to Reviewers - every application section and the single Before-Applying question left unchecked, with both visible-count indicators reading zero.

Checking the checkbox next to a question or an entire application section makes it visible to Reviewers; anything left unchecked stays hidden. Changes save automatically—no need to click Save.

The Question Visibility for Reviewers section, listing application questions grouped by section, each with a checkbox and a boxed visible-count indicator - Essay checked (its two sub-questions, Personal Statement and Financial Need Statement, both visible; General/Academic/Financial Information and Activities and Leadership left unchecked) and the single Before-Applying question also checked, demonstrating that some content can be made visible while other sections stay hidden.

Configuring Score Cards

Reviewers use score cards to evaluate and score the applications they review. Select a review group (via the Review tab) and click the Rubric Setup tab to start creating scoring criteria.

The Rubric Setup (formerly Score Cards) tab of a review group, showing the review group's own sub-nav with Rubric Setup already highlighted, the empty Instructions for Reviewers editor, a 'No Score Cards created yet' message, and the Create New Card section with its three real options - For Manual Review (boxed), For Auto-scoring, and For AI-scoring (BETA).

To create a score card, click For Manual Review under the Create New Card section. Enter your Score Card Name (e.g., Financial Need) and a Points value (e.g., 5), then click Save to save your new score card in the review group.

The new score card form filled in with an example name (Financial Need) and points value (5), with Save and Cancel buttons.

You can add as few or as many score cards as you'd like, which will all populate under the Score Cards list, along with a running total of points.

Note: In order for applications to be visible to a Reviewer, you will need to create at least one score card in the review group.

The Score Cards list on the Rubric Setup tab showing three saved score cards - Financial Need (5 points), GPA (5 points), and Essay (10 points) - with the running Total of 20 points beneath them.

To remove a score card from a review group, expand it and click the Delete button.

An expanded score card on the Score Cards tab with its Delete button highlighted.

Configuring Reviewer Assignments

Use the Reviewer Assignment page to add reviewers to a review group and decide which applicants each reviewer scores.

To get started, go to Review, open a review group, and click Reviewer Assignment in the menu beside the group.

The Reviewer Assignment page of a review group, with the Assignment strategy panel, coverage summary, Reviewers list and Needs reviewers list.

First, add the reviewers. Click into the search field under Reviewers. A list of eligible staff is displayed. Scroll through the list or start typing a name, then click Add next to each reviewer you want in the group.

Note: If you cannot find a reviewer in the list, they do not yet have an account. To learn how to create an account for them, click here.

The Add reviewer field open on the Reviewer Assignment page, listing eligible staff accounts with an Add button beside each name.

Next, choose how applicants are matched to your reviewers. Under Assignment strategy, select one of the three options:

  • All reviewers: every reviewer scores every applicant. This works best for small groups and committees. For example, with six applicants and two reviewers, both reviewers are assigned all six applications.

  • Random: each applicant is given a set number of reviewers, and applicants are spread evenly across your reviewers. For example, with six applicants, two reviewers and one reviewer per applicant, each reviewer is assigned three applicants. Use Reviewers per applicant to set the number.

  • Manual: you choose which reviewer scores which applicant. Nothing is assigned automatically.

Selecting a strategy creates a draft and nothing changes yet. For All reviewers and Random, a message shows how many assignments will be created. Click Review & apply to apply the strategy, or Discard to cancel. For Manual, click Save strategy.

The All reviewers strategy selected, with a note that applying it creates 12 assignments and the Review and apply and Discard buttons.

The row of numbers below the strategy shows Coverage, Fully covered, Needs reviewers and Reviews completed, so you can see at a glance how many applicants still need a reviewer.

Applicants who still need reviewers are listed under Needs reviewers. With Manual (or to adjust any other strategy), check the box next to an applicant, then click Assign to reviewer. To select everyone in the list, check Select all. To let the system spread the remaining applicants across your reviewers, click Auto-assign remaining.

Callahan, Owen ticked in the Needs reviewers list, with the 1 applicant selected bar and the Assign to reviewer button below the list.

Click the name of the reviewer who should score the selected applicant(s). A reviewer who already has all the selected applicants is not available.

The Assign 1 applicant to dialog listing the reviewers Anders, Wesley and Ashby, Dana, with a Cancel button.

The applicant leaves the Needs reviewers list, and the Assigned count for that reviewer goes up.

The Reviewer Assignment page after an assignment, with Anders, Wesley showing 1 assigned applicant and coverage at 17 percent.

To see or change the applicants assigned to a reviewer, click the side panel icon in that reviewer's Actions column. The panel shows how many applicants are assigned, completed and pending, and lists each assigned applicant.

The reviewer side panel for Anders, Wesley, with Assigned, Completed and Pending counts and Callahan, Owen in the assigned applicants list.

To unassign an applicant, check the box next to their name and click Unassign selected. The applicant returns to the Needs reviewers list. To take a reviewer out of the group altogether, click Remove reviewer from group at the bottom of the panel.

The reviewer side panel with Callahan, Owen ticked and the Unassign selected (1) button active.

Note: Once any applicant in the group has a score, the assignment strategy can no longer be changed. You can still make manual adjustments under Reviewers and Needs reviewers.

Applicants

This tab lists all applicants in the review group who need to be scored or are currently being scored. An applicant appears here once, even if they applied to one or more scholarships in the review group. Expanding an applicant shows their average score and a per-criterion breakdown, along with a Deny action that marks them denied for every scholarship in the group still in a neutral status.

The Applicants tab of a review group, listing five real applicants (Callahan, Nair, Ramstead, Reyes, Torres) once each, with Callahan, Owen expanded to show an average score and a per-criterion breakdown (Financial Need, GPA, Essay), plus a Deny action.

Reviewer View with Review Groups

Reviewers can access only the applications assigned to them.

Under the Question Visibility tab in a review group, you'll find the option to display the applicant's full name to Reviewers.

The Profile Information Visibility toggle on a review group's Question Visibility tab, shown again as the article introduces the Reviewer's own point of view - unchecked by default, meaning applicant names stay hidden from Reviewers.

List of applicants with blinded names:

A Reviewer's list of assigned applicants with names blinded, showing identifiers instead of applicant names so scoring stays anonymous.

List of applicants with their full names displayed:

The same Reviewer applicant list with full names displayed, as it appears once an administrator enables the full-name option on the review group's Question Visibility tab.

In order for Reviewers to score applicants, upon logging in, they will need to select a review group; there, they will find a list of applicants they were assigned to.

The screen a Reviewer sees after logging in, listing the review groups they belong to so they can pick one and see the applicants assigned to them.

Once they select an applicant, they'll have access to all application questions visible to them and the score board. Their score board includes an optional notes section. Once they finish scoring an applicant, they can click Next Applicant or the Next button.

A Reviewer's view of a single applicant, with the application questions made visible to Reviewers alongside the score board, an optional notes area, and the Next Applicant control.

On every applicant's page, they will also have access to the Instructions tab, where they can read the scoring instructions you've provided.

The Instructions tab on an applicant's page in the Reviewer portal, where a Reviewer reads the scoring guidance the administrator provided.

If you would like to impersonate a Reviewer user, click here to learn how.

Did this answer your question?