Review Settings

Review Settings

Reviews of submissions are governed by two key settings: Reviewer Allocation (how submissions are assigned) and Review Privacy (what reviewers and submitters can see).

Reviewer Allocation

A submission can only be reviewed by users assigned as reviewers. Likewise, reviewers may only access submissions explicitly assigned to them.

Manual: Submissions are manually assigned to reviewers. This method can be time-consuming but is sometimes necessary when assignment rules are highly specific.

Automatic: Random: Submissions are randomly distributed among members of the assigned Reviewer Group in the currently active Review Phase.

Automatic: Queue: Submissions are assigned to the reviewer with the fewest outstanding reviews. This helps balance the workload among reviewers based on their current queue.

Automatic: Smart (Beta): Uses observed reviewer behavior to estimate when a submission is likely to be reviewed. The system then assigns the submission to the reviewer predicted to complete it the fastest.

Note: A submission must be assigned before it can be reviewed.

Review Privacy

To reduce bias and preserve impartiality, some identifying information may be hidden from either reviewers or submitters.

Collaboration: Reviewers can see the author’s name, and submission authors can see who reviewed their submission.

Blind Review: Reviewers cannot see the author’s name. Authors cannot see reviewer names; however, reviewers can see each other's reviews.

Anonymous: Extends blind review by also preventing reviewers from seeing each other's evaluations.


    • Related Articles

    • Review Privacy Settings

      Oftentimes, to avoid bias, identity or certain information about the submitter should not be revealed to reviewers. You can enable/disable the following criteria on Call or Review Phase basis: Blind Review: reviewers cannot see the author of a ...
    • Marketing & Communication Settings

      This page is for Super Administrators who need to configure outgoing emails for submitters, reviewers, and more. Step 1: Access Administration From the Home page, select Administration. Step 2: Go to Communication Settings Under Marketing & ...
    • Call Configuration: Communication Settings

      Updates in the system can trigger notifications, to Administrators, Reviewers, and Submitters. Per call, the administrator can configure how frequently these notifications should be delivered. Submitter Communication Submitters can be notified about ...
    • Create a Review Phase

      This step is Optional. Once you have collected Submissions to your Call, you may want to review them to streamline the process of deciding which to Accept/Reject. The Review Phase covers the period where Reviewers will evaluate Submissions and ...
    • Delete a Submission/ Review Phase

      In the case, you no longer require an additional submission or a review phase, you can delete it from the call settings. Please note, any submissions or reviews received for that phase will still be listed in the submissions and reviews tab, but no ...