Review Settings

Review Settings

Reviews of submissions are conducted according to two important settings: Reviewer Allocation (how are submissions assigned to reviewers) and Review Privacy (how much information is shared between reviewers/submitters).

Reviewer Allocation

A submission can only be reviewed by a reviewer, and reviewers can only review submissions that are assigned to them.

Manual Manually assigning submissions is tedious, however sometimes required if many rules determine who can review what.

Automatic: Random Each submission is randomly assigned to a member of the "Reviewer Group" that was set on the "Review Phase" that is currently active. Read more about phases /here/.

Automatic: Queue Each reviewer in the "Reviewer Group" has a number of submissions awaiting their review. To balance out over-utilization of some reviewers, and to give reviewers with more availability higher volume, submissions can automatically be assigned to the member in the group of reviewers that has the least number of outstanding submissions to be reviewed.

Automatic: Smart BETA - Based on observed reviewer behavior we can forecast the expected time when the review will be completed by a reviewer. Utilizing this, this setting will assign the submission to the reviewer who is expected to review this submission the earliest.

Please note, a submission can only be reviewed by a reviewer, and reviewers can only review submissions that are assigned to them.

Review Privacy

Oftentimes, to avoid bias, identity or certain information about the submitter should not be revealed to reviewers.

Collaboration Reviewers can see the author of a submission. Submission authors see their assigned reviewer.

Blind Review Reviewers cannot see the author of a submission. Submission authors cannot see their assigned reviewer. Reviewers can see other reviews.

Anonymous Like blind review, but reviewers cannot see other reviews.

 

    • Related Articles

    • Review Privacy Settings

      Oftentimes, to avoid bias, identity or certain information about the submitter should not be revealed to reviewers. You can enable/disable the following criteria on Call or Review Phase basis: Blind Review: reviewers cannot see the author of a ...
    • Marketing & Communication Settings

      This page is designated for Super Administrators to allow the changes for outgoing emails to submitters and reviewers and much more. From the Home page select Administration Under Marketing & Communication select Communication Settings Select Edit to ...
    • Call Configuration: Communication Settings

      Updates in the system can trigger notifications, to Administrators, Reviewers, and Submitters. Per call, the administrator can configure how frequently these notifications should be delivered. Submitter Communication Submitters can be notified about ...
    • Create a Review Phase

      This step is Optional. Once you have collected Submissions to your Call, you may want to review them to streamline the process of deciding which to Accept/Reject. The Review Phase covers the period where Reviewers will evaluate Submissions and ...
    • Delete a Submission/ Review Phase

      In the case, you no longer require an additional submission or a review phase, you can delete it from the call settings. Please note, any submissions or reviews received for that phase will still be listed in the submissions and reviews tab, but no ...