JudgeWise

Getting started with JudgeWise

Everything from signing up to picking finalists, in the order you'll do it. Most organizers are set up in well under an hour.

What you'll need

Get in

A couple of minutes to your own competition.

  1. 1

    Sign up with your invite code

    /signup

    Go to the sign-up page, enter your email and a password, and type the invite code you were given. Spacing and capitalization don't matter — “POMS 2027”, “poms2027”, and “POMS2027” all work.

    Tip: No code yet? Request one and we'll email it to you.

  2. 2

    Create your competition

    /new

    Give your competition a name — a best-paper award, a grant panel, a design competition, anything expert-judged. You land on its dashboard, which tracks submissions, experts, assignments, and review progress in one place.

Set it up

Tell JudgeWise how the work should be judged.

  1. 3

    Set your rubric and settings

    Rubric tab

    Define your weighted scoring criteria, how many experts should see each submission, the review deadline, and how many finalists to pick. You can also tune the matching weights and add your own field-specific taxonomy.

  2. 4

    Add your submissions

    Papers tab

    Import a whole folder or spreadsheet of submissions, or add them one at a time. Fields are filled in automatically, and a blind-review check flags any file that accidentally reveals author identity before reviewing starts.

  3. 5

    Add your experts

    Reviewers tab

    Import your reviewer list or add people by hand — JudgeWise can fill in each person's topic areas from the web. You'll see who has accepted, reviewed, and confirmed at a glance.

  4. 6

    Flag conflicts of interest

    Conflicts tab

    Run the COI scan to check every expert against every submission and auto-exclude conflicts — their own submissions, shared institutions, and recent co-authors — so no one is assigned work they shouldn't see. Add manual conflicts too.

Run the reviews

Invite, match, and let the experts score.

  1. 7

    Invite your experts

    Emails tab

    Send branded “will you serve?” invitations in a click. Experts accept or decline with one click and their status updates automatically. Every email is yours to edit from your own templates.

  2. 8

    Auto-match submissions to experts

    Assignments tab

    One click proposes the best assignments by subject-area overlap, while respecting each expert's load limit and excluding the conflicts you flagged. Review and tweak per submission before sending.

  3. 9

    Send assignments, logins & reminders

    Emails tab

    Email each expert their assigned submissions and a one-click login, then nudge anyone running late with reminders. Re-sending never changes an expert's existing login.

Decide

Compare scores and pick the winners.

  1. 10

    Track scores as they come in

    Review Summary tab

    Experts score submissions on your weighted rubric. The review summary lines up every score side by side so nothing slips through and you can see where reviews are still outstanding.

  2. 11

    Compute finalists and notify

    Results tab

    Weighted results rank the whole field automatically and surface borderline cases for a closer look. When you're ready, notify finalists and participants in a click.

Running it as a committee?

Invite co-organizers from the Team tab. They log in with their own accounts and share the same competition — no invite code needed for people you invite.

Forgot your password?

Use forgot password to get a reset link by email. Your competition and all its data stay exactly as you left them.

Prefer to see it first? Watch the walkthrough with screenshots →

Ready when you are

Have a code? Create your competition now. If not, request one and we'll get you set up.