Prolific admin hub ← back to portal

Log into the portal as an admin first.

Monitor & statistics

Per-annotator counts/timing, comment progress, legacy vs two-stage.

Review annotations

Pick a participant, scroll all their submissions; block/unblock from there.

Payments & bonuses

Approve/reject/return each participant's submission on Prolific + pay per-stage bonuses (double-confirmed), with their validity + QC metrics.

Reconciliation (full view)

Every participant's LIVE Prolific submission status vs what the portal recorded (finished or not) + money owed, with mismatch cases flagged.

Disambiguate no-consensus …

Resolve Stage-B labels that reached no majority.

Problem reports …

Annotator-filed and system reports (incl. grounding-blocked comments).

Export two-stage dataset

Download the zip: per-stage annotations, merged Stage-A/B, no-consensus, + QC in its own file.

QC & LLM metrics

Correction rate, false correction, accuracy, acceptance; which labels/models get corrected.

Open a specific comment in Label Studio

Demo/admin task — builds a standalone Stage-A or Stage-B task and opens it. Isolated from the dataset: any submission on it is ignored.

Stage-B LLM pre-annotation …

Draft each entity's Stage-B labels with 3 LLMs; every annotator sees the SAME shared per-label vote tally (e.g. “YES 2/3”) as a hint, with the controls left empty (Option C). Toggling off never deletes stored drafts, and comments already drafted keep serving their hint.