Annotator portal (test)

Annotator portal

How to get through (order matters)

Your first task is a short guided tutorial — do it to learn the two task types.
Click Next task to get a comment.
Click Open in Label Studio — you are logged in automatically.
Do the task and click Submit:
- Stage A: mark the players/teams mentioned and link references to the same one. The pre-filled spans are only a model suggestion — add or remove spans and links; don't just submit it unchanged;
- Stage B: classify the already-marked entities — choose yes / no / unsure for the different categories, and highlight the text that supports each choice.
Wait to return here and read the feedback, then get the next one.
If a comment looks broken, click Report problem and add a short note.
Reach the 50-comment minimum to get your completion code — paste it into the MTurk HIT and submit. After that, keep going for bonus pay at the per-annotation stage rate (see the pay box below).

📄 Keep open while you work: One-page cheat sheet · Full guidelines

Need help? Contact the annotation study team:
uaoa.annotation.study@gmail.com

How pay works. Your first 50 comments are the required minimum for this HIT — the base reward covers them, and reaching the minimum unlocks your completion code. After the minimum, you can keep working for bonus pay: every extra annotation simply pays its stage rate (Stage A and Stage B rates appear in your progress bar). These bonus tasks are served as a mix of about 4 Stage A to 6 Stage B per batch of 10 annotations.

Login Email Password

Session

Session: unknown

Comment ID (report this if something breaks)

Annotator

Each line lists the failing check (e.g. [ENTITY_HEAD]). Return from LS uses poll_token on the URL (rebuild the label-studio image after changing custom-portal.js; set PORTAL_PUBLIC_URL to this portal’s origin).

Last response

{}

Classification feedback

Last response