Annotator portal (test)

Annotator portal

How to get through (order matters)

API base URL — leave http://127.0.0.1:5002 unless your compose uses another API_HOST_PORT.
Login — seeded test user: annotator@test.local / testpass123 (unless you changed SEED_PASSWORD). Click Login; you should see green OK.
Who am I? — optional: click GET /api/me. Check warmup_annotations, warmup_total (10), in_warmup, completed_valid_count only when you use GET /api/me?stats=1 (not on normal session checks). completed-valid-comments returns the JSON array of production comment_id strings.
Next task — click POST /api/annotator/next-task. Use the blue Open in Label Studio link (opens in a new tab). The JSON below has the same label_studio_url plus ls_task_id, comment_id, and thread text.
Annotate in Label Studio — open the link from next-task (patched image). After Submit, the LS tab waits for the portal webhook to finish, then returns to this portal tab so you can read validation feedback. You can also use the floating ← Annotator portal button.
Complete — Submit in Label Studio triggers the webhook. The API stores the annotation and checks that at least one ENTITY_HEAD span exists. If not, the assignment stays leased. When OK, it is marked submitted — use Complete (manual) only if webhooks are off.
Feedback — See the Classification feedback section below the buttons (or click Check classification feedback). Label Studio itself does not show this text.
Repeat — next-task → … → complete. First 10 tasks are shared warm-ups; then production-style items (prod_*).
Logout — Clear token, then log in as another user if needed.

API base URL Base URL (Flask API — not Label Studio)

Session

Token is stored in localStorage as annotator_token.

Session: unknown

Comment ID (report this if something breaks)

Annotator

Each line lists the failing check (e.g. [ENTITY_HEAD]). After next-task, errors show only if you are still on the same comment (repeat). Use Check classification feedback anytime. Return from LS uses poll_token on the URL (rebuild the label-studio image after changing custom-portal.js; set PORTAL_PUBLIC_URL to this portal’s origin).

Last response

{}

Classification feedback

Last response