Annotate without a queue

Not every score needs a queue behind it. If you already have a source open somewhere in Future AGI, a trace, span, dataset row, or prompt run, and something’s worth flagging, score it right there instead of setting one up.

Open the source and find the Annotations tab

Open the source’s detail view and go to the Annotations tab. It lists whatever’s already been scored on that source.

Switch to edit mode and pick your labels

Click Annotate to switch into edit mode, then pick the labels that apply and fill in a value for each. The labels on offer are the ones set up for that workspace. See Labels for how labels get organized.

Add a note, if a label supports it

Not every label carries a note field, only the ones set up for it. Where one is available, it sits right under the label as its own box, already visible, no click needed. Type into it to add context that doesn’t fit into the value itself.

Save to record the score

Click Save. This writes a score exactly like one submitted through a queue, minus the queue-item link. It shows up wherever the source appears and in exports, right next to any queue-based scores on the same source.

When to reach for a queue instead

A score saved on the spot is right for a one-off: you noticed something while looking at a source and want it on record. It stops being enough once more than one person needs to score the same batch of sources, or you need to see how far through that batch you’ve gotten. That’s what a queue is for: it organizes who scores what, and whether a reviewer has to approve before it counts as done. Create a queue walks through setting one up.

Dive deeper