Queue settings & limits

Every default value, permission, and cap that governs how a queue behaves

This is the reference for every field, status, role, and limit that shapes a queue in the annotation workspace. Field names below are the API/SDK payload names; where a field is also a control on the queue’s form in the app, both set the same value.

Queue fields and their defaults

FieldWhat it holdsDefault
nameThe queue’s name. Must be unique among non-archived queues in its org and scoperequired, no default
descriptionFree text describing the queue’s purposeempty
instructionsMarkdown guidelines shown to annotatorsempty
statusWorkflow state: draft, active, paused, or completed (see transitions below)draft
assignment_strategyHow items get handed to annotators: manual, round robin, or load balanced. Round robin and load balanced are marked “Coming soon” in the app today, only manual is selectablemanual
annotations_requiredHow many independent annotators must complete an item before it’s done1
reservation_timeout_minutesHow long an opened item stays locked to the annotator who opened it before it’s released back to the queue. Options are 15, 30, 60, or 240 minutes60
requires_reviewWhether a completed item needs reviewer approval before it counts as done. Needs an entitlement, see Limits, caps, and gated featuresfalse
auto_assignWhether every queue member can annotate any item without being assigned to it firstfalse
is_defaultWhether this is the queue Future AGI creates automatically for a project, dataset, or agent definitionfalse
project / dataset / agent_definitionWhich one, if any, the queue is scoped to. A queue is scoped to at most one of the three, or to none for an org-level queuenone

A queue’s name only has to be unique among non-archived queues in its scope, so archiving a queue frees up its name for reuse. The same logic caps default queues: only one non-archived default queue can exist per project, per dataset, and per agent definition at a time.

Each label you attach to a queue carries two settings of its own: order, which controls where it appears in the annotation workspace, and required, which forces the annotator to fill it in before submitting. Marking a label required needs an entitlement, covered in Limits, caps, and gated features.

Queue statuses and the exact permitted transitions

StatusCan move to
DraftActive
ActivePaused, Completed
PausedActive, Completed
CompletedActive, Paused

There’s no path back to Draft once a queue leaves it, and Completed isn’t a dead end: reopening it by moving it to Active or Paused is a normal transition, not a special case.

Archive, restore, and hard delete

Archiving a queue takes it out of the active list. It stops accepting new work, but it can be restored later: everything about it (its items, labels, and annotators) comes back as it was.

Hard delete is different: it’s permanent. It removes the queue and everything attached to it for good, with no way to bring it back. To hard delete a queue, you have to pass force=true and type the queue’s exact name to confirm, so it can’t fire from a stray click or a typo.

Item statuses and the six source types

StatusMeaning
PendingWaiting for an annotator to pick it up
In ProgressAn annotator has it open, reserved to them for the queue’s reservation_timeout_minutes so nobody else can grab it in the meantime. On a queue that requires review, In Progress also covers a submitted item awaiting reviewer approval: its reservation is cleared and it’s no longer open to anyone until a reviewer acts on it
CompletedAll required annotations have been submitted for it (and approved, if the queue requires review)
SkippedAn annotator passed on it. It stays available for someone else to pick up

An item can come from six sources:

Source typeWhat it points to
Dataset rowA row from a dataset
TraceA full trace
SpanA single span inside a trace
PrototypeA prototype run
SimulationA simulation
SessionA trace session

Roles and what each role can do

RoleCan do
AnnotatorSubmit annotations on items in the queue
ReviewerApprove or send back submitted annotations, when the queue requires review
ManagerConfigure the queue: its settings, labels, and annotators

Only annotators and managers can actually submit an annotation. Holding the reviewer role by itself doesn’t grant that.

Whoever creates a queue becomes its first manager automatically. Org admins and workspace admins act as managers on every queue in their scope too, without ever being added as a member.

Limits, caps, and gated features

LimitValue
Items per Add Items call1,000
Filter-based selection ceiling10,000 items
Items per synchronous export1,000
Mentions per comment50
Emoji reaction length16 characters

Note

How many queues your org can have is capped by your plan, not by the product itself, so the number depends on your plan.

Two more things need an entitlement: turning on Requires Review for a queue, and marking a per-label required flag. Both fail with an upgrade prompt if your plan doesn’t include them.

Keep exploring

Was this page helpful?

Questions & Discussion