Labels
Create, configure, and manage annotation labels. Understand the five label types and when to use each.
About
An annotation label is a reusable template that defines what feedback annotators provide. Labels are organization-scoped: once created, any queue in your workspace can use them. This keeps annotation criteria consistent across teams and projects.
Each label has a type that determines the UI control annotators see and the value format stored in the resulting score.
Label Types
| Type | Description | Example Use Case | Value Format |
|---|---|---|---|
| Categorical | Predefined list of options. Supports single-choice or multi-choice. Can be used for auto-annotation. | Sentiment analysis: Positive, Negative, Neutral | string (single) or string[] (multi) |
| Numeric | A number within a defined range. | Relevance score from 1 to 10 | number |
| Text | Free-form text input for open-ended feedback. | Grammar corrections or rewrite suggestions | string |
| Star Rating | Visual star selector for quick quality ratings. | Overall response quality | number (1 to N) |
| Thumbs Up/Down | Binary pass/fail toggle. The fastest annotation type. | Helpfulness check: was this answer useful? | boolean |
Which type should I use?
| Scenario | Recommended Type | Why |
|---|---|---|
| Classify responses into fixed categories | Categorical | Predefined options ensure consistency and enable aggregation |
| Rate quality on a fine-grained scale | Numeric | Continuous range captures nuance that categories miss |
| Collect corrections, rewrites, or explanations | Text | Free-form input gives annotators maximum flexibility |
| Quick quality gut-check (1-5 stars) | Star Rating | Visual stars are fast and intuitive for subjective quality |
| Binary accept/reject decisions | Thumbs Up/Down | Fastest annotation type: one click per item |
| Multiple dimensions per item | Combine multiple labels in one queue | Attach several labels to a single queue for multi-dimensional annotation |
UI appearance by type
| Type | Annotator UI |
|---|---|
| Categorical (single) | Radio buttons for each option |
| Categorical (multi) | Checkboxes for each option |
| Numeric | Number input with stepper or slider |
| Text | Multi-line text area |
| Star Rating | Clickable star icons |
| Thumbs Up/Down | Thumb up and thumb down buttons |
Creating a Label
Open the Labels tab
Go to Annotations in the left sidebar, then open the Labels tab. Click Create Label.
Enter name and description
Fill in the Name field (required) and an optional Description to help annotators understand the label’s purpose.
Select a type
Choose the label Type. This cannot be changed after creation, so choose carefully.
Configure type-specific settings
Each type has its own configuration options:
- Categorical: Add at least two options. Toggle Allow multiple selection if annotators should be able to pick more than one option.
- Numeric: Set Min, Max, and Step size values. Choose the display format: Slider or Buttons.
- Text: Set Placeholder text, Min character length, and Max character length.
- Star: Set the Number of stars (1-10, default 5).
- Thumbs Up/Down: No additional settings needed.
Enable optional notes
Toggle Allow Notes if you want annotators to add free-text commentary alongside their label value. Notes are stored in the notes field of the resulting score and are available in exports and the API.
Save the label
Click Save. The label is now available for use in any queue.
Managing Labels
| Action | How |
|---|---|
| Edit | Click a label row or use the menu and select Edit. You can change the name, description, and type-specific settings, but the type itself is immutable. |
| Duplicate | Use the menu and select Duplicate. Creates a copy you can customize. |
| Archive | Use the menu and select Archive. Soft-deletes the label. Archived labels can be restored. |
| Search | Use the search bar at the top to filter labels by name. |
| Filter by type | Use the type dropdown to show only labels of a specific type. |
Label Type Settings Reference
| Type | Settings | Default |
|---|---|---|
| Categorical | options (list), multi_choice (bool) | multi_choice: false |
| Numeric | min, max, step_size | 0, 10, 1 |
| Text | placeholder, min_length, max_length | empty string, 0, 5000 |
| Star | no_of_stars | 5 |
| Thumbs Up/Down | none | none |
Note
Labels are shared across your entire organization. Any queue can use any label, and changes to a label’s settings apply everywhere the label is used. Deleting a label does not remove existing scores that were created with it.
Tip
Start with a few simple labels (e.g. a 5-star quality rating and a categorical sentiment label) before creating complex ones. You can always duplicate and customize later.