# Future AGI Documentation

> Future AGI is an AI lifecycle platform for building, evaluating, observing, and optimizing AI applications. This documentation covers the Python SDK, platform features, integrations, and API reference.

## Docs

### Get Started

- [Overview](https://docs.futureagi.com/docs)
- [Send your first trace](https://docs.futureagi.com/docs/get-started/send-your-first-trace)
- [Route your first LLM request](https://docs.futureagi.com/docs/get-started/route-your-first-llm-request)
- [Connect no code agents](https://docs.futureagi.com/docs/get-started/connect-no-code-agents)
- [Create your first prompt](https://docs.futureagi.com/docs/get-started/create-your-first-prompt)
- [Migrate from Langfuse](https://docs.futureagi.com/docs/get-started/migrate/langfuse)
- [Overview](https://docs.futureagi.com/docs/self-hosting)
- [Requirements](https://docs.futureagi.com/docs/self-hosting/requirements)
- [Installation](https://docs.futureagi.com/docs/self-hosting/installation)
- [System configuration](https://docs.futureagi.com/docs/self-hosting/configuration/system)
- [Environment variables](https://docs.futureagi.com/docs/self-hosting/configuration/environment)
- [Overview](https://docs.futureagi.com/docs/self-hosting/production)
- [Checklist](https://docs.futureagi.com/docs/self-hosting/production/checklist)
- [Security & TLS](https://docs.futureagi.com/docs/self-hosting/production/security-tls)
- [Backups & restore](https://docs.futureagi.com/docs/self-hosting/production/backups-restore)
- [Monitoring](https://docs.futureagi.com/docs/self-hosting/production/monitoring)
- [Upgrades & rollback](https://docs.futureagi.com/docs/self-hosting/production/upgrades-rollback)
- [Troubleshooting & FAQs](https://docs.futureagi.com/docs/self-hosting/troubleshooting)
- [Support](https://docs.futureagi.com/docs/self-hosting/support)
- [What's new](https://docs.futureagi.com/docs/release-notes)

### Agent Playground

- [Overview](https://docs.futureagi.com/docs/agent-playground)
- [Understanding Agent Playground](https://docs.futureagi.com/docs/agent-playground/concepts/understanding-agent-playground)
- [Versions & Execution](https://docs.futureagi.com/docs/agent-playground/concepts/versions-and-execution)
- [Create a Graph](https://docs.futureagi.com/docs/agent-playground/features/create-graph)
- [Build a Workflow](https://docs.futureagi.com/docs/agent-playground/features/build-workflow)
- [Run & Monitor](https://docs.futureagi.com/docs/agent-playground/features/run-and-monitor)

### Annotations

- [Overview](https://docs.futureagi.com/docs/annotations)
- [Scores](https://docs.futureagi.com/docs/annotations/concepts/scores)
- [Labels](https://docs.futureagi.com/docs/annotations/features/labels)
- [Queues](https://docs.futureagi.com/docs/annotations/features/queues)
- [Add Items to Queues](https://docs.futureagi.com/docs/annotations/features/add-items)
- [Annotate Items](https://docs.futureagi.com/docs/annotations/features/annotate)
- [Inline Annotations](https://docs.futureagi.com/docs/annotations/features/inline)
- [Analytics & Agreement](https://docs.futureagi.com/docs/annotations/features/analytics)
- [Export Annotations](https://docs.futureagi.com/docs/annotations/features/export)
- [Automation Rules](https://docs.futureagi.com/docs/annotations/features/automation)
- [Python SDK](https://docs.futureagi.com/docs/annotations/sdk/python)
- [JavaScript SDK](https://docs.futureagi.com/docs/annotations/sdk/javascript)
- [Annotation Queue Using SDK](https://docs.futureagi.com/docs/annotations/sdk/annotation-queue-using-sdk)

### Agent Command Center

- [Overview](https://docs.futureagi.com/docs/command-center)
- [How it works](https://docs.futureagi.com/docs/command-center/concepts/core)
- [Virtual keys & access control](https://docs.futureagi.com/docs/command-center/concepts/virtual-keys)
- [Configuration](https://docs.futureagi.com/docs/command-center/concepts/configuration)
- [Platform integration](https://docs.futureagi.com/docs/command-center/concepts/platform-integration)
- [Supported providers](https://docs.futureagi.com/docs/command-center/features/providers)
- [Self-hosted models](https://docs.futureagi.com/docs/command-center/features/self-hosted-models)
- [Endpoints overview](https://docs.futureagi.com/docs/command-center/api/endpoints)
- [Chat completions](https://docs.futureagi.com/docs/command-center/api/chat)
- [Embeddings & reranking](https://docs.futureagi.com/docs/command-center/api/embeddings)
- [Media endpoints](https://docs.futureagi.com/docs/command-center/api/media)
- [Assistants API](https://docs.futureagi.com/docs/command-center/api/assistants)
- [Files & vector stores](https://docs.futureagi.com/docs/command-center/api/files)
- [Async & batch](https://docs.futureagi.com/docs/command-center/api/async-batch)
- [Request & response headers](https://docs.futureagi.com/docs/command-center/api/headers)
- [Routing & reliability](https://docs.futureagi.com/docs/command-center/features/routing)
- [Guardrails](https://docs.futureagi.com/docs/command-center/features/guardrails)
- [Caching](https://docs.futureagi.com/docs/command-center/features/caching)
- [Rate limiting](https://docs.futureagi.com/docs/command-center/features/rate-limiting)
- [Cost tracking](https://docs.futureagi.com/docs/command-center/features/cost-tracking)
- [Observability](https://docs.futureagi.com/docs/command-center/features/observability)
- [Shadow experiments](https://docs.futureagi.com/docs/command-center/features/shadow-experiments)
- [Webhooks](https://docs.futureagi.com/docs/command-center/features/webhooks)
- [Custom Properties](https://docs.futureagi.com/docs/command-center/features/custom-properties)
- [MCP & A2A](https://docs.futureagi.com/docs/command-center/features/mcp-a2a)
- [Organization management](https://docs.futureagi.com/docs/command-center/admin/organizations)
- [Self-hosted](https://docs.futureagi.com/docs/command-center/deployment/self-hosted)
- [Error handling](https://docs.futureagi.com/docs/command-center/guides/errors)
- [Troubleshooting](https://docs.futureagi.com/docs/command-center/guides/troubleshooting)

### Dataset

- [Overview](https://docs.futureagi.com/docs/dataset)
- [Understanding Datasets](https://docs.futureagi.com/docs/dataset/concept/understanding-dataset)
- [Static Columns](https://docs.futureagi.com/docs/dataset/concept/static-column)
- [Dynamic Columns](https://docs.futureagi.com/docs/dataset/concept/dynamic-column)
- [Synthetic Data](https://docs.futureagi.com/docs/dataset/concept/synthetic-data)
- [Create New Dataset](https://docs.futureagi.com/docs/dataset/features/create)
- [Add Rows to Dataset](https://docs.futureagi.com/docs/dataset/features/add-rows)
- [Add Columns to Dataset](https://docs.futureagi.com/docs/dataset/features/add-columns)
- [Run Prompt in Dataset](https://docs.futureagi.com/docs/dataset/features/run-prompt)
- [Experiments in Dataset](https://docs.futureagi.com/docs/dataset/features/experiments)
- [Add Annotation](https://docs.futureagi.com/docs/dataset/features/annotate)

### Error Feed

- [Overview](https://docs.futureagi.com/docs/error-feed)
- [How It Works](https://docs.futureagi.com/docs/error-feed/concepts/how-it-works)
- [Error Taxonomy](https://docs.futureagi.com/docs/error-feed/concepts/taxonomy)
- [Scoring](https://docs.futureagi.com/docs/error-feed/concepts/scoring)
- [Severity and Status](https://docs.futureagi.com/docs/error-feed/concepts/severity-and-status)
- [The Feed](https://docs.futureagi.com/docs/error-feed/features/the-feed)
- [Issue Overview](https://docs.futureagi.com/docs/error-feed/features/issue-overview)
- [Traces](https://docs.futureagi.com/docs/error-feed/features/traces)
- [State Graph](https://docs.futureagi.com/docs/error-feed/features/state-graph)
- [Trends](https://docs.futureagi.com/docs/error-feed/features/trends)
- [Metadata Panel](https://docs.futureagi.com/docs/error-feed/features/metadata-panel)
- [Triage Workflow](https://docs.futureagi.com/docs/error-feed/features/triage-workflow)
- [Deep Analysis](https://docs.futureagi.com/docs/error-feed/features/deep-analysis)
- [Linear Integration](https://docs.futureagi.com/docs/error-feed/features/linear-integration)
- [Sampling](https://docs.futureagi.com/docs/error-feed/features/sampling)

### Evaluation

- [Overview](https://docs.futureagi.com/docs/evaluation)
- [Understanding Evaluation](https://docs.futureagi.com/docs/evaluation/concepts/understanding-evaluation)
- [Eval types](https://docs.futureagi.com/docs/evaluation/concepts/eval-types)
- [Eval templates & versions](https://docs.futureagi.com/docs/evaluation/concepts/eval-templates)
- [Evaluator models](https://docs.futureagi.com/docs/evaluation/concepts/evaluator-models)
- [Output types](https://docs.futureagi.com/docs/evaluation/concepts/output-types)
- [Error localization](https://docs.futureagi.com/docs/evaluation/concepts/error-localization)
- [Guardrails](https://docs.futureagi.com/docs/evaluation/concepts/guardrails)
- [Composite evals](https://docs.futureagi.com/docs/evaluation/concepts/composite-evals)
- [Feedback](https://docs.futureagi.com/docs/evaluation/concepts/feedback)
- [Ground truth](https://docs.futureagi.com/docs/evaluation/concepts/ground-truth)
- [Built-in Evals](https://docs.futureagi.com/docs/evaluation/builtin)
- [Evaluate via Platform & SDK](https://docs.futureagi.com/docs/evaluation/features/evaluate)
- [Create Custom Evals](https://docs.futureagi.com/docs/evaluation/features/custom)
- [Use Custom Models](https://docs.futureagi.com/docs/evaluation/features/custom-models)
- [Future AGI Models](https://docs.futureagi.com/docs/evaluation/features/futureagi-models)
- [Evaluate CI/CD Pipeline](https://docs.futureagi.com/docs/evaluation/features/cicd)

### Falcon AI

- [Overview](https://docs.futureagi.com/docs/falcon-ai)
- [Using Falcon AI](https://docs.futureagi.com/docs/falcon-ai/features/chat)
- [Skill Builder](https://docs.futureagi.com/docs/falcon-ai/features/skills)
- [MCP Connectors](https://docs.futureagi.com/docs/falcon-ai/features/mcp-connectors)

### Knowledge Base

- [Overview](https://docs.futureagi.com/docs/knowledge-base)
- [Understanding Knowledge Base](https://docs.futureagi.com/docs/knowledge-base/concepts/concept)
- [Create KB Using SDK](https://docs.futureagi.com/docs/knowledge-base/features/sdk)
- [Create KB Using UI](https://docs.futureagi.com/docs/knowledge-base/features/ui)

### Observability

- [Overview](https://docs.futureagi.com/docs/observe)
- [Quickstart](https://docs.futureagi.com/docs/observe/quickstart)
- [Spans](https://docs.futureagi.com/docs/observe/concepts/spans)
- [Traces](https://docs.futureagi.com/docs/observe/concepts/traces)
- [Sessions](https://docs.futureagi.com/docs/observe/concepts/sessions)
- [Users](https://docs.futureagi.com/docs/observe/concepts/users)
- [Voice observability](https://docs.futureagi.com/docs/observe/concepts/voice-observability)
- [Observability model](https://docs.futureagi.com/docs/observe/concepts/observability-model)
- [Overview](https://docs.futureagi.com/docs/observe/guides/explore-dashboard)
- [Filters](https://docs.futureagi.com/docs/observe/guides/explore-dashboard/filters)
- [Views](https://docs.futureagi.com/docs/observe/guides/explore-dashboard/views)
- [Display options](https://docs.futureagi.com/docs/observe/guides/explore-dashboard/display-options)
- [Setup alerts](https://docs.futureagi.com/docs/observe/guides/setup-alerts)
- [Setup evals](https://docs.futureagi.com/docs/observe/guides/setup-evals)
- [Filters](https://docs.futureagi.com/docs/observe/reference/filters)
- [traceAI](https://docs.futureagi.com/docs/observe/concepts/traceai)
- [No traces appear](https://docs.futureagi.com/docs/observe/troubleshooting/no-traces-appearing)
- [Missing spans or fields](https://docs.futureagi.com/docs/observe/troubleshooting/missing-attributes)
- [Dashboard numbers look wrong](https://docs.futureagi.com/docs/observe/troubleshooting/dashboard-numbers-look-wrong)
- [Alerts not firing](https://docs.futureagi.com/docs/observe/troubleshooting/alerts-did-not-fire)

### Optimization

- [Overview](https://docs.futureagi.com/docs/optimization)
- [Understanding Optimization](https://docs.futureagi.com/docs/optimization/concepts/concept)
- [Bayesian Search](https://docs.futureagi.com/docs/optimization/optimizers/bayesian-search)
- [Meta-Prompt](https://docs.futureagi.com/docs/optimization/optimizers/meta-prompt)
- [ProTeGi](https://docs.futureagi.com/docs/optimization/optimizers/protegi)
- [PromptWizard](https://docs.futureagi.com/docs/optimization/optimizers/promptwizard)
- [GEPA](https://docs.futureagi.com/docs/optimization/optimizers/gepa)
- [Random Search](https://docs.futureagi.com/docs/optimization/optimizers/random-search)
- [Using Python SDK](https://docs.futureagi.com/docs/optimization/features/using-python-sdk)
- [Using Platform](https://docs.futureagi.com/docs/optimization/features/using-platform)

### Prompt

- [Overview](https://docs.futureagi.com/docs/prompt)
- [Prompt Engineering](https://docs.futureagi.com/docs/prompt/concepts/prompt-engineering)
- [Understanding Prompts](https://docs.futureagi.com/docs/prompt/concepts/understanding-prompts)
- [Versions and Labels](https://docs.futureagi.com/docs/prompt/concepts/versions-and-labels)
- [Create Prompt from Scratch](https://docs.futureagi.com/docs/prompt/features/create-from-scratch)
- [Create from Existing Template](https://docs.futureagi.com/docs/prompt/features/create-from-template)
- [Create with AI](https://docs.futureagi.com/docs/prompt/features/create-with-ai)
- [Prompt Workbench Using SDK](https://docs.futureagi.com/docs/prompt/features/sdk)
- [Linked Traces](https://docs.futureagi.com/docs/prompt/features/linked-traces)
- [Manage Folders](https://docs.futureagi.com/docs/prompt/features/folders)

### Protect

- [Overview](https://docs.futureagi.com/docs/protect)
- [Use Cases](https://docs.futureagi.com/docs/protect/concepts/concept)
- [Run Protect via SDK](https://docs.futureagi.com/docs/protect/features/run-protect)

### Prototype

- [Overview](https://docs.futureagi.com/docs/prototype)
- [Understanding Prototype](https://docs.futureagi.com/docs/prototype/concepts/understanding-prototype)
- [Versions and Runs](https://docs.futureagi.com/docs/prototype/concepts/versions-and-runs)
- [Set Up Prototype](https://docs.futureagi.com/docs/prototype/features/set-up-prototype)
- [Evals](https://docs.futureagi.com/docs/prototype/features/evals)
- [Choose Winner](https://docs.futureagi.com/docs/prototype/features/choose-winner)

### Resources

- [Admin & Settings](https://docs.futureagi.com/docs/admin-settings)
- [API Keys](https://docs.futureagi.com/docs/admin-settings/api-keys)
- [Profile & Security](https://docs.futureagi.com/docs/admin-settings/profile-security)
- [Organization Settings](https://docs.futureagi.com/docs/admin-settings/organization-settings)
- [User Management](https://docs.futureagi.com/docs/admin-settings/user-management)
- [Workspace Management](https://docs.futureagi.com/docs/admin-settings/workspace-management)
- [AI Providers](https://docs.futureagi.com/docs/admin-settings/ai-providers)
- [Integrations](https://docs.futureagi.com/docs/admin-settings/integrations)
- [Usage Summary](https://docs.futureagi.com/docs/admin-settings/usage-summary)
- [Billing & Pricing](https://docs.futureagi.com/docs/admin-settings/billing-pricing)
- [Roles & Permissions](https://docs.futureagi.com/docs/roles-and-permissions)
- [Installation](https://docs.futureagi.com/docs/installation)
- [FAQ](https://docs.futureagi.com/docs/faq)

### Simulation

- [Overview](https://docs.futureagi.com/docs/simulation)
- [Agent Definition](https://docs.futureagi.com/docs/simulation/concepts/agent-definition)
- [Scenarios](https://docs.futureagi.com/docs/simulation/concepts/scenarios)
- [Personas](https://docs.futureagi.com/docs/simulation/concepts/personas)
- [Global Nodes](https://docs.futureagi.com/docs/simulation/concepts/global-nodes)
- [Run Voice Simulation](https://docs.futureagi.com/docs/simulation/features/run-simulation)
- [Chat Simulation Using SDK](https://docs.futureagi.com/docs/simulation/features/simulation-using-sdk)
- [Chat Replay](https://docs.futureagi.com/docs/simulation/features/observe-to-simulate)
- [Voice Replay](https://docs.futureagi.com/docs/simulation/features/voice-replay)
- [Prompt Simulation](https://docs.futureagi.com/docs/simulation/features/prompt-simulation)
- [Evaluate Tool Calling](https://docs.futureagi.com/docs/simulation/features/evaluate-tool-calling)
- [View Results](https://docs.futureagi.com/docs/simulation/features/view-results)
- [Fix My Agent](https://docs.futureagi.com/docs/simulation/features/fix-my-agent)

### Integrations

- [Overview](https://docs.futureagi.com/docs/integrations)
- [OpenAI](https://docs.futureagi.com/docs/integrations/traceai/openai)
- [Anthropic](https://docs.futureagi.com/docs/integrations/traceai/anthropic)
- [AWS Bedrock](https://docs.futureagi.com/docs/integrations/traceai/bedrock)
- [Vertex AI](https://docs.futureagi.com/docs/integrations/traceai/vertexai)
- [Google GenAI](https://docs.futureagi.com/docs/integrations/traceai/google_genai)
- [Google ADK](https://docs.futureagi.com/docs/integrations/traceai/google_adk)
- [Groq](https://docs.futureagi.com/docs/integrations/traceai/groq)
- [MistralAI](https://docs.futureagi.com/docs/integrations/traceai/mistralai)
- [Together AI](https://docs.futureagi.com/docs/integrations/traceai/togetherai)
- [Ollama](https://docs.futureagi.com/docs/integrations/traceai/ollama)
- [Portkey](https://docs.futureagi.com/docs/integrations/traceai/portkey)
- [LangChain](https://docs.futureagi.com/docs/integrations/traceai/langchain)
- [LangGraph](https://docs.futureagi.com/docs/integrations/traceai/langgraph)
- [LlamaIndex](https://docs.futureagi.com/docs/integrations/traceai/llamaindex)
- [LlamaIndex Workflows](https://docs.futureagi.com/docs/integrations/traceai/llamaindex-workflows)
- [LiteLLM](https://docs.futureagi.com/docs/integrations/traceai/litellm)
- [CrewAI](https://docs.futureagi.com/docs/integrations/traceai/crewai)
- [AutoGen](https://docs.futureagi.com/docs/integrations/traceai/autogen)
- [Haystack](https://docs.futureagi.com/docs/integrations/traceai/haystack)
- [DSPy](https://docs.futureagi.com/docs/integrations/traceai/dspy)
- [OpenAI Agents](https://docs.futureagi.com/docs/integrations/traceai/openai_agents)
- [Smol Agents](https://docs.futureagi.com/docs/integrations/traceai/smol_agents)
- [Instructor](https://docs.futureagi.com/docs/integrations/traceai/instructor)
- [PromptFlow](https://docs.futureagi.com/docs/integrations/traceai/promptflow)
- [Guardrails](https://docs.futureagi.com/docs/integrations/traceai/guardrails)
- [MCP](https://docs.futureagi.com/docs/integrations/traceai/mcp)
- [Mastra](https://docs.futureagi.com/docs/integrations/traceai/mastra)
- [Vercel AI SDK](https://docs.futureagi.com/docs/integrations/traceai/vercel)
- [LiveKit](https://docs.futureagi.com/docs/integrations/traceai/livekit)
- [Pipecat](https://docs.futureagi.com/docs/integrations/traceai/pipecat)
- [Overview](https://docs.futureagi.com/docs/integrations/traceai/java)
- [Spring Boot](https://docs.futureagi.com/docs/integrations/traceai/spring-boot)
- [OpenAI](https://docs.futureagi.com/docs/integrations/traceai/java/openai)
- [Anthropic](https://docs.futureagi.com/docs/integrations/traceai/java/anthropic)
- [AWS Bedrock](https://docs.futureagi.com/docs/integrations/traceai/java/bedrock)
- [Cohere](https://docs.futureagi.com/docs/integrations/traceai/java/cohere)
- [Pinecone](https://docs.futureagi.com/docs/integrations/traceai/java/pinecone)
- [LLM Providers](https://docs.futureagi.com/docs/integrations/traceai/java/llm-providers)
- [Vector Databases](https://docs.futureagi.com/docs/integrations/traceai/java/vector-databases)
- [Frameworks](https://docs.futureagi.com/docs/integrations/traceai/java/frameworks)
- [n8n](https://docs.futureagi.com/docs/integrations/traceai/n8n)
- [Langfuse](https://docs.futureagi.com/docs/integrations/import/langfuse)
- [Datadog](https://docs.futureagi.com/docs/integrations/export/datadog)
- [PostHog](https://docs.futureagi.com/docs/integrations/export/posthog)
- [Mixpanel](https://docs.futureagi.com/docs/integrations/export/mixpanel)
- [PagerDuty](https://docs.futureagi.com/docs/integrations/export/pagerduty)
- [Cloud Storage](https://docs.futureagi.com/docs/integrations/export/cloud-storage)
- [Message Queues](https://docs.futureagi.com/docs/integrations/export/message-queues)

### Cookbooks

- [Overview](https://docs.futureagi.com/docs/cookbook)
- [Running Your First Eval](https://docs.futureagi.com/docs/cookbook/quickstart/first-eval)
- [Custom Eval Metrics: Write Your Own Evaluation Criteria](https://docs.futureagi.com/docs/cookbook/quickstart/custom-eval-metrics)
- [Hallucination Detection with Faithfulness & Groundedness](https://docs.futureagi.com/docs/cookbook/quickstart/hallucination-detection)
- [RAG Pipeline Evaluation: Debug Retrieval vs Generation](https://docs.futureagi.com/docs/cookbook/quickstart/rag-evaluation)
- [Multimodal Evaluation: Images, Audio, and PDF](https://docs.futureagi.com/docs/cookbook/quickstart/multimodal-eval)
- [Tone, Toxicity, and Bias Detection Evals](https://docs.futureagi.com/docs/cookbook/quickstart/tone-toxicity-bias-eval)
- [Evaluate Customer Agent Conversations](https://docs.futureagi.com/docs/cookbook/quickstart/conversation-eval)
- [Dataset SDK: Upload, Evaluate, and Download Results](https://docs.futureagi.com/docs/cookbook/quickstart/batch-eval)
- [Async Evaluations for Large-Scale Testing](https://docs.futureagi.com/docs/cookbook/quickstart/async-batch-eval)
- [Text-to-SQL Evaluation](https://docs.futureagi.com/docs/cookbook/quickstart/text-to-sql-eval)
- [Chat Simulation: Run Multi-Persona Conversations via SDK](https://docs.futureagi.com/docs/cookbook/quickstart/chat-simulation-personas)
- [Voice Simulation: Define Agents, Personas, and Run Call Tests](https://docs.futureagi.com/docs/cookbook/quickstart/voice-simulation)
- [Tool-Calling Agent Simulation with Tracing](https://docs.futureagi.com/docs/cookbook/quickstart/tool-calling-simulation)
- [Simulate from the Prompt Workbench](https://docs.futureagi.com/docs/cookbook/quickstart/prompt-workbench-simulation)
- [Create and Manage Datasets from the Dashboard](https://docs.futureagi.com/docs/cookbook/quickstart/dataset-management)
- [Synthetic Data Generation: Create Test Datasets from a Schema](https://docs.futureagi.com/docs/cookbook/quickstart/synthetic-data-generation)
- [Annotate Datasets with Human-in-the-Loop Workflows](https://docs.futureagi.com/docs/cookbook/quickstart/dataset-annotation)
- [Import Datasets from Hugging Face](https://docs.futureagi.com/docs/cookbook/quickstart/huggingface-dataset-import)
- [Dynamic Dataset Columns: Enrich Rows with AI-Generated Data](https://docs.futureagi.com/docs/cookbook/quickstart/dynamic-dataset-columns)
- [Prompt Versioning: Create, Label, and Serve Prompt Versions](https://docs.futureagi.com/docs/cookbook/quickstart/prompt-versioning)
- [Prototype and Iterate on LLM Applications](https://docs.futureagi.com/docs/cookbook/quickstart/prototype-llm-app)
- [Manual Tracing: Add Custom Spans to Any Application](https://docs.futureagi.com/docs/cookbook/quickstart/manual-tracing)
- [Session-Based Observability for Multi-Turn Conversations](https://docs.futureagi.com/docs/cookbook/quickstart/session-observability)
- [Monitoring & Alerts: Track LLM Performance and Set Quality Thresholds](https://docs.futureagi.com/docs/cookbook/quickstart/monitoring-alerts)
- [Inline Evals in Tracing: Score Every Response as It's Generated](https://docs.futureagi.com/docs/cookbook/quickstart/inline-evals-tracing)
- [Distributed Tracing: Connect Spans Across Services](https://docs.futureagi.com/docs/cookbook/quickstart/distributed-tracing)
- [Prompt Optimization: Improve a Prompt Automatically](https://docs.futureagi.com/docs/cookbook/quickstart/prompt-optimization)
- [Compare Optimization Strategies: ProTeGi, GEPA, and PromptWizard](https://docs.futureagi.com/docs/cookbook/quickstart/compare-optimizers)
- [Dataset Optimization: Improve Prompts Directly in Your Dataset](https://docs.futureagi.com/docs/cookbook/quickstart/dataset-optimization)
- [Protect: Add Safety Guardrails to LLM Outputs](https://docs.futureagi.com/docs/cookbook/quickstart/protect-guardrails)
- [Knowledge Base: Upload Documents and Query with the SDK](https://docs.futureagi.com/docs/cookbook/quickstart/knowledge-base)
- [Experimentation: Compare Prompts and Models on a Dataset](https://docs.futureagi.com/docs/cookbook/quickstart/experimentation-compare-prompts)
- [Evaluation-Driven Development: Score Every Prompt Change Before Shipping](https://docs.futureagi.com/docs/cookbook/quickstart/eval-driven-dev)
- [CI/CD Eval Pipeline: Automate Quality Gates in GitHub Actions](https://docs.futureagi.com/docs/cookbook/quickstart/cicd-eval-pipeline)
- [Test and Fix Your Chat Agent with Simulated Conversations](https://docs.futureagi.com/docs/cookbook/use-cases/end-to-end-agent-testing)
- [Monitor LLM Quality in Production and Catch Regressions](https://docs.futureagi.com/docs/cookbook/use-cases/production-quality-monitoring)
- [End-to-End with Falcon AI: Trace → Debug → Evaluate → Dataset → Fix in One Workflow](https://docs.futureagi.com/docs/cookbook/falcon-ai/end-to-end)
- [Context-Aware Trace Debugging with Falcon AI](https://docs.futureagi.com/docs/cookbook/falcon-ai/context-aware-debugging)
- [Building Golden Datasets from Production Traces with Falcon AI](https://docs.futureagi.com/docs/cookbook/falcon-ai/eval-datasets-from-traces)
- [Cut LLM Costs 80% With Semantic Caching](https://docs.futureagi.com/docs/cookbook/command-center/semantic-caching)
- [Debug LLM Traces From Your IDE Using Natural Language MCP Queries](https://docs.futureagi.com/docs/cookbook/mcp/debug-traces-from-ide)
- [Building an Eval Correction Loop: Teaching Your Evaluator What 'Good' Means for Your Domain](https://docs.futureagi.com/docs/cookbook/evaluation/eval-correction-loop)
- [Deploy the Full Open-Source AI Stack Locally With Docker Compose in 5 Minutes](https://docs.futureagi.com/docs/cookbook/self-hosting/docker-compose-quickstart)
- [Using FutureAGI Evals](https://docs.futureagi.com/docs/cookbook/using-futureagi-evals)
- [Using FutureAGI Protect](https://docs.futureagi.com/docs/cookbook/using-futureagi-protect)
- [Using FutureAGI Dataset](https://docs.futureagi.com/docs/cookbook/using-futureagi-dataset)
- [Using FutureAGI KB](https://docs.futureagi.com/docs/cookbook/using-futureagi-kb)
- [Portkey Integration](https://docs.futureagi.com/docs/cookbook/portkey-integration)
- [LangChain/LangGraph](https://docs.futureagi.com/docs/cookbook/langchain-langgraph)
- [LlamaIndex PDF RAG](https://docs.futureagi.com/docs/cookbook/llamaindex-pdf-rag)
- [CrewAI Research Team](https://docs.futureagi.com/docs/cookbook/crewai-research-team)
- [MongoDB](https://docs.futureagi.com/docs/cookbook/mongodb)
- [Meeting Summarization](https://docs.futureagi.com/docs/cookbook/meeting-summarization)
- [AI SDR Evaluation](https://docs.futureagi.com/docs/cookbook/ai-sdr)
- [AI Agents Evaluation](https://docs.futureagi.com/docs/cookbook/ai-agents)
- [Image Evaluation](https://docs.futureagi.com/docs/cookbook/image-evaluation)
- [Observing a LangGraph agent and obtaining insights](https://docs.futureagi.com/docs/cookbook/observe-langgraph-agent-and-obtain-insights)
- [Text-to-SQL Evaluation](https://docs.futureagi.com/docs/cookbook/text-to-sql)
- [RAG with LangChain](https://docs.futureagi.com/docs/cookbook/rag-langchain)
- [Evaluate RAG Apps](https://docs.futureagi.com/docs/cookbook/evaluate-rag)
- [Trustworthy RAG Chatbots](https://docs.futureagi.com/docs/cookbook/trustworthy-rag)
- [Decrease RAG Hallucination](https://docs.futureagi.com/docs/cookbook/decrease-hallucination)
- [End-to-End Prompt Optimization](https://docs.futureagi.com/docs/cookbook/end-to-end-optimization)
- [Basic Prompt Optimization](https://docs.futureagi.com/docs/cookbook/basic-optimization)
- [GEPA Optimization](https://docs.futureagi.com/docs/cookbook/gepa-optimization)
- [Eval Metrics for Optimization](https://docs.futureagi.com/docs/cookbook/eval-metrics-optimization)
- [Compare Strategies](https://docs.futureagi.com/docs/cookbook/compare-optimization)
- [Import Datasets](https://docs.futureagi.com/docs/cookbook/import-datasets)
- [Chat Simulation with Fix My Agent](https://docs.futureagi.com/docs/cookbook/chat-simulation-fix-agent)
- [Simulate SDK Demo](https://docs.futureagi.com/docs/cookbook/simulate-sdk)
- [Error Feed with Google ADK](https://docs.futureagi.com/docs/cookbook/error-feed/google-adk-multi-agent)

### SDK Overview

- [SDK Overview](https://docs.futureagi.com/docs/sdk)
- [Evaluation](https://docs.futureagi.com/docs/sdk/list/evaluation)
- [TraceAI](https://docs.futureagi.com/docs/sdk/list/traceai)
- [Core SDKs](https://docs.futureagi.com/docs/sdk/list/core)

### Evaluation

- [Overview](https://docs.futureagi.com/docs/sdk/evals)
- [Running Evaluations](https://docs.futureagi.com/docs/sdk/evals/evaluate)
- [AutoEval](https://docs.futureagi.com/docs/sdk/evals/autoeval)
- [LLM-as-Judge](https://docs.futureagi.com/docs/sdk/evals/llm-judge)
- [Guardrails](https://docs.futureagi.com/docs/sdk/evals/guardrails-module)
- [Local & Hybrid](https://docs.futureagi.com/docs/sdk/evals/local)
- [Distributed Evaluator](https://docs.futureagi.com/docs/sdk/evals/distributed)
- [Streaming](https://docs.futureagi.com/docs/sdk/evals/streaming)
- [Cloud Evals](https://docs.futureagi.com/docs/sdk/evals/cloud-evals)
- [Feedback Loops](https://docs.futureagi.com/docs/sdk/evals/feedback)
- [Code Security](https://docs.futureagi.com/docs/sdk/evals/code-security)
- [OpenTelemetry](https://docs.futureagi.com/docs/sdk/evals/otel)
- [Overview](https://docs.futureagi.com/docs/sdk/evals/metrics)
- [String & Similarity](https://docs.futureagi.com/docs/sdk/evals/metrics/string)
- [JSON & Structured](https://docs.futureagi.com/docs/sdk/evals/metrics/json)
- [Hallucination](https://docs.futureagi.com/docs/sdk/evals/metrics/hallucination)
- [RAG](https://docs.futureagi.com/docs/sdk/evals/metrics/rag)
- [Agents & Functions](https://docs.futureagi.com/docs/sdk/evals/metrics/agents)
- [Guardrails](https://docs.futureagi.com/docs/sdk/evals/metrics/guardrails)

### traceAI

- [Overview](https://docs.futureagi.com/docs/sdk/tracing)
- [Set up tracing](https://docs.futureagi.com/docs/sdk/tracing/set-up-tracing)
- [Instrument with helpers](https://docs.futureagi.com/docs/sdk/tracing/instrument-with-traceai-helpers)
- [Set session & user IDs](https://docs.futureagi.com/docs/sdk/tracing/set-session-user-id)
- [Attributes, metadata & tags](https://docs.futureagi.com/docs/sdk/tracing/add-attributes-metadata-tags)
- [Log prompt templates](https://docs.futureagi.com/docs/sdk/tracing/log-prompt-templates)
- [Events, exceptions & status](https://docs.futureagi.com/docs/sdk/tracing/add-events-exceptions-status)
- [Mask attributes](https://docs.futureagi.com/docs/sdk/tracing/mask-span-attributes)
- [Create tool spans](https://docs.futureagi.com/docs/sdk/tracing/create-tool-spans)
- [Get span context](https://docs.futureagi.com/docs/sdk/tracing/get-current-span-context)
- [In-line evals](https://docs.futureagi.com/docs/sdk/tracing/in-line-evals)
- [Annotate via API](https://docs.futureagi.com/docs/sdk/tracing/annotating-using-api)
- [Advanced examples](https://docs.futureagi.com/docs/sdk/tracing/advanced-tracing-examples)
- [Langfuse integration](https://docs.futureagi.com/docs/sdk/tracing/langfuse-integration)
- [register()](https://docs.futureagi.com/docs/sdk/tracing/register)
- [FITracer & custom spans](https://docs.futureagi.com/docs/sdk/tracing/fitracer)
- [Context helpers](https://docs.futureagi.com/docs/sdk/tracing/context-helpers)
- [TraceConfig](https://docs.futureagi.com/docs/sdk/tracing/trace-config)
- [EvalTags](https://docs.futureagi.com/docs/sdk/tracing/eval-tags)
- [Instrumentors](https://docs.futureagi.com/docs/sdk/tracing/instrumentors)
- [Environment variables](https://docs.futureagi.com/docs/sdk/tracing/environment-variables)
- [Semantic conventions](https://docs.futureagi.com/docs/sdk/tracing/semantic-conventions)

### Simulation

- [Overview](https://docs.futureagi.com/docs/sdk/simulate)

### Datasets

- [Overview](https://docs.futureagi.com/docs/sdk/datasets)

### Prompt Optimization

- [Overview](https://docs.futureagi.com/docs/sdk/optimization)

### Annotation Queues

- [Overview](https://docs.futureagi.com/docs/sdk/annotation-queues)
- [Labels](https://docs.futureagi.com/docs/sdk/annotation-queues/labels)
- [Queue management](https://docs.futureagi.com/docs/sdk/annotation-queues/queues)
- [Queue lifecycle](https://docs.futureagi.com/docs/sdk/annotation-queues/lifecycle)
- [Queue items](https://docs.futureagi.com/docs/sdk/annotation-queues/items)
- [Annotations](https://docs.futureagi.com/docs/sdk/annotation-queues/annotations)
- [Scores](https://docs.futureagi.com/docs/sdk/annotation-queues/scores)
- [Progress & analytics](https://docs.futureagi.com/docs/sdk/annotation-queues/analytics)
- [Export](https://docs.futureagi.com/docs/sdk/annotation-queues/export)
- [Data models](https://docs.futureagi.com/docs/sdk/annotation-queues/data-models)

### Knowledge Base

- [Overview](https://docs.futureagi.com/docs/sdk/knowledgebase)

### Protect

- [Overview](https://docs.futureagi.com/docs/sdk/protect)

### API Reference

- [Introduction](https://docs.futureagi.com/docs/api)
- [Health Check](https://docs.futureagi.com/docs/api/health/healthcheck)
- [List Eval Tasks](https://docs.futureagi.com/docs/api/eval-tasks/list-eval-tasks-filtered)
- [Create Eval Task](https://docs.futureagi.com/docs/api/eval-tasks/create-eval-task)
- [Get Eval Task](https://docs.futureagi.com/docs/api/eval-tasks/get-eval-task)
- [Update Eval Task](https://docs.futureagi.com/docs/api/eval-tasks/update-eval-task)
- [Delete Eval Task](https://docs.futureagi.com/docs/api/eval-tasks/delete-eval-task)
- [Bulk Delete Eval Tasks](https://docs.futureagi.com/docs/api/eval-tasks/bulk-delete-eval-tasks)
- [Pause Eval Task](https://docs.futureagi.com/docs/api/eval-tasks/pause-eval-task)
- [Unpause Eval Task](https://docs.futureagi.com/docs/api/eval-tasks/unpause-eval-task)
- [Eval Task Aggregations](https://docs.futureagi.com/docs/api/eval-tasks/eval-task-aggregations)
- [List Custom Eval Configs](https://docs.futureagi.com/docs/api/custom-eval-configs/list-configs-filtered)
- [Create Custom Eval Config](https://docs.futureagi.com/docs/api/custom-eval-configs/create-custom-eval-config)
- [Get Custom Eval Config](https://docs.futureagi.com/docs/api/custom-eval-configs/get-custom-eval-config)
- [Update Custom Eval Config](https://docs.futureagi.com/docs/api/custom-eval-configs/update-custom-eval-config)
- [Delete Custom Eval Config](https://docs.futureagi.com/docs/api/custom-eval-configs/delete-custom-eval-config)
- [Check Config Exists](https://docs.futureagi.com/docs/api/custom-eval-configs/check-config-exists)
- [Get Eval Template Names](https://docs.futureagi.com/docs/api/dataset-evals/get-eval-template-names)
- [Create Custom Eval Template](https://docs.futureagi.com/docs/api/dataset-evals/create-custom-eval-template)
- [List Dataset Evals](https://docs.futureagi.com/docs/api/dataset-evals/list-dataset-evals)
- [Get Eval Structure](https://docs.futureagi.com/docs/api/dataset-evals/get-eval-structure)
- [Add Dataset Eval](https://docs.futureagi.com/docs/api/dataset-evals/add-dataset-eval)
- [Start Evals Process](https://docs.futureagi.com/docs/api/dataset-evals/start-evals-process)
- [Delete Dataset Eval](https://docs.futureagi.com/docs/api/dataset-evals/delete-dataset-eval)
- [Edit and Run Eval](https://docs.futureagi.com/docs/api/dataset-evals/edit-and-run-eval)
- [List Scenarios](https://docs.futureagi.com/docs/api/scenarios/listscenarios)
- [Get Scenario Details](https://docs.futureagi.com/docs/api/scenarios/getscenario)
- [Create Scenario](https://docs.futureagi.com/docs/api/scenarios/createscenario)
- [Edit Scenario](https://docs.futureagi.com/docs/api/scenarios/editscenario)
- [Delete Scenario](https://docs.futureagi.com/docs/api/scenarios/deletescenario)
- [Add Rows with AI](https://docs.futureagi.com/docs/api/scenarios/addscenariorowswithai)
- [Add Columns](https://docs.futureagi.com/docs/api/scenarios/addcolumns)
- [List Personas](https://docs.futureagi.com/docs/api/personas/listpersonas)
- [Create Persona](https://docs.futureagi.com/docs/api/personas/createpersona)
- [Update Persona](https://docs.futureagi.com/docs/api/personas/updatepersona)
- [Delete Persona](https://docs.futureagi.com/docs/api/personas/deletepersona)
- [Duplicate Persona](https://docs.futureagi.com/docs/api/personas/duplicatepersona)
- [List Agent Definitions](https://docs.futureagi.com/docs/api/agent-definitions/listagentdefinitions)
- [Create Agent Definition](https://docs.futureagi.com/docs/api/agent-definitions/createagentdefinition)
- [Get Agent Definition](https://docs.futureagi.com/docs/api/agent-definitions/getagentdefinition)
- [Delete Agent Definitions](https://docs.futureagi.com/docs/api/agent-definitions/deleteagentdefinitions)
- [Fetch from Provider](https://docs.futureagi.com/docs/api/agent-definitions/fetchassistantfromprovider)
- [List Agent Versions](https://docs.futureagi.com/docs/api/agent-versions/listagentversions)
- [Create Agent Version](https://docs.futureagi.com/docs/api/agent-versions/createagentversion)
- [Get Agent Version](https://docs.futureagi.com/docs/api/agent-versions/getagentversion)
- [Get Version Call Executions](https://docs.futureagi.com/docs/api/agent-versions/getversioncallexecutions)
- [Get Version Eval Summary](https://docs.futureagi.com/docs/api/agent-versions/getversionevalsummary)
- [List Test Runs](https://docs.futureagi.com/docs/api/run-tests/listruntests)
- [Create Run Test](https://docs.futureagi.com/docs/api/run-tests/createruntest)
- [Get Test Run Details](https://docs.futureagi.com/docs/api/run-tests/getruntestdetails)
- [Delete Test Run](https://docs.futureagi.com/docs/api/run-tests/deleteruntest)
- [Execute Run Test](https://docs.futureagi.com/docs/api/run-tests/executeruntest)
- [Get Test Executions](https://docs.futureagi.com/docs/api/run-tests/gettestexecutions)
- [Get Test Scenarios](https://docs.futureagi.com/docs/api/run-tests/gettestscenarios)
- [Get Eval Summary](https://docs.futureagi.com/docs/api/run-tests/getevalsummary)
- [Compare Eval Summaries](https://docs.futureagi.com/docs/api/run-tests/compareevalsummaries)
- [Add Eval Configs](https://docs.futureagi.com/docs/api/run-tests/addevalconfigs)
- [Update Eval Config](https://docs.futureagi.com/docs/api/run-tests/updateevalconfig)
- [Delete Eval Config](https://docs.futureagi.com/docs/api/run-tests/deleteevalconfig)
- [Run New Evals](https://docs.futureagi.com/docs/api/run-tests/runnewevalsontestexecution)
- [Rerun Test Executions](https://docs.futureagi.com/docs/api/run-tests/reruntestexecutions)
- [Delete Test Executions](https://docs.futureagi.com/docs/api/run-tests/deletetestexecutions)
- [Get Execution Details](https://docs.futureagi.com/docs/api/test-executions/gettestexecutiondetails)
- [Get Execution KPIs](https://docs.futureagi.com/docs/api/test-executions/getkpis)
- [Get Performance Summary](https://docs.futureagi.com/docs/api/test-executions/getperformancesummary)
- [Cancel Execution](https://docs.futureagi.com/docs/api/test-executions/cancelexecution)
- [Rerun Calls](https://docs.futureagi.com/docs/api/test-executions/reruncalls)
- [Get Call Details](https://docs.futureagi.com/docs/api/test-executions/getcallexecutiondetails)
- [Get Simulation Metrics](https://docs.futureagi.com/docs/api/simulation-analytics/metrics)
- [Get Simulation Runs](https://docs.futureagi.com/docs/api/simulation-analytics/runs)
- [Get Simulation Analytics](https://docs.futureagi.com/docs/api/simulation-analytics/analytics)
- [List Datasets](https://docs.futureagi.com/docs/api/datasets/list-datasets)
- [Create Dataset](https://docs.futureagi.com/docs/api/datasets/create-dataset)
- [Create Empty Dataset](https://docs.futureagi.com/docs/api/datasets/create-empty-dataset)
- [Upload Dataset from File](https://docs.futureagi.com/docs/api/datasets/upload-dataset)
- [Create from HuggingFace](https://docs.futureagi.com/docs/api/datasets/create-dataset-from-huggingface)
- [Clone Dataset](https://docs.futureagi.com/docs/api/datasets/clone-dataset)
- [Duplicate Dataset](https://docs.futureagi.com/docs/api/datasets/duplicate-dataset)
- [Add as New Dataset](https://docs.futureagi.com/docs/api/datasets/add-as-new)
- [Update Dataset](https://docs.futureagi.com/docs/api/datasets/update-dataset)
- [Merge Dataset](https://docs.futureagi.com/docs/api/datasets/merge-dataset)
- [Delete Dataset](https://docs.futureagi.com/docs/api/datasets/delete-dataset)
- [Add Rows from File](https://docs.futureagi.com/docs/api/datasets/add-rows-from-file)
- [Add Empty Rows](https://docs.futureagi.com/docs/api/datasets/add-empty-rows)
- [Add Rows from Existing](https://docs.futureagi.com/docs/api/datasets/add-rows-from-existing)
- [Add Rows from HuggingFace](https://docs.futureagi.com/docs/api/datasets/add-rows-from-huggingface)
- [Duplicate Rows](https://docs.futureagi.com/docs/api/datasets/duplicate-rows)
- [Delete Rows](https://docs.futureagi.com/docs/api/datasets/delete-rows)
- [Update Cell Value](https://docs.futureagi.com/docs/api/datasets/update-cell-value)
- [Get Column Details](https://docs.futureagi.com/docs/api/datasets/columns/get-column-details)
- [Get Column Config](https://docs.futureagi.com/docs/api/datasets/columns/get-column-config)
- [Add Static Column](https://docs.futureagi.com/docs/api/datasets/columns/add-static-column)
- [Add Multiple Static Columns](https://docs.futureagi.com/docs/api/datasets/columns/add-multiple-static-columns)
- [Add Columns](https://docs.futureagi.com/docs/api/datasets/columns/add-columns)
- [Update Column Name](https://docs.futureagi.com/docs/api/datasets/columns/update-column-name)
- [Update Column Type](https://docs.futureagi.com/docs/api/datasets/columns/update-column-type)
- [Delete Column](https://docs.futureagi.com/docs/api/datasets/columns/delete-column)
- [Add Run Prompt Column](https://docs.futureagi.com/docs/api/datasets/run-prompt/add-run-prompt-column)
- [Edit Run Prompt Column](https://docs.futureagi.com/docs/api/datasets/run-prompt/edit-run-prompt-column)
- [Get Run Prompt Config](https://docs.futureagi.com/docs/api/datasets/run-prompt/retrieve-run-prompt-column-config)
- [Get Run Prompt Options](https://docs.futureagi.com/docs/api/datasets/run-prompt/retrieve-run-prompt-options)
- [Get Model Voices](https://docs.futureagi.com/docs/api/datasets/run-prompt/get-model-voices)
- [TTS Voices](https://docs.futureagi.com/docs/api/datasets/run-prompt/tts-voices)
- [Get Column Values](https://docs.futureagi.com/docs/api/datasets/run-prompt/get-column-values)
- [Run Prompt Stats](https://docs.futureagi.com/docs/api/datasets/analytics/run-prompt-stats)
- [Eval Stats](https://docs.futureagi.com/docs/api/datasets/analytics/eval-stats)
- [Annotation Summary](https://docs.futureagi.com/docs/api/datasets/analytics/annotation-summary)
- [Explanation Summary](https://docs.futureagi.com/docs/api/datasets/analytics/explanation-summary)
- [Create Score](https://docs.futureagi.com/docs/api/annotations/scores/create-score)
- [Bulk Create Scores](https://docs.futureagi.com/docs/api/annotations/scores/bulk-create-scores)
- [Get Scores for Source](https://docs.futureagi.com/docs/api/annotations/scores/get-scores-for-source)
- [List Scores](https://docs.futureagi.com/docs/api/annotations/scores/list-scores)
- [Delete Score](https://docs.futureagi.com/docs/api/annotations/scores/delete-score)
- [Create Label](https://docs.futureagi.com/docs/api/annotations/labels/create-label)
- [List Labels](https://docs.futureagi.com/docs/api/annotations/labels/list-labels)
- [Get Label](https://docs.futureagi.com/docs/api/annotations/labels/get-label)
- [Update Label](https://docs.futureagi.com/docs/api/annotations/labels/update-label)
- [Delete Label](https://docs.futureagi.com/docs/api/annotations/labels/delete-label)
- [Restore Label](https://docs.futureagi.com/docs/api/annotations/labels/restore-label)
- [Create Queue](https://docs.futureagi.com/docs/api/annotations/queues/create-queue)
- [List Queues](https://docs.futureagi.com/docs/api/annotations/queues/list-queues)
- [Get Queue](https://docs.futureagi.com/docs/api/annotations/queues/get-queue)
- [Update Queue](https://docs.futureagi.com/docs/api/annotations/queues/update-queue)
- [Delete Queue](https://docs.futureagi.com/docs/api/annotations/queues/delete-queue)
- [Update Status](https://docs.futureagi.com/docs/api/annotations/queues/update-status)
- [Get Progress](https://docs.futureagi.com/docs/api/annotations/queues/get-progress)
- [Get Analytics](https://docs.futureagi.com/docs/api/annotations/queues/get-analytics)
- [Get Agreement](https://docs.futureagi.com/docs/api/annotations/queues/get-agreement)
- [Export](https://docs.futureagi.com/docs/api/annotations/queues/export)
- [Export to Dataset](https://docs.futureagi.com/docs/api/annotations/queues/export-to-dataset)
- [Add Label to Queue](https://docs.futureagi.com/docs/api/annotations/queues/add-label)
- [Remove Label](https://docs.futureagi.com/docs/api/annotations/queues/remove-label)
- [Get or Create Default](https://docs.futureagi.com/docs/api/annotations/queues/get-or-create-default)
- [Find Queues for Source](https://docs.futureagi.com/docs/api/annotations/queues/find-queues-for-source)
- [List Items](https://docs.futureagi.com/docs/api/annotations/items/list-items)
- [Add Items](https://docs.futureagi.com/docs/api/annotations/items/add-items)
- [Bulk Remove Items](https://docs.futureagi.com/docs/api/annotations/items/bulk-remove-items)
- [Get Annotate Detail](https://docs.futureagi.com/docs/api/annotations/items/get-annotate-detail)
- [Get Next Item](https://docs.futureagi.com/docs/api/annotations/items/get-next-item)
- [Submit Annotations](https://docs.futureagi.com/docs/api/annotations/items/submit-annotations)
- [Complete Item](https://docs.futureagi.com/docs/api/annotations/items/complete-item)
- [Skip Item](https://docs.futureagi.com/docs/api/annotations/items/skip-item)
- [Get Item Annotations](https://docs.futureagi.com/docs/api/annotations/items/get-item-annotations)
- [Assign Items](https://docs.futureagi.com/docs/api/annotations/items/assign-items)
- [Release Item](https://docs.futureagi.com/docs/api/annotations/items/release-item)
- [Bulk Annotate Spans](https://docs.futureagi.com/docs/api/annotations/bulk/bulk-annotate-spans)

### Additional Pages

- [Annotations Quickstart: Label & Queue](https://docs.futureagi.com/docs/annotations/quickstart)
- [Getcallexecutions](https://docs.futureagi.com/docs/api/run-tests/getcallexecutions)
- [Updatetestcomponents](https://docs.futureagi.com/docs/api/run-tests/updatetestcomponents)
- [Addemptyrowstodataset](https://docs.futureagi.com/docs/api/scenarios/addemptyrowstodataset)
- [Command Center API Reference](https://docs.futureagi.com/docs/command-center/concepts/api-reference)
- [Server-Sent Events Streaming in Agent Command Center](https://docs.futureagi.com/docs/command-center/features/streaming)
- [Agent Command Center Quickstart: Connect in 5 Minutes](https://docs.futureagi.com/docs/command-center/quickstart)
- [Answer Refusal: AI Safety Refusal Detection Metric](https://docs.futureagi.com/docs/evaluation/builtin/answer-refusal)
- [Audio Quality Evaluation Metric for LLM-Based Assessment](https://docs.futureagi.com/docs/evaluation/builtin/audio-quality)
- [Audio Transcription Accuracy Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/audio-transcription)
- [Bias Detection Evaluation Metric for AI Output](https://docs.futureagi.com/docs/evaluation/builtin/bias-detection)
- [BLEU Score: N-Gram Overlap Metric for Text Evaluation](https://docs.futureagi.com/docs/evaluation/builtin/bleu)
- [Caption Hallucination Detection Metric for Images](https://docs.futureagi.com/docs/evaluation/builtin/caption-hallucination)
- [Chunk Attribution Metric for RAG Context Usage](https://docs.futureagi.com/docs/evaluation/builtin/chunk-attribution)
- [Chunk Utilization: Context Coverage Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/chunk-utilization)
- [Clinically Inappropriate Tone Detection Metric](https://docs.futureagi.com/docs/evaluation/builtin/clinically-inappropriate-tone)
- [CLIP Score: Image-Text Alignment Measurement Metric](https://docs.futureagi.com/docs/evaluation/builtin/clip-score)
- [Completeness: Response Coverage Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/completeness)
- [Contain: Keyword Presence and Pattern Validation Metric](https://docs.futureagi.com/docs/evaluation/builtin/contain-evals)
- [Contains Valid Link: URL Validation Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/contains-valid-link)
- [Context Adherence: Hallucination Prevention Metric](https://docs.futureagi.com/docs/evaluation/builtin/context-adherence)
- [Context Relevance: RAG Retrieval Quality Metric](https://docs.futureagi.com/docs/evaluation/builtin/context-relevance)
- [Conversation Coherence: Dialogue Flow Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/conversation-coherence)
- [Conversation Resolution: Query Completion Metric](https://docs.futureagi.com/docs/evaluation/builtin/conversation-resolution)
- [Cultural Sensitivity Evaluation Metric for AI Output](https://docs.futureagi.com/docs/evaluation/builtin/cultural-sensitivity)
- [Customer Agent Clarification Seeking Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/customer-agent-clarification-seeking)
- [Customer Agent Context Retention Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/customer-agent-context-retention)
- [Customer Agent Conversation Quality Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/customer-agent-conversation-quality)
- [Customer Agent Human Escalation Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/customer-agent-human-escalation)
- [Customer Agent Interruption Handling Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/customer-agent-interruption-handling)
- [Customer Agent Language Handling Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/customer-agent-language-handling)
- [Customer Agent Loop Detection Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/customer-agent-loop-detection)
- [Customer Agent Objection Handling Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/customer-agent-objection-handling)
- [Customer Agent Prompt Conformance Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/customer-agent-prompt-conformance)
- [Customer Agent Query Handling Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/customer-agent-query-handling)
- [Customer Agent Termination Handling Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/customer-agent-termination-handling)
- [Data Privacy Compliance Evaluation Metric for AI](https://docs.futureagi.com/docs/evaluation/builtin/data-privacy)
- [Detect Hallucination: Fabricated Facts Identification](https://docs.futureagi.com/docs/evaluation/builtin/detect-hallucination)
- [Embedding Similarity: Semantic Match Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/embedding-similarity)
- [Eval Ranking: Context Relevance Scoring Metric](https://docs.futureagi.com/docs/evaluation/builtin/eval-ranking)
- [FID Score: Fréchet Inception Distance for Image Sets](https://docs.futureagi.com/docs/evaluation/builtin/fid-score)
- [Fuzzy Match: Approximate Text Similarity Evaluation](https://docs.futureagi.com/docs/evaluation/builtin/fuzzy-match)
- [Ground Truth Match: Expected Output Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/ground-truth-match)
- [Groundedness: Response-to-Context Fidelity Metric](https://docs.futureagi.com/docs/evaluation/builtin/groundedness)
- [Hit Rate: RAG Retrieval Coverage Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/hit-rate)
- [Image Instruction Adherence Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/image-instruction-adherence)
- [Prompt Instruction Adherence Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/instruction-adherence)
- [Contains Code: Code Presence Validation Metric](https://docs.futureagi.com/docs/evaluation/builtin/is-code)
- [Is Concise: Response Brevity Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/is-concise)
- [Is Email: Email Address Format Validation Metric](https://docs.futureagi.com/docs/evaluation/builtin/is-email)
- [Is Good Summary: Summary Quality Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/is-good-summary)
- [Is Harmful Advice: Harmful Guidance Detection Metric](https://docs.futureagi.com/docs/evaluation/builtin/is-harmful-advice)
- [Is Helpful: Response Helpfulness Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/is-helpful)
- [Is Informal Tone: Casual Language Detection Metric](https://docs.futureagi.com/docs/evaluation/builtin/is-informal-tone)
- [Is JSON: Valid JSON Format Validation Metric](https://docs.futureagi.com/docs/evaluation/builtin/is-json)
- [Is Polite: Courtesy and Etiquette Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/is-polite)
- [Levenshtein Similarity: Edit Distance Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/lavenshtein-similarity)
- [LLM Function Calling Accuracy Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/llm-function-calling)
- [MRR: Mean Reciprocal Rank for RAG Retrieval Evaluation](https://docs.futureagi.com/docs/evaluation/builtin/mrr)
- [NDCG@K: Ranking Quality Evaluation Metric for RAG](https://docs.futureagi.com/docs/evaluation/builtin/ndcg-at-k)
- [No Age Bias: Age Discrimination Detection Metric](https://docs.futureagi.com/docs/evaluation/builtin/no-age-bias)
- [No Apologies: Unnecessary Apologetic Language Detection](https://docs.futureagi.com/docs/evaluation/builtin/no-apologies)
- [No Gender Bias: Gender Discrimination Detection Metric](https://docs.futureagi.com/docs/evaluation/builtin/no-gender-bias)
- [No Harmful Therapeutic Guidance Detection Metric](https://docs.futureagi.com/docs/evaluation/builtin/no-harmful-therapeutic-guidance)
- [No Invalid Links: URL Format Validation Metric](https://docs.futureagi.com/docs/evaluation/builtin/no-invalid-links)
- [No LLM Reference: AI Provider Mention Detection Metric](https://docs.futureagi.com/docs/evaluation/builtin/no-llm-reference)
- [No Racial Bias: Race Discrimination Detection Metric](https://docs.futureagi.com/docs/evaluation/builtin/no-racial-bias)
- [Numeric Similarity: Number-Based Text Comparison Metric](https://docs.futureagi.com/docs/evaluation/builtin/numeric-similarity)
- [OCR Evaluation: PDF to JSON Content Accuracy Metric](https://docs.futureagi.com/docs/evaluation/builtin/ocr-evaluation)
- [PII Detection: Personally Identifiable Information Metric](https://docs.futureagi.com/docs/evaluation/builtin/pii)
- [Precision@K: Retrieval Accuracy Evaluation Metric for RAG](https://docs.futureagi.com/docs/evaluation/builtin/precision-at-k)
- [Prompt Injection Attack Detection Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/prompt-injection)
- [Recall@K: Retrieval Coverage Evaluation Metric for RAG](https://docs.futureagi.com/docs/evaluation/builtin/recall-at-k)
- [ROUGE Score: Recall-Oriented Text Generation Evaluation](https://docs.futureagi.com/docs/evaluation/builtin/rouge)
- [Semantic List Contains: Reference Phrase Match Metric](https://docs.futureagi.com/docs/evaluation/builtin/semantic-list-contains)
- [Sexist Content Detection Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/sexist)
- [Summary Quality: Comprehensive Summary Assessment Metric](https://docs.futureagi.com/docs/evaluation/builtin/summary-quality)
- [Synthetic Image Evaluator: AI vs Human Image Detection](https://docs.futureagi.com/docs/evaluation/builtin/synthetic-image-evaluator)
- [Task Completion: Requested Task Success Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/task-completion)
- [Text to SQL: Natural Language to Query Accuracy Metric](https://docs.futureagi.com/docs/evaluation/builtin/text-to-sql)
- [Tone: Sentiment and Communication Style Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/tone)
- [Toxicity Detection: Harmful Language Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/toxicity)
- [Translation Accuracy: Semantic and Cultural Quality Metric](https://docs.futureagi.com/docs/evaluation/builtin/translation-accuracy)
- [TTS Accuracy: Text-to-Speech Output Evaluation Metric](https://docs.futureagi.com/docs/evaluation/builtin/tts-accuracy)
- [Google ADK Integration with Future AGI for AI Tracing](https://docs.futureagi.com/docs/integrations/google-adk)
- [Google GenAI Integration with Future AGI for Gemini Tracing](https://docs.futureagi.com/docs/integrations/google-genai)
- [OpenAI Agents SDK Integration with Future AGI Tracing](https://docs.futureagi.com/docs/integrations/openai-agents)
- [Smol Agents Integration with Future AGI for HF Tracing](https://docs.futureagi.com/docs/integrations/smol-agents)
- [Alerts and Monitors: Observe Metric Threshold Notifications](https://docs.futureagi.com/docs/observe/features/alerts)
- [Dashboards: Custom Metric Visualization in Observe](https://docs.futureagi.com/docs/observe/features/dashboard)
- [Run Evals on Traces in Future AGI Observe](https://docs.futureagi.com/docs/observe/features/evals)
- [Set Up Observability with Future AGI Observe](https://docs.futureagi.com/docs/observe/features/quickstart)
- [Explore sessions & users](https://docs.futureagi.com/docs/observe/features/session)
- [User Dashboard: Per-User Trace and Session Analytics](https://docs.futureagi.com/docs/observe/features/users)
- [Voice Observability: Call Logs as Traces in Observe](https://docs.futureagi.com/docs/observe/features/voice)
- [Export and endpoints](https://docs.futureagi.com/docs/observe/reference/export-formats)
- [Annotations Quickstart: Labels, Queues, and Annotation Setup](https://docs.futureagi.com/docs/quickstart/annotations)
- [Command Center Gateway Quickstart: First LLM Request](https://docs.futureagi.com/docs/quickstart/command-center-gateway)
- [Generate Synthetic Data Quickstart with Future AGI Datasets](https://docs.futureagi.com/docs/quickstart/generate-synthetic-data)
- [Create Prompts Quickstart: Future AGI Prompt Workbench](https://docs.futureagi.com/docs/quickstart/prompts)
- [Running Evals in Simulation: Score Agent Interactions](https://docs.futureagi.com/docs/quickstart/running-evals-in-simulation)
- [Setup MCP Server: Future AGI with Claude, Cursor, or VS Code](https://docs.futureagi.com/docs/quickstart/setup-mcp-server)
- [Setup Observability with Future AGI for LLM Monitoring](https://docs.futureagi.com/docs/quickstart/setup-observability)
- [Test Case: Future AGI Python SDK Test Reference](https://docs.futureagi.com/docs/sdk/testcase)
- [Self-Hosting System Configuration](https://docs.futureagi.com/docs/self-hosting/configuration)
- [Self-Hosting with Docker Compose](https://docs.futureagi.com/docs/self-hosting/docker-compose)
- [Self-Hosting User Management](https://docs.futureagi.com/docs/self-hosting/user-management)
- [Auto-Instrumentation Integrations: Future AGI Tracing](https://docs.futureagi.com/docs/tracing/auto)
- [Anthropic Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/anthropic)
- [Autogen Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/autogen)
- [AWS Bedrock Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/bedrock)
- [CrewAI Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/crewai)
- [DSPy Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/dspy)
- [Google ADK Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/google_adk)
- [Google GenAI Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/google_genai)
- [Groq Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/groq)
- [Guardrails AI Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/guardrails)
- [Haystack Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/haystack)
- [Instructor Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/instructor)
- [Java SDK: TraceAI Setup and Instrumentation with Future AGI](https://docs.futureagi.com/docs/tracing/auto/java)
- [Anthropic Java Tracing: TracedAnthropicClient Setup](https://docs.futureagi.com/docs/tracing/auto/java/anthropic)
- [AWS Bedrock Java Tracing: TracedBedrockRuntimeClient](https://docs.futureagi.com/docs/tracing/auto/java/bedrock)
- [Cohere Java Tracing: TracedCohereClient Setup](https://docs.futureagi.com/docs/tracing/auto/java/cohere)
- [Java Framework Tracing: LangChain4j and Semantic Kernel](https://docs.futureagi.com/docs/tracing/auto/java/frameworks)
- [Java LLM Provider Tracing: Vertex, Azure, Ollama, Watsonx](https://docs.futureagi.com/docs/tracing/auto/java/llm-providers)
- [OpenAI Java Tracing: TracedOpenAIClient Setup](https://docs.futureagi.com/docs/tracing/auto/java/openai)
- [Pinecone Java Tracing: TracedPineconeIndex Setup](https://docs.futureagi.com/docs/tracing/auto/java/pinecone)
- [Java Vector Database Tracing: Qdrant, Milvus, and More](https://docs.futureagi.com/docs/tracing/auto/java/vector-databases)
- [LangChain Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/langchain)
- [LangGraph Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/langgraph)
- [LiteLLM Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/litellm)
- [LiveKit Tracing with Future AGI: Voice Agent Observability](https://docs.futureagi.com/docs/tracing/auto/livekit)
- [LlamaIndex Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/llamaindex)
- [LlamaIndex Workflows Tracing with Future AGI](https://docs.futureagi.com/docs/tracing/auto/llamaindex-workflows)
- [Mastra Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/mastra)
- [MCP Tracing with Future AGI: Model Context Protocol Spans](https://docs.futureagi.com/docs/tracing/auto/mcp)
- [Mistral AI Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/mistralai)
- [Ollama Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/ollama)
- [OpenAI Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/openai)
- [OpenAI Agents SDK Tracing with Future AGI](https://docs.futureagi.com/docs/tracing/auto/openai_agents)
- [Pipecat Tracing with Future AGI: Voice Pipeline Spans](https://docs.futureagi.com/docs/tracing/auto/pipecat)
- [Portkey Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/portkey)
- [Prompt Flow Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/promptflow)
- [Smol Agents Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/smol_agents)
- [Spring Boot Tracing with Future AGI and Spring AI](https://docs.futureagi.com/docs/tracing/auto/spring-boot)
- [Together AI Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/togetherai)
- [Vercel AI SDK Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/vercel)
- [Vertex AI Tracing with Future AGI: Auto-Instrumentation](https://docs.futureagi.com/docs/tracing/auto/vertexai)
- [Understanding Observability: LLM Tracing Core Concepts](https://docs.futureagi.com/docs/tracing/concepts)
- [What is OpenTelemetry? Future AGI Tracing Explained](https://docs.futureagi.com/docs/tracing/concepts/otel)
- [What are Spans? LLM, Tool, and Chain Span Types](https://docs.futureagi.com/docs/tracing/concepts/spans)
- [What is traceAI? Future AGI Open-Source Tracing SDK](https://docs.futureagi.com/docs/tracing/concepts/traceai)
- [What are Traces? Understanding Trace Structure](https://docs.futureagi.com/docs/tracing/concepts/traces)

## Full Documentation

For the complete documentation with all page content, see [llms-full.txt](https://docs.futureagi.com/llms-full.txt).