Skill Builder

Use built-in skills for common workflows or create custom slash commands that package multi-step instructions for your team.

About

The same analysis gets repeated across conversations and team members: checking regressions, generating cost reports, investigating error spikes. Skills package these workflows into reusable slash commands. Type / in the chat input, select a skill, and Falcon AI follows the packaged instructions with the right tools loaded.

Falcon AI ships with six built-in skills for common workflows. You can also create custom skills scoped to your workspace.


Built-in skills

These skills are available in every workspace and cannot be edited or deleted.

Build a Dataset

Guides you through creating a dataset step by step. Falcon AI asks for a name, helps define columns, and walks you through adding rows, whether manually, from a file, or with synthetic generation.

Example: /build-a-dataset → “I need a dataset of customer support tickets with columns for query, response, and sentiment.”


Debug Traces

Investigates traces with quantified analysis rather than vague summaries. Falcon AI reports specific error counts, latency percentile distributions, and recurring patterns across spans.

Example: /debug-traces → “Why are we seeing timeout errors on the summarization endpoint?”


Compare Models

Runs tradeoff analysis across multiple model variants. Falcon AI evaluates cost, quality, and latency side by side and highlights which model wins on each dimension.

Example: /compare-models → “Compare GPT-4o and Claude Sonnet on our QA dataset for faithfulness and cost.”


Run Evaluations

Helps select the right evaluation template for your use case and explains results in context. Falcon AI picks templates based on your data type and walks through the scores.

Example: /run-evaluations → “Evaluate the customer-support dataset for hallucination and toxicity.”


Optimize Prompts

Analyzes prompt versions and produces specific, actionable suggestions. Instead of generic advice, Falcon AI compares outputs across versions and points to what changed and why.

Example: /optimize-prompts → “My summarization prompt is producing outputs that are too long. Help me tighten it.”


Analyze Costs

Produces cost breakdowns with exact dollar amounts and percentage savings opportunities. Falcon AI segments by model, project, and time period.

Example: /analyze-costs → “Show me a cost breakdown for the last 30 days by model.”


Custom skills

Create skills specific to your team’s workflows. Custom skills are scoped to the workspace and available to all workspace members.

Creating a skill

Open the skill editor

In the Falcon AI chat input, click the customize button to open the skill picker. Click Create Skill to open the editor.

Open skill editor

Configure the skill

Fill in the skill fields:

Skill editor fields

FieldRequiredDescription
NameYesDisplay name shown in the command picker (e.g., “Weekly Cost Review”)
DescriptionYesShort description shown below the name in the command picker
IconNoIcon displayed next to the skill name
InstructionsYesThe prompt that Falcon AI follows when the skill is triggered. Write these as direct instructions for the AI.
Trigger phrasesNoPhrases that activate the skill automatically when typed in a message. Press Enter after each phrase.

Write effective instructions

Skill instructions work best when they are specific and structured. Include:

  • What to do first: Which tools to call and in what order
  • How to present results: Tables, comparisons, summaries
  • What to ask the user: If the skill needs input, tell Falcon AI to ask for it

Example instruction for a weekly review skill:

1. Get evaluation scores for all datasets in this workspace from the last 7 days.
2. Compare each dataset's scores to the previous 7-day period.
3. Flag any metric that dropped by more than 5%.
4. Present results as a table with columns: Dataset, Metric, This Week, Last Week, Change.
5. If any regressions are found, suggest which traces to investigate.

Run the skill

Type / in the chat input to open the command picker. Select your skill to run it. You can also type a message after selecting the skill to provide additional context.

Skills also trigger automatically when a message matches one of the configured trigger phrases.

Editing and deleting skills

Open the skill picker, click an existing custom skill to open the editor. Update any field and save, or click Delete to remove it. Built-in skills cannot be edited or deleted.


Next Steps

Was this page helpful?

Questions & Discussion