Admin & Settings
Administration Panel
Centralized dashboard for monitoring usage, managing access, configuring integrations, tracking billing, and maintaining personal settings
The Administration Panel centralizes everything you need to monitor usage, manage access, configure integrations, track billing, and maintain your personal settings.
Usage Summary
Provides full visibility into how the platform is being consumed.
Key Features
-
Overview Dashboard
- Total evaluations (by module: Resource Used, Evals, Protect, Prompt Optimization)
- Credit balance and consumption
- Real-time protection events (e.g. filtered or flagged content)
-
Date Filtering
- Pre-set ranges (Last 7 days, Last 30 days) or custom range
- Zoom in/out on time-series charts
-
Drill-down Views
- By feature: switch between Evaluations, Prompt Optimization, Protect
- By user or API key: filter consumption per sub-user
-
Export & Reporting
- Download CSV, XLSX, or PDF
- Schedule recurring exports via email
Step-by-step Guide
- Go to Settings > Usage Summary
- Select your date range
- Use module tabs to toggle features
- Hover over charts for exact numbers
- Click Export to download or schedule reports
API Keys & User Management
Managing Users
-
Invite new users
- Go to Settings > User Management
- Click Add User
- Enter email and assign role (Admin, Editor, Viewer)
- Submit – they’ll receive an invitation link
-
Modify or revoke access
- Use the menu next to a user to Edit Role, Resend Invite, or Remove User
-
View pending invitations under the Invitations tab
Managing API Keys
-
Add a new key
- Go to Settings > API Keys
- Click Add Key
- Choose provider (OpenAI, Azure, Anthropic, Hugging Face, etc.)
- Paste or upload key/JSON credentials
- Save
-
Encryption & Safety
- All keys are encrypted at rest and in transit
- Only Admin users can view keys
-
Rotate or delete keys
- Rotate uploads a new key without downtime
- Delete removes access permanently
Adding Custom Models
- Go to Settings > Custom Models
- Click Add Model
- Fill in Model Name, Provider (Vertex AI, AWS SageMaker, AWS Bedrock), API credentials, input/output token costs
- Save
Once registered, custom models appear alongside built-in engines in evaluation workflows.
Billing Management
Plan Management
- Compare available tiers (Free, Pro, Enterprise) side-by-side
- Toggle billing cycle between monthly and yearly
- Change plan by selecting a new tier and confirming
Track & Add Credits
- Current balance displayed at the top of the page
- Usage history table showing date, feature, and amount consumed
- To add credits
- Click Top Up
- Enter amount
- Choose payment method (Credit Card, ACH, Wire)
- Confirm
- Invoices & payments
- Download past invoices (PDF)
- Update or add payment methods
Profile Management
Reset Password
Keep your account secure by managing credentials.
- Go to Settings > Profile
- Under Security, click Reset Password
- Enter current password, then new password twice
- Save Changes
- You’ll receive a confirmation email once updated
We recommend strong passwords (at least 12 characters with letters, numbers, and symbols).