Changelog

Latest updates and improvements to Future AGI.

Stay up to date with the latest features, improvements, and bug fixes.

v2.0.0 - December 2024

Major Release

This is a major release with significant improvements to evaluation, tracing, and the overall developer experience.

New Features

  • 70+ Evaluation Metrics - Expanded metric library covering quality, safety, RAG, and more
  • Agent Compass - New error analysis system for debugging AI agents
  • Prompt Optimization - Bayesian optimization and meta-prompting algorithms
  • Session Management - Group related traces into user sessions
  • Real-time Streaming - Support for streaming responses in tracing

Improvements

  • 3x faster evaluation performance
  • Reduced API latency by 40%
  • New dark mode dashboard
  • Improved code block syntax highlighting

Breaking Changes

  • client.eval() renamed to client.evaluate()
  • Minimum Python version is now 3.8
  • Removed deprecated callback parameter

v1.5.0 - November 2024

New Features

  • Custom Metrics - Define your own evaluation metrics
  • CI/CD Integration - GitHub Actions and GitLab CI support
  • Cost Tracking - Monitor AI spending across projects

Improvements

  • Better error messages
  • Improved documentation
  • New LangChain integration features

v1.4.0 - October 2024

New Features

  • LlamaIndex Integration - Full support for LlamaIndex pipelines
  • Batch Evaluation - Evaluate multiple samples efficiently
  • Dataset Management - Create and manage evaluation datasets

Bug Fixes

  • Fixed memory leak in long-running traces
  • Resolved authentication timeout issues
  • Fixed incorrect token counting for Claude models

v1.3.0 - September 2024

New Features

  • Anthropic Integration - Support for Claude models
  • Safety Metrics - Toxicity, bias, and PII detection
  • Export API - Export traces to your data warehouse

v1.2.0 - August 2024

New Features

  • RAG Evaluation - Context relevance and groundedness metrics
  • Team Collaboration - Invite team members to projects
  • Webhooks - Real-time notifications for events

v1.1.0 - July 2024

New Features

  • OpenAI Integration - Automatic tracing for OpenAI calls
  • Dashboard v2 - Redesigned UI with better visualization
  • Alerts - Set up alerts for anomalies

v1.0.0 - June 2024

Note

Initial public release!

Features

  • Core evaluation framework
  • Basic tracing and observability
  • LangChain integration
  • REST API
  • Python SDK
Was this page helpful?

Questions & Discussion