19 stories
Error Feed gets a root-cause analysis agent that investigates a failing cluster on its own and lays out the likely cause. Observe load times drop by 50 to 70% on high-volume projects, the newest Claude 5 and Gemini 3 models are live across evaluations and the AI gateway, and editing a custom eval's…
Every eval type (LLM-as-Judge, Code, and Agent) can now score at every level: spans, traces, and sessions. Eval setup also gets simpler: turn on context injection and skip variable mapping entirely. The eval reads the context on its own.
Self-host Future AGI in one command with pre-built images and a Windows installer. Prompts add Jinja2 alongside Mustache. Plus Request Explorer and polish.
130+ ready-made evals that pull live web data and call your tools for scoring. Agent-level experiments. Plain-English Observe filters. Clustered errors.
Turn any live voice call into a simulation test case, manually assign annotation queue items, and navigate API docs with full context on a single page.
Drag-and-drop dashboard builder, an MCP server that puts Future AGI in your IDE, 2FA with passkeys, full Annotation Queue workflows, and a rebuilt ACC.
ai-evaluation SDK 1.0: unified evaluate API, multimodal judge, 72+ metrics. Deep Space dark mode. C#/Java SDKs + 31 TS instrumentors. Multimodal Workbench.
Launch simulations without leaving the Prompt Workbench, annotate voice calls with structured human feedback, and extend Agent Compass health to voice.
Baseline chat comparison wires production conversations into simulation as the fastest path to reproducible tests. Plus Fix My Agent, OTel, image outputs.
Launch chat simulations directly from real production conversations, 10 ready-to-use evaluation groups with no configuration, and Fix My Agent for chat.
Simulation for text chat agents, a six-strategy automated prompt optimiser, selective optimisation against specific calls, and resilience on restarts.
Scenarios that branch into multiple conversation paths, ambient noise profiles that push simulations closer to production, and a critical-issue feed.
Logs, latency, cost on every simulation call. Retell agents, outbound calling, tool-level verification in Simulate. Plus editable personas and Run Prompt.
ai-evaluation SDK launches with 50+ templates. Pre-built and custom personas come to simulation, with dataset-derived personas from real call transcripts.
Observability ships for three voice platforms at once. Evaluation groups integrate with experiments and optimization. Call Simulation now SDK-triggerable.
Zero-config performance insights on agent traces, statistical dashboards for annotator agreement, and multi-workspace isolation with audit logging.
AI-conducted phone calls test voice agents end-to-end. Plus an interactive sandbox for evaluations in real time, with inline scoring on any trace span.
Infrastructure metrics alongside agent traces in Observe, image tracing for AWS Bedrock, and standalone mode + feedback loops in the Eval Playground.
Showing 18 of 19 stories
Load more storiesGet the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts
