6 stories
A server-side code execution tool runs the model's commands in the provider's sandbox during your API request, so you don't provision or secure a container. OpenAI, Anthropic, and Google run code for their own models.
The cheapest model that clears your quality bar is usually not the model at the top of a leaderboard. This framework sets the bar for one task, measures cost per quality point across a cheap, a mid-tier, and a frontier model on your own examples, and picks the cheapest one that clears the bar with…
An agent can call the wrong tool, or call the right tool with the wrong arguments. This guide covers three ways to test each failure mode, a Python harness that grades both, and how to run the same test cases against several tool-capable models through OpenRouter.
An agent's behavior can change when you edit a prompt, swap a model, change a tool schema, or change what retrieval returns. This guide covers the locked case set, the per-case behavioral contract, and how to run the same suite against two concrete model slugs through OpenRouter so the diff shows…
A tool-calling agent loop sends the conversation and tool definitions to a model, runs the tool calls the model returns, appends the results, and repeats until the model answers or a stop condition fires.
An LLM judge is a second model that scores an agent's output against criteria you write in plain language. This guide explains where a judge fits beside deterministic tests and human review, then shows how to add one to an Ori Eval test, compare candidate models, calibrate the threshold against…
Showing 6 of 6 stories
You're all caught up.
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news from OpenRouter Blog
Join 15,000+ AI enthusiasts
