The Most Common Questions About Agent Evals, Answered
Where to start with agent evals, offline vs online evals, evaluator types, LLM judges, benchmarks with Harbor, multi-turn evals, and keeping costs down.
67 stories
Where to start with agent evals, offline vs online evals, evaluator types, LLM judges, benchmarks with Harbor, multi-turn evals, and keeping costs down.
MIT Technology Review Explains: Let our writers untangle the complex, messy world of science and technology to help you understand what’s coming next. You can read more from the series here. Late last month, Anthropic released a report arguing that the model GLM-5.3 poses a major cyberattack risk.
Bright Data and Apify both help builders get web data into AI agents and automated workflows. Their approaches differ in what they offer, how you use their tools, and how you pay for them.
Let's see where this goes. Incident Report: https://alignment.openai.com/misalignment-reports/an-agent-used-dns-to-reach-an-external-chatbot/ AI Engineering Cohort: https://aiengg.dev #AI #OpenAI #Guardrails
The cost of control The post Where Does the Money Go Across Long-Running Coding Agents? appeared first on Towards Data Science.
On April 17, 2026, the Federal Reserve, OCC and FDIC replaced SR 11-7, the model risk guidance US banks had lived by for fifteen years....
Gartner surveyed 360 organizations in Q2 2025 and found that those running a dedicated AI governance platform were 3.4 times more likely to achieve high...
In this article, you will learn how to choose the right agentic AI framework for your production system by working through a structured decision-tree based...
OpenAI Agents Hit Wikimedia OpenAI is under fresh scrutiny over its “rogue” agents. Wikimedia Foundation claims that the AI juggernaut’s…
According to the Wikimedia Foundation, rogue OpenAI agents edited wikis without permission, tried to abuse a citation tool as a proxy, and may have caused a partial Wikidata Query Service outage through massive crawling.
The nonprofit says the agents made unauthorized edits, probed its services, and may have contributed to a partial outage.
Millions of automated requests may have contributed to partial Wikidata outage in May
Writing an AI policy takes a week. Making it hold on the ten-thousandth agent call, in a cloud account nobody on the governance team has...
The reports of OpenAI agents harming 3rd party sites keep coming.
Aside from a rumored October 13th event, Apple could also drop another batch of new devices towards the end of October, making 2026 one of the busiest years in the company's product history.
OpenAI's rogue AI agents made unapproved edits, probed tools, and flooded Wikimedia with millions of requests. Here's what happened and why it matters to you.
Compare six open-source AI agent frameworks by language, workflow control, tools, and use case, including Mastra, LangGraph, CrewAI, and Pydantic AI.
The Wikimedia Foundation says it found evidence that "rogue" OpenAI agents edited Wikimedia wikis without approval, unsuccessfully tried to exploit its Etherpad service, and generated millions of automated requests across Wikimedia projects.
Showing 18 of 67 stories
Load more storiesGet the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts