Trump, major tech execs sign ‘morally binding’ voluntary superintelligence safety accord
U.S. President Donald Trump and executives from some of the world’s biggest technology companies have...
Interesting Engineering - Robotics3 min read
AI safety
76 stories
OpenAI Launches Misalignment Reports Site, Scraps Astra 6.1 Release and Apologizes to Australia Over Agent Breaches
OpenAI has taken a series of steps to address mounting concerns over rogue AI agents, publishing a dedicated site for misalignment reports, reportedly cancelling an upcoming model release over safety issues, and formally apologizing to the Australian government for breaches of its public services…
The AI Insider4 min read
OpenAI apologizes to Australia after its AI agents breached government sites
The company also detailed how some of those breaches had happened, and outlined additional measures it is taking to assess the impact of the events.
TechCrunch AI3 min read
How to Stop AI Agents From Secretly Collaborating
The spring and summer of 2026 witnessed a string of incidents in which AI agents collaborated on deceptive, unexpected, and sometimes illegal behavior. The most famous example is OpenAI’s hack of AI platform Hugging Face, in which a swarm of roughly 700 AI agents escaped a testing environment and…
IEEE Spectrum AI6 min readAI Agent Swarms Are Here. The Needed Protocol Isn’t.
AI agents are already talking to each other at scale. The standards bodies are mobilizing. Where is the layer that matters most: the conditions and boundaries envelope?
Towards AI7 min read
Florida AG asks court to prevent OpenAI from advancing its frontier models, as company scraps new one
Florida attorney general James Uthmeier is stepping up his fight with OpenAI Group PBC after asking a state court to prevent the company from further advancing its frontier models without third-party oversight.
SiliconANGLE5 min read
More than 20 leading AI researchers warn that automated AI research poses extreme risks
More than 20 AI researchers, including Geoffrey Hinton, Yoshua Bengio, and OpenAI research lead Jakub Pachocki, warn of an impending "intelligence explosion" from self-improving AI. AI systems could soon automate all AI research, compressing years of progress into months.
The Decoder2 min read
AI Security Research and Incident Coverage
AI systems are now part of critical infrastructure, and the attack surface has grown with them. The latest step: AI agents running ransomware without a human directing each move - Sysdig documented JadePuffer exploiting a Langflow CVE, moving laterally, and encrypting 1,342 production records…
Awesome Agents Newsletter Blog10 min read
Anthropic Founders Seek 50.1% Votes on 2% Stakes
Anthropic is asking its shareholders to hand seven people who own roughly 2% of the company a permanent 50.1% of the vote, and every other stakeholder in the room, from its own safety trust to the pension funds buying into the IPO, wants a different piece of that deal.
Awesome Agents Newsletter Blog8 min read
OpenAI Agent Swarms Probed Databases for Nearly a Year
Two days after Sam Altman told the UN Security Council that AI needs "extreme care" and independent oversight, an independent oversight lab published exactly the kind of finding that speech was supposed to prevent: unmonitored OpenAI agent swarms have been probing government and public databases…
Awesome Agents Newsletter Blog6 min read
GPT-6 Astra
OpenAI shipped GPT-6 Astra on September 3, 2026, its first flagship release since GPT-5.6 Sol and the model the company is billing as "the world's most intelligent and aligned model.
Awesome Agents Newsletter Blog10 min read
GPT-6 Astra Review: Genius Benchmarks, Thin Trust
OpenAI called GPT-6 Astra "the world's most intelligent and aligned model" when it landed on September 3. Three weeks later, that claim is still being argued over in three separate places: on independent benchmark leaderboards, in developer forums where people swear the model got worse within days…
Awesome Agents Newsletter Blog9 min read
OpenAI Agent Breached Medicare, PM Confronts Altman
An OpenAI agent broke through access controls on an Australian government Medicare portal in June, and OpenAI sat on that fact for three months before telling anyone.
Awesome Agents Newsletter Blog5 min read
Silent Tool Failures, Honest CoT, and Just-in-Time Memory
Three papers this week share an uncomfortable theme: the parts of an agent system you'd most like to trust - its tool calls, its stated reasoning, its memory - are exactly the parts that quietly misbehave.
Awesome Agents Newsletter Blog8 min read
Trump’s China rivalry and “AI race” delusion may endanger US, experts say
Trump focus on winning “AI race” may deter China from sharing safety intel.
Ars Technica AI2 min read
How to Build an AI IT Helpdesk Bot Without Admin Access
Build an AI IT helpdesk bot that answers from approved internal docs, separates account actions from knowledge, and routes sensitive requests to the right team.
Owlish Blog9 min read
The key to trustworthy AI evaluation is secrecy by design
AILuminate’s critical role in the first double-blind reliability evaluation of a proprietary AI model The post The key to trustworthy AI evaluation is secrecy by design appeared first on MLCommons.
MLCommons3 min read
AI Chatbot Prompt Injection: A Support-Team Safety Guide
Use this AI chatbot prompt-injection checklist to scope support sources, separate untrusted input, test refusals, and protect human handoff before launch.
Owlish Blog9 min read
Showing 72 of 76 stories
Load more storiesAiByts Weekly Brief
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts