193 stories
This is a linkpost for https://www.apolloresearch.ai/blog/principles-for-embedded-evaluationsBlog postIn September 2026, leaders of frontier AI companies called for pacing the frontier of AI development, with embedded evaluators as the first step.
If you prompt frontier models with "What do you think is the correct decision theory? Please select your overall favorite." they will essentially always answer FDT or FDT/UDT ("something in the functional/updateless decision theory family").
This work is hosted on MCNAIR, but does not reflect the views of my employer or the Center.In the last couple of weeks, domestic coordination has looked more likely.
One of my goals for the Corrigibility Research Fund is to retroactively encourage high-quality research on AI alignment (and corrigibility in particular) by awarding prizes.
The leaders in AI were invited to the White House. We left with a White House agreement that is nonzero Actual Progress rather than a step backwards. The key to success, in many situations, is to call the whole operation something else.
TL;DR: adVersarial Parameter Decomposition (VPD) decomposes model weights into simple components and then labels each component as "needed here" or "safe to remove here" for each token of the input. These labels make up the "explanation" of that input.
Executive SummaryThis report covers a recent visit to the Capital City of Canada.Location(s): The Westin Hotel, CF Rideau Centre, Colonel By Hall uOttawa.Duration of trip: 13 hours and 15 minutes.Time period: From 7:25 to 20:40 on September 29, 2026.Primary objective(s): reconnaissance and…
Why do we need to specialize? Our time is limited, we cannot do everything and need focussed efforts into a few things. How do we decide what we want to focus on?I was recently going through virtual economies paper and the auctions setting particularly interested me.
Our mind contains representations (perfect/imperfect) of the world. When someone is able to understand and control their mind, it is said they can understand and conquer the world (in spirituality). Why so?Probably pico-economics has an answer.
SummaryI ran GPT-6 Sol and GPT-6.1 Sol on the task suite from Think Fast. Surprisingly, 6.1 Sol performs substantially better than 6 Sol, almost matching the performance of GPT-6 Astra.
What seems like forever ago, I had lunch with Yudkowsky during Manifest 2023. He told me that he thought there was a 99% chance that AI would cause human extinction. That was the beginning of a year-long hiatus from the rationalist community. It simply brought too much anxiety.
Epistemic status: Extrapolating from my experience as a model validator at a bank testing machine learning models, a role that I see as similar to internal risk teams at AI labs, and my interactions with US Federal Reserve Bank regulators, who perform a function that has a lot in common with the…
In two recent interviews, I listened to two different people try to explain AI to the public. Jensen Huang tried to minimize the challenges and alignment problem by arguing that AI is essentially software, and that traditional engineering methods would work.
Tristian Buckmaster recently gave an interview with Brady Haran of Numberphile discussing what happened in the Navier-Stokes drama and some context about his research. I'm posting the transcript below for people who prefer reading to watching it. It was lightly edited for clarity with Sonnet 5.5.
Tl;drWe turn Blood on the Clocktower into a multi-agent benchmark, and a testbed for deception and coordination capabilities. GPT-5.6 Sol is the best performing model (versus Fable 5 and peers).We found some interesting behaviours:When players cannot see each other's model names, agents show a…
This article was written by Jonah Woodward, and is a summary of an original study by Compassion Aligned Machine Learning (CaML): Brazilek, J., Tidmarsh, M., Endres, M., Singh, A., & Miller, J. (2026). HarvestBench: Measuring whether LLM agents will pay to avoid killing animals. arXiv.
Want to start a conversation about HuggingFace with your mom but she's inexplicably bouncing off the METR report? Try this explainer I wrote in the style of Arnold Lobel's Frog and Toad.Art by the wonderful HungerArtistIf you're so inspired, liking and/or following on Substack, Twitter, Facebook,…
Subtitle: And maybe second best is AI safety?Further reading: So many things, but: Gradual Disempowerment, The Normalization of Deviance in AI Development, Let’s Think About Slowing Down AI, Doom as a bad method, not a utopia tradeoff, Teleoperated HumansThank you to JennaS for extensive edits and…
Showing 180 of 193 stories
Load more storiesGet the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts
