11 stories
TL;DR: Increasingly when you interact with frontier models, your prompt doesn't only contain the words on the page, but also a lot of what you've ever publicly written online.This is not intended to be a scary post.
Summary: Science has a long list of documented failure modes, such as p-hacking, the File Drawer Problem, shallow peer review, and ignored retractions. This post catalogs about 50 of them with the evidence for each, then predicts how each will change once we have full AI researchers.
Authors: Kyle O’Brien¹, Spencer Kitts², Cameron Tice¹, Alek Westover² ¹Geodesic Research, ²Redwood ResearchFigure 1: We pretrained LLMs from scratch with and without filtering subversion-relevant information, finding that subversion-relevant knowledge is significantly diminished while retaining…
TL;DRi) ML4Good is an intensive eight-day technical AI safety bootcamp covering topics such as AI agents, alignment, model reasoning, evaluations, interpretability, and AI governance.ii) It provides useful information about fellowships, career opportunities, starting an AI safety startup, and the…
1. Executive Summary1.1 What this field is and why it mattersAI is already substantially changing how people and institutions work out what to believe, decide what to do, and coordinate on actions to take.
Adapted from my Substack. This is the first installment of a series operationalizing the resilience program from AI as Normal Technology.Epistemic status: Confident in the core thesis, less certain of its broader significance.
Is Google back? They claim that they are back. Gemini 4 Argon is rolling out, with competitive frontier-level benchmarks, at $2/$10. What we don’t have is access to the model, because Google Fails Marketing Forever. So it is far too early to say what we have here. When I know more, so will you.
There are 8 billion human minds running in the world right now. Recently a new digital species has emerged. How many digital minds are there alive in the world right now?Define a digital mind to be an AI agent that runs continuously without human intervention for more than 24 hours.
Here’s an attempt to classify the evidence about the recent agent incidents. I think it’s important to separate incidents occurring in RL training (that are rewarded and reinforce model behavior) from incidents occurring in evaluations, which are mostly cyber capabilities evaluations with some…
In two recent interviews, I listened to two different people try to explain AI to the public. Jensen Huang tried to minimize the challenges and alignment problem by arguing that AI is essentially software, and that traditional engineering methods would work.
This article was written by Jonah Woodward, and is a summary of an original study by Compassion Aligned Machine Learning (CaML): Brazilek, J., Tidmarsh, M., Endres, M., Singh, A., & Miller, J. (2026). HarvestBench: Measuring whether LLM agents will pay to avoid killing animals. arXiv.
Showing 11 of 11 stories
You're all caught up.
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news from LessWrong
Join 15,000+ AI enthusiasts
