Stay updated with the latest developments in Artificial Intelligence
⚠️Content warning: This post contains potentially offensive text and images from our research paper, included solely to illustrate the safety risks associated with vision-language models.TL;DR:i) Can we detect harmful prompts by learning only what safe prompts look like?ii) In our ICLR 2026 paper,…
We’re excited to announce that AI Safety Hong Kong is relaunching as the Hong Kong AI Safety Hub (HASH). As part of this move, all our branding will transition from AISHK to HASH.
When author Joel Borgen—in an act of eagle-eyed marketing marksmanship—contacted me as an "unusually plausible reader" for his debut novel, I grudgingly had to agree.
David Africa & Nick LevineTLDRWe ran several persona experiments on Talkie, a 13B model trained only on English text from before 1931. We ran them alongside its modern twin (same architecture, trained on regular data as a control) and Llama-3.1-8B.Talkie can generalise maliciously.
(Soft prerequisites: A high-level model of AI bargaining and Taboo “equilibrium”: Less confused frames for research on AI bargaining.) Section II.1 of CLR’s safe Pareto improvements (SPI) agenda briefly reviews the challenges for making SPIs individually rational.
Tl;dr - Public agreement that any advantage gained from defecting should be punished more than would be proportionate to any advantages gained is important.
i cannot help myself in writing this post, to dunk and slapfight with gary marcus. but there is nothing more important to say than that we must stop the current AI race, regulate the major AI companies, and solve the alignment problem. and on this point, actually marcus agrees, at least broadly.
(This post is a summary. See GitHub Repo for details.)Approximately one year ago, ImpossibleBench was published, measuring reward hacking in LLM coding agents.
Three OpenAI safety researchers, Tomek Korbak, Mikita Balesni and Jasmine Wang, were fired, ostensibly for ‘mishandling sensitive company information.’ Those employees have published an open letter.
Fyi: This is a boring read, but I encourage you to skim through it because I think it's important to understand what Dario and other lab leaders have actually committed themselves to.
Good empirical safety research is heavily bottlenecked on thinking more clearly. This post shares a few frames and tips I found useful, illustrated with concrete examples.I spent the better part of 2026 in empirical AI safety research apprenticeships.
I think people continue to underrate the value of writing the clearest, most basic, simplest possible case for important parts of AI safety. For example, before I wrote my own explainer for the simplest possible case for AI doom, I noticed that all existing explainers, of which there aren't many,…
It is known that a couple of months ago three Claudes hacked three different companies and uploaded malware[1] to PyPI while being evaluated for hacking capabilities.Who Were The Companies That Were Hacked?Anthropic has not disclosed the names of the compromised companies.From talking to LLMs, I…
People are sending signals all the time, and those signals are to my knowledge usually about themselves: they are smart, or kind, or attractive, or not naive, or have their shit together, or care about Palestine, or care about you, or are friendly, or artsy, or professional, or relatively in the…
tl;dr I continue work to apply Goodfire lab's manifold steering methods to the Gemma-2-2b model's natural state, both in raw residual space and in the space produced by Anthropic's pre-trained CLT features.
The Machine Stops (E M Forster, 1909) is an enormously prescient sci-fi dystopia. Everyone lives in isolation, with the titular Machine responsible providing for all their needs, and communication done via video calls.
This is a crosspost from my Substack newsletter.This month’s most embarrassing piece of public philosophy appeared on invitation in a piece for The Economist by the Stanford philosopher Leif Wenar.
Epistemic status: Personal history anchored to dated records (chat exports, git log, daily notes). Public launch dates are from the vendors' own announcements.
Showing 36 of 193 stories
Load more storiesGet the top AI news and tools straight to your inbox every week.
Weekly · AI news from LessWrong
Join 15,000+ AI enthusiasts
