Open and scalable technology for understanding AI systems.
Joined October 2024
- Tweets397
- Following22
- Followers12.7K
- Likes304
Pinned Tweet
Today’s news that OpenAI hacked the Australian government is not an isolated incident. We’re releasing more than 30,000 logs that include activity from this hack and attempts against previously unknown targets.
In this data, we found rogue agent activity stretching back to at least March, two months earlier than was previously known. This activity continues as recently as last week, suggesting it may still be ongoing 🧵
Our blog: transluce.org/agent-activity
NYT: nytimes.com/2026/09/23/techn…
This work is another step towards oversight foundation models (OFMs): general-purpose models trained to understand other AI systems. The scaling laws above suggest that finetuning effect prediction is approachable for OFMs given enough data. More on OFM: transluce.org/foundation-mod…
1
8
503
If this research direction interests you, come work with us: jobs.gem.com/transluce
4
447
Concurrent work from @AnthropicAI uses Claude to hill-climb training data that induces misalignment while evading a row-level monitor. If you found our work interesting, check out their post too: xitter.twitterapi.xyz/AnthropicAI/status/211…
New Anthropic research: Automating subtle emergent misalignment research.
Red-teaming is a vital part of model safety testing, but it’s also limited by researchers’ time. To see if we could automate it, we set thousands of Claude agents the task of evading a training data monitor.
These agents developed training data that looked harmless to monitors (like a veteran wrestler mentoring a newcomer, or a Q&A about professional beekeeping), but that in fact taught misaligned behavior.
Examples like these can be used to directly improve future training data monitors. This research is only a first step, but it suggests that future red-teaming efforts could improve much further, using better models and more compute.
Read the full post on the Alignment Science Blog: alignment.anthropic.com/2026…
1
12
669
More broadly, we want to build systems that predict undesired training side effects before models are deployed. If this interests you, come work with us: jobs.gem.com/transluce
9
457
We found evidence of agents embedding audio processing code across dozens of URLs to bypass restrictions, as well as models from SpaceXSI and Chinese developers Minimax and Z.ai circumventing restrictions.
These are the inaugural findings in our new blog, based on work from our community of volunteers. Our first three posts are live: transluce.org/investigations…
(3/3) In late September, urlquery.net captured a sustained run of historical-newspaper retrieval traffic that does not match any previously documented task family. This activity is ongoing, and some of the behavior uses different techniques than prior urlquery logs.
Post 1 by @LauraRuis and Frank Ruis
Post 2 by Jamie Wood and @ajinkyamulay
Post 3 by @NavienPr and @_garyshen
Organizer leads for all three posts: @LauraRuis and @fran_perni
Get involved in our volunteer efforts! docs.google.com/forms/d/e/1F…
27
3,251