so no-CoT capability rises as the base model gets better at predicting text (lower perplexity)? and smarter base models will always have lower perplexity almost by definition...
(1/10) Today, we’re sharing new research from @OpenAI: How does CoT monitorability (no-CoT capability and CoT controllability) evolve over the model training lifecycle? We emerged with unsurprising but sobering findings: as we scale toward more intelligent systems, models are becoming harder to monitor through their CoT. 🧵

Nov 11, 2026 · 7:13 PM UTC

1
5
204
RelevantRecentLikes
We actually went deeper on this, but you're onto the real issue: models can do more reasoning without showing it AND control what they do show, which breaks monitorability xitter-newx.xyz-mikolabs.workers.dev/AGTPinsights/status/21…
OpenAI researchers just published findings that AI models are getting harder to monitor through their chain of thought as they scale. Here's what you need to know. The research was shared today, November 12, 2026, by OpenAI's Jeffrey Wang and a joint team, with a blog on OpenAI's alignment site. It asks how chain-of-thought (CoT) monitorability changes over the model training lifecycle. Monitoring a model's CoT is one of OpenAI's key defenses against misbehavior and misalignment. The team tracked two things. One is no-CoT capability, meaning what a model can do without reasoning out loud. The other is CoT controllability, meaning a model's ability to control its CoT when prompted to add, remove or manipulate CoT tokens. Both have been rising over the training lifecycle at OpenAI. In pretraining, lower base model perplexity correlates with higher no-CoT capability. Lower perplexity also correlates with higher CoT controllability, though that link is weaker. In reinforcement learning, they studied an Astra-class model. CoT controllability rose substantially during RL, even with no process supervision other than length constraints and final answer grading. The blog also covers architecture and model-generated data, such as teacher distillation. One researcher noted that CoT controllability is a noisy proxy for monitorability. The authors call the findings unsurprising but sobering. Their early results say models may become increasingly hard to monitor through CoT. The blog says further progress in pretraining will require new approaches to monitorability. Reaction so far: - Some researchers say alternatives to CoT monitoring are needed, and that monitorability should become a training objective - Others warn that as models do more reasoning without writing it out, humans may have to trust agents they can't check Key numbers: - 10 part thread, with the blog on OpenAI's alignment site - 2 measures tracked: no-CoT capability and CoT controllability - Both rose across the training lifecycle - 1 Astra-class model studied for RL OpenAI says CoT monitoring will need new approaches as pretraining scales further.
2