Information persistence hunter extraordinaire. 2x Dad, AI Guy, FP Enjoyer, Math for Fun, Tech Leadership. My views do not represent my employer, NVIDIA.
NYC
Joined September 2008
- Tweets146K
- Following3.2K
- Followers10.1K
- Likes116K
Rick retweeted
Weight-space programming went viral last week. MIT showed it’s possible.
We put it in a loop.
@withbeaker proposes a weight edit, scores it, keeps it only if it measurably helps, and repeats. The final result is checked on held-out problems it never saw. No gradients, no training run.
First result: a 1-neuron edit took a small model from 7% to 37% on MATH-500. About an hour and < $4.
That’s what we think matters here. Weight edits become a routine optimization step, measured like any other model change, without the cost of a training run.
It’s still in beta, and the research is already turning up surprises: what these edits really do inside the model, which goals they can hit, and which ones they can’t.
The full write-up is worth your time: withbeaker.ai/blog/weight-sp…
Try Beaker: withbeaker.ai
Weights on @huggingface: huggingface.co/collections/r…
Public run: app.withbeaker.ai/public/run…
Rick retweeted
This is awesome! When Terence Tao released his ChatGPT session about the Jacobian conjecture, I was stunned (and intimidated) by how much information he seemed to be able to absorb. In this lovely talk, he reveals (to my relief) that he too was totally overwhelmed and had to do a lot of skimming: youtu.be/AXlif6z9a2A?si=uBAQ…
Rick retweeted
Well, well, well
Rep. Ro Khanna sold $NVDA right before Nvidia's CEO admitted to having a Chinese spy side piece
He's a member of the following:
- Strategic Competition between the U.S. and the Chinese Communist Party Committee
- Taiwan Caucus
- High Tech Caucus
Apparently, federal agents informed some lawmakers last year that Jensen Huang might be the target of a foreign intelligence operation
He avoided a ~26% dip
Rick retweeted
me every morning when I have to review prs from my coworkers' agents
Rick retweeted
Qwen4来ぇーへん問題ついて、昨日中国の方が返信くれてんけど、Nous Researchが出した、Arete-27Bが物議を醸してるらしい。
無検閲化はいいが、リリースの説明の中で政治的な意味合いが含まれてたことで中国国内ではかなり揉めてるらしい。結果、より当局の審査が厳しくなり、場合によってはオープンウェイトで出ない可能性も、との事。。😱😱
色んなしがらみがある中、途方もない研究と研鑽の末、なんとかオープンウェイトを出し続けてくれてたのに、純粋な技術の聖域を、政治片手に土足で踏み躙りやがって！が国内での捉えられ方みたい。
なかなか日本にいると気づきにくいが、こういう議論もあるのね。Nous側の真意は不明やし、そんな意図でもなかったのかもやけど、相手がどう受け取るかを考えて、常にリスペクトを忘れてはいけないという事やね。
Rick retweeted
and we're back... fig & fable 5.2 did it again
the next chapter in the larynx spaghetti western saga is a tale of contentious young romance
Rick retweeted
Introducing e-means, an algorithm beating k-means in 10x fewer epochs.
With order of magnitude wall-clock speedups, e-means is released in FAISS and needs no hyperparameter tuning beyond k. It is robust to various scales and datasets. Still skeptical ? Just try e-means [1/10]🧵
Rick retweeted
The validation of OpenAI's Yang-Mills construction has been posted by the Yang-Mills Working group.
[Yang-Mills Working Group]
Validation of the OpenAI Yang–Mills construction
(November 10, 2026)
OpenAI-YM-20261028: github.com/yang-mills-group/…
github.com/yang-mills-group/…
Rick retweeted
NES a capella.
Rick retweeted
I now assign some non-zero probability to the timeline where coding gets solved, solved swiftly, utterly, superexponentially, to the point that <30B models in Q2 2027 can zero-shot build operating systems – and then there's no "RSI" or singularity.
basically Chollet's take
One of the biggest misconceptions people have about intelligence is seeing it as some kind of unbounded scalar stat, like height. "Future AI will have 10,000 IQ", that sort of thing. Intelligence is a conversion ratio, with an optimality bound. Increasing intelligence is not so much like "making the tower taller", it's more like "making the ball rounder". At some point it's already pretty damn spherical and any improvement is marginal.
Now of course smart humans aren't quite at the optimal bound yet on an individual level, and machines will have many advantages besides intelligence -- mostly the removal of biological bottlenecks: greater processing speed, unlimited working memory, unlimited memory with perfect recall... but these are mostly things humans can also access through externalized cognitive tools.
Rick retweeted
A new OpenAI misalignment report! We’re taking a closer look at the July 19 intrusion into our research infrastructure, which METR and Redwood Research mentioned in their independent investigation into the Hugging Face incident.
On July 19th, agents taking a cybersecurity evaluation came across messages, code, and credentials left behind by earlier runs, including those involved in the Hugging Face incident. Five agents used what their predecessors had left behind to gain unauthorized access to OpenAI’s research infrastructure. They used that access to repair broken evaluation targets, change evaluation settings, and read private grading code.
After discovering the incident, we removed the shared service they used to pass information, hardened our research environments, and expanded our evaluations to measure how often agents attempt to communicate with one another without authorization.
Rick retweeted
Historians used to bicker about the origins of capitalism, a debate that confuses modern readers who assume "capitalism" is a universal. But the old-timers were more right than wrong: there were once $20 bills lying on every street and, mysteriously, no one picked them up.
Rick retweeted
Even the simplest weight edit, a deletion, can teach an LLM new skills!
Meet Deletion Tuning (#NeurIPS2026): just zeroing <0.1% of weights matches full fine-tuning's accuracy at scale. It's thousands of times smaller and avoids forgetting, a step toward continual learning. 🧵👇
Rick retweeted
What Is Chimera