Eric Frank (@IHaveSweaters) header
Eric Frank (@IHaveSweaters) profile picture

MTS @VinciPhysics, founding team @ uber ai labs & @ml_collective & geometric intelligence, ex toy designer @KiteandRocket 🌈✡️

San Francisco, CA
Joined March 2012
Photo by Eric Frank (@IHaveSweaters)Photo by Eric Frank (@IHaveSweaters)Photo by Eric Frank (@IHaveSweaters)Photo by Eric Frank (@IHaveSweaters)Photo by Eric Frank (@IHaveSweaters)Photo by Eric Frank (@IHaveSweaters)Photo by Eric Frank (@IHaveSweaters)Photo by Eric Frank (@IHaveSweaters)Photo by Eric Frank (@IHaveSweaters)Photo by Eric Frank (@IHaveSweaters)
Eric Frank retweeted
ARC Prize Research Summit - @kenneth0stanley On why open-endedness, invention, discovery are essential to AGI, but designing a benchmark for them creates difficult problems.
4
8
6
78
11,313
For the past year @BasisOrg has been building a general framework for probabilistic reasoning in dynamical systems, called Dynestyx. Blog: basis.ai/blog/dynestyx/ Dynamical systems are the workhorse of science and engineering: robotics, epidemiology, climate, biology, etc. The basic thing you can do with a dynamical system is simulate it: run it forward to compute how it will evolve over time. Dynestyx goes beyond this and lets you do inference and reasoning in dynamical systems. This includes: - Forecasting: What will happen next, and how sure are we? - State inference: Given noisy, partial measurements, where has the system actually been? - System identification: How does the system work? What parameters and rules produced the data we see? - Causal reasoning: Given the evidence, what would happen if we intervened on the system? Dynestyx allows you to do probabilistic inference over all kinds of dynamical systems (ODEs, SDEs, PDEs). You (or an AI agent) write the model once, then swap in different inference methods with minimal changes. Its generality allows us to tackle many different systems, as shown in the GIFS: - recovering a high-res Navier–Stokes fluid flow from noisy low-res measurements - steering particles through the wake behind a cylinder - a robot hand turning a cube it can only see through a camera - forecasting a 1978 flu outbreak at a boarding school as the data comes in Also: it's open source. Please give it a try: github.com/BasisResearch/dyn… Led by Matt Levine and @DanWaxmanML, with many contributions from our research staff
13
50
4
354
16,709
Research News! Announcing the 1st release of fundamental AI research from the Open-Endedness Team @LilaSciences: a vision-focused blog + 4 preprints. The blog details a broad research agenda for achieving open-endedness while each paper unveils its own novel research direction. The ideas covered in the papers include: • a novel approach to training for creativity designed to sidestep a newly-identified problem called the “creative paradox,” which means that directly reinforcing creative outputs can sometimes limit reaching full creative potential; • an investigation of the advantages of seeing the world through fresh eyes by training an LLM that is intentionally naïve in a certain area (in effect presenting less data as a potential advantage); • a new kind of training regularization technique for SGD called unified factored organizers (UFOs), which is designed to achieve unified factored representation (UFR) as seen in Picbreeder CPPNs; • and finally a unique study of catastrophic forgetting that shows that networks with UFR (like those from Picbreeder) are intrinsically resistant to catastrophic forgetting. The inset video on this post is a visualization from that catastrophic forgetting work. The blog post also includes an interactive “wheel of science” demo. The implications of these ideas are broad and diverse, but the fun part is that each one opens up its own new research playground - there is a lot of room for further research here! Moreover, we hope this release also highlights one other important point about AI today: while it may seem that the road ahead is already paved and all that’s left is to drive mindlessly forward, there actually remains a lot of room for new directions and insights in the pursuit of open-endedness and creativity. This research was possible because @LilaSciences appreciates the critical role of open-ended innovation in the pursuit of scientific superintelligence. The advances you see here are part of this much larger company-wide ambition, which includes AI Science Factories and many other unprecedented components. When this engine is fueled by open-endedness, the result will be much more than a step change. More advances in open-endedness are coming! Blog link below 👇
41
70
31
426
280,946
The dogma of the last decade in computer vision is that all classical algorithms should be replaced by neural networks. This has been very productive but, counterintuitively, with the latest frontier models, I find myself sometimes turning back to classical methods. If you have the training data, the dogma still holds. But there are situations where data is hard to get, there exist good classical algorithms for solving a problem, optimization methods are just better, or where some simple code just does the thing you want. When writing code was time consuming and error prone, training everything made sense. Now, that a frontier model can code up and test solutions quickly, getting a solution through coding can be faster than gathering training data and training a model. Consequently, I think there will be more hybrid approaches that blend trained models and code. We now have generic, high-level, planners that can execute sequences of lower-level tasks to solve large problems. These lower-level tasks may be solved by a neural network, a classical method, or specialized code written on the fly. It never pays to be religious about technology. The future is probably hybrid. Pick the thing that works for you.
54
157
32
1,261
82,020
reflected on this and it's not surprising that an llm can write/edit the weights of another model, hypernetworks showed this is possible over a narrow family of weights. it is shocking that this works zero shot though and I'm skeptical that this skill just emerged
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: rikiyat.github.io/blog/weigh…
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math. rikiyat.github.io/blog/weight-sp… github.com/RikiyaT/lm_und… huggingface.co/Qwen/Qwen3.5-0… huggingface.co/RikiyaT/Qwen3.…
1
2
266
reading weights seems handy for mech interp, my guess is labs are post training towards that. editing would then come for free
49
Eric Frank retweeted
Introducing HalachaBench: we gave AI programs from the makers of ChatGPT, Claude, Gemini and others real semicha exam questions from Israel's Chief Rabbinate, in Hebrew, with no books and no internet. The best scored 80 out of 100. Many scored under 11. 🧵
90
80
76
1,156
201,965
Eric Frank retweeted
Excited to release UMA Nitro! WAY faster than the previous UMA default. For this 153 atom peptide the raw inference speed is 32 ns/day on a single H200 Getting closer to watching biology happen from atoms up with a reactive DFT level potential is incredible!!
9
35
2
288
17,073
Eric Frank retweeted
My husband has used AI agents to revive old fonts, ornaments, & cuts from 19th century newspapers. The agents even built an editor where you can create your own invitations/pamphlets/cards using old cuts & fonts. Have been using it for @Quillette invitations already font-revival.com/
69
122
40
1,927
122,355
Eric Frank retweeted
Yes, it seems indeed the models even obtained the results on the same day. I haven't had a chance to look through the OAI claimed proof yet, but in the spirit of the AGMAI recommendations to improve exposition before release, some of us did read Claude's proof last week before release to try to incorporate a better quality high level overview and exposition overall, which I hope is reflected in the pdf (published via the AI repository Hexagon, see hexagonmath.org/2610.00577; lean available at github.com/anthropics/formal…; also see the google drive shared via @rrwilliams's post drive.google.com/drive/u/0/f… in preparation for the upcoming workshops he's organizing with Impagliazzo and Paturi). Sharing what I understood from the proof below: Basic idea (below is for runtime 2^{delta n} for arbitrary constant delta>0; it seems both proofs ultimately get roughly exp(O(n / sqrt(log n))) time with lower order terms in the exponent), * can assume num clauses = O(n) wlog via previous sparsification results (n = num variables) * Solve #3-SAT not 3-SAT (i.e. count satisfying assignments, don't just decide satisfiability) * Convert to graph problem: clauses are nodes, and edges between clauses that share a variable (whether it's x or not(x) doesn't matter; we care about same variable, not same literal). Weight of an edge is # of shared variables. * Divide and Conquer idea: if there's a cut with total weight W, you can iterate over all 2^W fixings of those shared variables, and for each fixing you recurse on both sides and multiply, then add it up. Base case is constant # vertices, then you can just brute force count in 2^O(1) time. Unfortunately, you're not going to always find such a cut. (aside: from now on you can imagine every occurrence of a literal gets its own variable, and edges are functions enforcing equality constraints between those copies) * Instead of the above D&C, group the vertices into g^2 groups for some large constant g = g(delta). It matters how to do this grouping (it's not arbitrary); without getting into the details (see paper), a random grouping has properties the D&C wants (probabilistic method), and this existence is enough to allow for a slow-but-fast-enough algorithm to find a good grouping deterministically. * Imagine laying out the g^2 vertices arbitrarily on a g x g grid. Some edges are "side edges" (purely horizontal or purely vertical) and some are "diagonal" (the rest). There are (g choose 2)^2 = Theta(g^4) diagonal ones (choose two rows and two columns to define the corners) but only 2*g*(g choose 2) = O(g^3) side edges. You can pick g a large enough constant that the side edges have much less total weight than the diagonals -- the D&C will save on the diagonals, so we want there to be many more of them. * The sum we want is sum_z prod_{vertices a} W_a(z_a) * prod_{edges a,b} P(z_a,z_b), where W_a(z_a) at the highest level of recursion is a table of 2^3=8 values for each of the settings of the 3 literals in clause a, with value 0 or 1 indicating whether z_a satisfies clause a or not, and P() is the equality constraint checker I mentioned on the edges (deeper levels of recursion also all involve sums of this form where P() is always an equality checker on some set of bits, but deeper W's have arbitrary integer outputs and not necessarily 0/1) Write prod_{edges} P(..) = prod_{side edges} P(..) prod_{rectangles r} P_1(..) P_2(..) where P_1, P_2 are the diagonals for the rectangle r *The key step* (eqn 15 in the pdf): first assume all edges in the entire graph have exactly 3 bits on them (it turns out reducing to this isn't *too* complicated; see (19)), and replace P_1*P_2 with a hyperedge that involves some function on the corners of the rectangle, times a sum of two products of edge functions. This replacement comes from something called the "eight square identity"; this is related to octonions, which I still know nothing about. :) So P_1*P_2 = HyperEdgeFunction(corners)*(Q_1*Q_2 + Q_3*Q_4) Two interesting things here: (1) Q_1,Q_2,Q_3,Q_4 are all side edges (Q_1,Q_2 are horizontal and Q_3,Q_4 are vertical), and (2) whereas P1,P2 have total weight 6 (3 and 3), if you merge each row of the grid into a supervertex then Q_1,Q_2 vanishes and the hyperedge becomes a regular edge with total weight 3 whereas hyperedge*Q_3*Q_4 still involves 6 bits (and vice versa if you merge each column into a supervertex). In particular, the average weight from using Q_1*Q_2 vs. Q_3*Q_4 is (3+6)/2 = 4.5. We went from weight 6 (P_1*P_2) to weight 4.5 "on average". * So back to the original sum, we can rewrite it: sum_a W_a(z_a) * prod_{side edges} P(..) * prod_{rectangles r} hyperedge(r) * (Q_1*Q_2 + Q_3*Q_4) Now imagine distributing that product over that final sum involving the Q's, to get a new sum that has a factor 2^{# rectangles} more terms multiplicatively. (but there are only poly(g) = O(1) rectangles, so this is only a 2^{poly(g)} = O(1) blowup in the number of summands) * Each one of these terms in the new, bigger sum, has a prod_rectangles in it. Either >=1/2 of the rectangles chose the Q_1*Q_2 when we distributed the product, or >=1/2 chose the Q_3*Q_4. That means we can either merge all row edges or merge all column edges, and one of those wil decrease the total number of weights on edges by a 4.5/6 factor. This is the heart of why D&C makes progress; D&C is supposed to reduce one instance to simpler instances, and "simpler" in this case means decreasing the total weight on all edges (here by a 4.5/6 factor). This overall looks like a recursion with branching factor 2^{poly(g)} = O(1), but in reality the branching factor becomes poly(m) when you account for the trick in the proof to reduce to the case of 3 bits on each edge. In any case, there are more steps to get everything to work, but the above gives some taste of how the Divide & Conquer works. If you optimize the right way to choose g to not be a constant but a slow enough growing function, you get runtime exp(O(n / log^c n)), but for a tiny c. If you replace the eight square identity with something fancier, and replace the black-box invocation of the sparsification lemma with a more white box version that adds in some more ideas, you get down to the exp(O(n loglog n / sqrt(log n))) in the paper.
The ETH repository has a paper where it appears an Anthropic internal model independently disproved the Exponential Time Hypothesis? xitter.twitterapi.xyz/rrwilliams/status/2114…
26
41
8
485
59,634
My mathematician daughter was browsing in a used bookstore this weekend ... and found this: writings.stephenwolfram.com/…
100
167
28
2,550
191,646
Introducing Reinforcement Learning from Collective Rewards (RLCR). RLCR is a recipe that trains language models as agent organisations, which share a message board and workspace. We use it to train Avalon-M1-Mini (120B) and study its behaviour. We find a number of interesting results, including: 🛠️ Learnt organisational hierarchies and divisions of labour 🕵️ Increased collective verification, through hires of verifiers and testers 👥 The rise of collective thinking, where agents think more about other agents and how to help them We believe RLCR can provide a laboratory for studying collective intelligence and multi-agent safety. Blog post and technical report 👇
96
180
77
1,967
199,386
Talked about the reasons to get rid of backprop last month. TLDR; memory wall.
Yaroslav Bulatov (@yaroslavvb) wants to get rid of backpropagation. For Episode 7 of The Interlude Show, @jakekang and I chat with Yaroslav, who worked at Google Brain, early OpenAI, Meta, and Together AI. He now runs the Sutro Group at South Park Commons (@spc), exploring energy-efficient learning algorithms with AI agents. We get into why moving data matters so much for energy use, how the memory wall changes algorithm design, and how gradient checkpointing can make a workload faster even while doing more calculations. We also discuss early OpenAI, his skepticism about reinforcement learning, and why recursive self-improvement still faces new bottlenecks. We close with whether more code translates into better outcomes, and the difference between AI that helps us pursue our goals and AI that gets better at capturing our attention. Chapters: 00:00 - A plan to rethink backpropagation 00:49 - Introducing Yaroslav Bulatov 01:30 - Energy-efficient learning and the 20-year research plan 03:25 - Why focus on software now? 08:05 - Sutro Group: using agents to explore learning algorithms 10:57 - The memory wall: arithmetic versus data movement 17:07 - Why peak memory is only part of the energy story 18:40 - Why Yaroslav wants to replace backpropagation 24:27 - Mixture of experts and disentangling neural networks 27:24 - Toy problems: matrix multiplication, sparse parity, and MNIST 31:21 - Early OpenAI and skepticism about reinforcement learning 34:41 - Gradient checkpointing: doing more math to move less data 38:51 - Power grids, intelligence per joule, and new bottlenecks 43:25 - Do more tokens and pull requests mean better outcomes? 46:21 - Superintelligence, specialization, and physical limits 51:49 - Creative freedom, attention capture, and possible AI futures
4
3
91
4,041
Found a fun use for Thermal Master P3 camera, track heat propagation when you schedule computation on different parts of the chip spacesheep.dev/@yaroslavvb/e…
2
3
1
35
2,255
Eric Frank retweeted
Argon has this amazing natural understanding of the world. It can do so many things from first principles. Here's a pelican riding a bike, using fourier epicycles. Video made by Argon. Time-synced Lyria 3.5 music prompted by Argon.
234
592
239
8,417
2,245,058
Eric Frank retweeted
$250M in new funding. A $1.5B valuation. A conviction that the way we engineer the physical world is about to change. Today, Vinci announces our Series B, co-led by @adventintl , @Temasek and Xora Innovation, with participation from @AMD Ventures, @EclipseVentures , @khoslaventures, @MadronaVentures and others. This investment backs a future where physics intelligence becomes foundational to how hardware is designed and built. For decades, engineers have rationed analysis, narrowed exploration and committed to decisions before knowing the physical consequences. Vinci’s Continuous Physics Reasoning makes deterministic, solver-accurate physical understanding continuously available as designs evolve. It is already running on more than 40 flagship production engineering programs. This round fuels our next chapter: expanding across more physics and more of the hardware economy, moving from understanding what will happen to helping engineers determine what should change. Semiconductors are the proving ground. The ambition reaches everything we build. Thank you to our customers, team and investors for making this possible. The next era of hardware engineering is taking shape. We’re building for it.
7
7
5
19
6,694
BTW, the entire development vault of Esperanto is up for open-sourcing/public-release, need to find funding to pay an intern to walk through the files and make sure no proprietary TSMC stuff is leaked
1
1
6
822
Spent last two weeks learning electronics by having Opus run experiments on the Esperanto AI chips and condensing the results into interactive diagrams like this spacesheep.dev/@yaroslavvb/e…
5
13
2
169
8,583
Eric Frank retweeted
Ive slowly came to realization that more and more people hate AI. Artists hate it, programmers hate it, mathematicians hate it, and everyone thats currently impacted in business hate it. It used to be small number of people, but its quite a lot now. I've been truely in a bubble because for past one year ive just met my peers in AI field / my workplace and my close friend, and noone else outside my existing network group. Ai researcher is slowly becoming most hated occupation and I dont know what / how to feel about it. We now have some big obligation to 'make it all work', i.e., permanent upperclass for everyone, or get hanged.
222
69
49
1,297
155,805
Eric Frank retweeted
I want a futurism that feels like this. Like we've mastered nature and mastered the human-scale longed for ideals. Not like flying plastic or plants on top of glass-plastic
131
635
52
8,870
240,184