Head of Robotics @runwayml, ex-DeepMind and Meta
Joined July 2022
- Tweets25
- Following319
- Followers1.7K
- Likes233
Today we’re releasing Praxis-1, Runway’s state-of-the-art world action model for robotics, with open weights under Apache 2.0.
It’s the #1 world action model and the #1 open-source model on NVIDIA’s RoboLab-120 leaderboard, and it’s 15.6x faster and 51x cheaper per completed task than a frontier LLM agent driving the same robot.
Under the hood, it’s a 27B-parameter mixture-of-experts diffusion transformer that predicts video and actions together, turning video pretraining into control for real robots.
Praxis-1 is available now on @LeRobotHF and vLLM-Omni (@vllm_project), with hosted inference on @reactorworld.
Full results: runway.com/research/praxis-1…
This is our first release, and we’re expanding our investment in robotics from here. If you want to put world models on real robots with us, we’re hiring!
jobs.ashbyhq.com/runway-ml/0…
Talking robots, sim-to-real, and what it takes to actually deploy at @encord_team’s Long Horizon Tuesday.
9:25am, Frontier Stage. Come say hi 🤖
The biggest names in Physical AI are coming the Long Horizon Summit Oct 20 / 21.
1000+ VPs, Heads of and Practitioners in one room. Every conversation will be worth your day.
See the full lineup here: encord.com/long-horizon/
1
2
266
Two robots ran live all day at our AI Summit on an early build of Praxis-1, our new World Action Model.
No cherry-picked clips, no benchmark maxxing, just the model working in front of everyone.
An article about the amazing applications of LLM's (GPT-3 for search, Excel, codegen, SQL)
From July 2020.
In the 2+ years since this article was published, none of these applications took off.
What happened? A Thread 🧵👇
pub.towardsai.net/crazy-gpt-…
The article above lists pretty decent GPT-3 applications, and all had working demos. But it looks like LLM's weren't quite ready for prime time then —
xitter.twitterapi.xyz/parthi_logan/status/13…
The results weren't accurate enough to charge people and the GPT-3 costs were too high to keep it up and running, unfortunately.
1
2