Mostly posting about robots. currently AI @agilityrobotics prev embodied AI @AIatMeta, @NVIDIAAI. All views my own.
Pittsburgh, PA
Joined December 2013
- Tweets24.5K
- Following3.8K
- Followers39.2K
- Likes94.7K
Pinned Tweet
Using a simulation that does not match the world very well, you can let an agent build and acquire skills that it can then use on a real robot, in order to perform a wide variety of manipulation tasks. Cool work by @JiahengHu1 and @SteveTod1998 on @RoboPapers ->
Coding agents powered by large language models are increasingly able to complete complex, long-horizon goals, but this capability is still largely relegated to computer tasks. Bringing agents to real-world robotics is much harder.
Enter SimEX, by @JiahengHu1, @SteveTod1998, and team. It is a simulation-based auto-research framework, wherein agents can develop skills which can be used to control real robots, developing a robust toolbox of skills which can then be used for real-world tasks like towel folding and plate manipulation.
To learn more, watch Episode 116 of RoboPapers with @micoolcho and @DJiafei!
Teleoperating the @featherrobotics semi-humanoid. Its $33,000 and has 15 lb payload per arm, and is human sized with fantastic reach. All around seems like a great and affordable industrial semi humanoid.
And really glad the team let me try it out. It always gives a clearer (and usually more positive) view of what a robot can do
Another cool DexUMI stype solution, but the same device is both DexUMI and robot hand. really promising way to close the gap
You’ve seen data-collection gloves. You’ve seen teleoperation gloves.
But this is different.
What if the glove itself IS the robot hand? ✋
TRIMI eliminates the gap between human demonstration and robotic execution! Cool! 😎
@RoMeLaUCLA @UCLAengineering
If youre a roboticist worried about how frontier models are going to eat all of robotics, I recommend stopping by the RoboColliseum setup at the BitRobot booth. It made me feel a lot better. Here's GPT6 astra folding a towel
Robots are going to be so cheap in a couple years
The start of something new
A family of affordable American Robots
Pre-order Origin now at hiroindustries.com/ for $450
Chat when Russ Tedrake does a point by point takedown of your blog post in his keynote is it a good thing
Walden robotics: be full stack, build a good simulation, build a good teleop stack and collect human intervention data at scale.
Long horizon mobile manipulation will always be the coolest thing you can do; probably the most impressive demo at CoRL
Yesterday, we unboxed Taku at @corl_conf put it to work.
Powered by Dyna-2.1, it performed long-horizon, whole-body mobile manipulation zero-shot, with no on-site data collection or post-training.
Come see it live and meet the team at Booth 500 in Griffin Hall!
I might like the zoox experience the most. The vehicle is so roomy and futuristic. Its tiny but gives you, the occupant, so much space.
6
68
3,914
Riding in a @zoox for the first time since I was an intern like 10 years ago
Teaching robots new tasks very quickly
As we get closer to a world where we live among robots, it’s becoming more and more valuable for robots to learn quickly with and from people.
I’m very excited to share Steertuning, a novel approach that adapts robots to new tasks from 5 human demonstrations in under 5 minutes, from demonstration to deployment.
Website: steertuning.github.io/
Code: github.com/billy-yibo-yan/st…
“I was struck by a statistic that seemed to me shocking. In the last 50 years, the automobile has killed more people in the United States than we have had fatalities in all our wars: on all the battlefields of all the wars of the United States since its founding 177 years ago.”
— Dwight D. Eisenhower, Remarks to the White House Conference on Highway Safety, February 17, 1954.
