harpreet (@DataScienceHarp) header
harpreet (@DataScienceHarp) profile picture

hacker-in-residence/ principal devrel engineer. data curation for physical and visual ai systems. in my physical ai era

I ship daily
Joined April 2020
Photo by harpreet (@DataScienceHarp)Photo by harpreet (@DataScienceHarp)Photo by harpreet (@DataScienceHarp)Photo by harpreet (@DataScienceHarp)Photo by harpreet (@DataScienceHarp)Photo by harpreet (@DataScienceHarp)Photo by harpreet (@DataScienceHarp)Photo by harpreet (@DataScienceHarp)Photo by harpreet (@DataScienceHarp)Photo by harpreet (@DataScienceHarp)
This is clearly the path to scaling ground level 3d globally. It's wild how good LLMs are getting at making plausible 3d reconstructions of the real world. This literally used to be an IARPA (IC world's DARPA) project a few years ago and now it's a frontier model prompt.
Gemini 4 Carbon is out today - spent a bit of time testing its long-horizon agentic coding on a personal experiment: rebuilding ~220m of downtown Los Gatos in Blender (~50 storefronts + 3D interiors), w/ ~zero manual modeling. Quick look under the hood 🧵 (1/5)
20
37
2
399
24,428
agent memory is one of the key topics for developers to learn in 2026. @AnthropicAI latest piece on building better memory tociches on a lot of things I've been splving for years. This year in particular I went around the states talking to devleopers and startups solving agent memory Here is record of it youtu.be/b3R7Q7xbwVs
1
3
9
1,467
claude will get lung cancer with how often it runs smoke tests
17
25
3
544
19,369
Call for Speakers! Are you working on robotics research, an open source project or commercial app in the physical AI space? Consider speaking at the upcoming Nov 9 - Buffalo Physical AI Workshop and Meetup! Visit hubs.ly/Q04CnZRT0 to submit your talk. (Select “Nov 9 - Buffalo” in the dropdown.) Event details: hubs.ly/Q04CnYSv0 #PhysicalAI #Robotics #ComputerVision #MachineLearning #FiftyOne
1
3
90
harpreet retweeted
got an SO-101? think yours can finish it? built a little game. the idea is stupid simple, get from start to finish without crossing the red lines. play here wiggle-run.vercel.app/ #robot #game
1
1
5
172
This is a virtual human body with 700 muscle actuators, 206 joints, and 90 body segments. It's fully open source, and researchers can use it to simulate human movement through muscle-level control.
51
166
24
1,597
94,701
harpreet retweeted
New in LeRobot: DM0.5 by @Dexmal_AI 🤖 A 4B VLM with a 680M flow-matching action expert, pretrained on 7 robot embodiments. Right now it's the top open-source model on RoboColiseum. Fine-tune it on your robot: --policy.path=lerobot/dm05_base Docs 👇 huggingface.co/docs/lerobot/…
13
30
4
208
11,614
harpreet retweeted
Fifteen years ago, doing SLAM with a single camera didn't even stand a chance. I was working on SLAM back then. Point Cloud Library had just been released. ROS1 was picking up steam. And if you wanted good accuracy, you used a LiDAR of some sort. Cameras alone didn't cut it. Not even stereo. Bring up a single camera and nobody took it seriously. Then I came across this open-source model rebuilding 3D scenes from one camera, live, at around 20 frames per second, and staying stable over long sequences. That still blows my mind. And it isn't only perception and mapping that grew up. Position estimation came a really long way too. Factor graphs, IMU preintegration and a stack of other techniques each pushed the field forward in their own way. If you're a robotics nerd, you know how exciting this is. The setup that didn't stand a chance in my SLAM days is now code you can clone and run.
8
11
191
9,730
new day, new dataset 🤗! we now have 900+ 3D files from @NASA on the hub to explore! - includes space shuttles, satellites, and more! 🚀 - permissively licensed, filtered dataset link: huggingface.co/datasets/suva… use this space to explore and look around: huggingface.co/spaces/suvadi…
1
13
597
If you're a rockstar DevRel in AI and in the bay area 🇺🇸, we are hiring! DM me or apply here! careers.nebius.com/job?gh_ji… RT for good karma!
“Startup companies like Nebius are doing incredibly well.” - @JensenHuang, @nvidia CEO at #NVIDIAGTC Berlin keynote
3
5
24
1,452
harpreet retweeted
Today at @NVIDIAGTC Berlin, @Porsche, @VW Group brands, and @cariad_tech announced that they are jointly building a shared AV data flywheel, with Porsche leading the initial implementation and ecosystem integration together with @Voxel51, @NVIDIA, and @Microsoft: link.voxel51.com/blfs3v
1
9
13
1,014
Join us Nov.2 SF to win $18k 💰
On Nov 2, join us w/ @Microsoft x @nvidia for an SF buildathon that pits frontier models vs specialized open models. To win: Pick a task, build an eval & beat a frontier model on quality, latency or cost. Teams of 2-5 compete for $10K. Apply early to save your spot: luma.com/fireworks-8kmc
2
6
1,166
🚀 Introducing Voxel51 3.0 — an end-to-end multimodal platform for physical AI, right in your browser - voxel51.com/blog/voxel51-3-0… We’ve unified search, curation, annotation, and evaluation into a single platform! 🔹 Time-series multimodal support — work seamlessly across sensor streams, video, and more 🔹 Unified annotation — one workflow for all your data types 🔹 Agentic Labeling — VLM-powered labeling that does the heavy lifting for you 🔹 Voxel51 Agent — chains workflows together using 45+ MCP tools, 80+ operators, and 18 skills 🔹 Data provenance — full activity logs, sample edit history, and dataset versioning for complete traceability 🔹 Model-agnostic and free to try. 👉 Get started at app.voxel51.com #Voxel51 #PhysicalAI #MultimodalAI #ComputerVision #AIAgents #DataAnnotation #MachineLearning
1
4
5
192
VOXEL51 IS REBORN TODAY!!!! Starting today, anyone can try Voxel51's paid features for FREE with just an email. For anyone who hasn’t tried our product yet, here are three things I’d try first:  → Voxel51 Search: Hybrid search across embeddings and structured metadata. All data uploaded to Voxel51 is automatically indexed, so you can search by semantic similarity alongside exact conditions, metadata, and multimodal events out of the box. → Agentic Labeling: Powered by VLMs, generate labels from natural-language instructions and visual examples, then review and refine the prompts before applying them more broadly. → Voxel51 Agent: Everything you can do with Voxel51 can now be initiated with a prompt. Ask and answer questions about your data and models, and turn those actions into repeatable workflows. Try it on your own data and tell me in the comments what works and what doesn’t: lnkd.in/gx4_kV_C
4
1
10
469
Tactile is making its first steps in @LeRobotHF datasets, and @DataScienceHarp has you covered on how to visualize it 🫆
we gave robots eyes and called it manipulation but try tying your shoes with numb fingers robots need to feel their data, not just see it i pulled some of the most interesting tactile lerobot datasets into fiftyone, all ready to use on the hub, plus what to check before you train on touch huggingface.co/blog/harpreet…
1
3
142
Exact-duplicate search misses mirrored, cropped, or filtered copies of your images — different bytes, same picture - voxel51.com/blog/image-copy-… That’s train/test leakage, wasted labeling spend, and licensing headaches waiting to happen. Voxel51’s fix: combine two signals that fail in different places. 🔹 pHash — reads pixel layout, breaks on mirrors/crops 🔹 CLIP — reads meaning, fooled by look-alikes 🔹 A rule you control to combine them (“any” vs “all”) 🔹 Every link shown as a graph, with evidence 🔹 Scored against ground truth with native evaluation Check out @DataScienceHarp's post! #ComputerVision #MachineLearning #OpenSource #AI #DataCuration
3
6
395
Failure mining in robotics: find one failure, surface every similar one - voxel51.com/blog/failure-min… Most robotics teams find failures by scrubbing hours of recordings by hand. This Voxel51 post shows a faster workflow in FiftyOne: * Start with one confirmed failure (a robot drops a cloth mid-fold) and mark it with a temporal tag * Use segment-level embedding similarity search to surface every visually similar moment across the dataset — not whole episodes, but 5-second windows * Embeddings find similar situations, not failures — a dropped cloth and a deliberately placed one look nearly identical. Scoping the search to episodes already flagged as failed cut candidates from 16 down to 2 * Review and confirm the real failures, then tag + save them as a reusable set for retraining or evaluation The result: a repeatable loop — find, search, narrow, confirm, tag — that turns a messy pile of recordings into a growing, labeled failure dataset. #Robotics #PhysicalAI #MachineLearning #ComputerVision #DataCuration #AI #FiftyOne #Voxel51 #RoboticsAI #DataFlywheel
1
2
104
harpreet retweeted
The robotics data ecosystem keeps getting stronger 🦾 @Voxel51 now reads LeRobot datasets natively, with episode visualization, embedding exploration and semantic search across embodiments 🤗
you balanced your robot dataset by embodiment. the embeddings say you balanced it by recording session i pulled 10 episodes from each of the 50 robot types in lerobot's community dataset and embedded every clip with qwen3-vl 1. 495 of 497 clips have their nearest neighbor in the same session 2. 292 score below 0.1 uniqueness 3. the two "most unique" clips are single-frame recordings, 0.02 seconds long filter the session out and the cross-embodiment signal shows up: a cloth fold on one rig lands next to so100 arms folding cloth i indexed all 497 episodes in fiftyone so you can search by text, cut the near-duplicates, and export a curated lerobot v3 subset one prompt to an agent with fiftyone skills built the whole thing start here, read the full blog: huggingface.co/blog/harpreet… read the dataset card: huggingface.co/datasets/Voxe… @LeRobotHF @Alibaba_Qwen
3
6
70
5,197
Tokyo's most accident-prone intersection, turned into a dataset you can actually explore. Check out this lightning talk from @DataScienceHarp on the Hard Intersections Multimodal Dataset from Dynamic Map Platform Co., Ltd. - huggingface.co/datasets/dyna… * 6 synchronized camera views (full 360°) * 29 classes of road infrastructure — labeled entirely by models, zero manual annotation * Trajectory data at 200Hz * HD maps in 5 industry formats * ~35M-point aggregated LiDAR All in one interactive viewer with FiftyOne. No exporting. No jumping between tools. #ComputerVision #AutonomousVehicles #FiftyOne #OpenSource
3
6
324
VLA models don't learn from folders of images. They learn from episodes—vision, state, and action locked to one clock, frame by frame - voxel51.com/blog/lerobot-v3-… We loaded 11 LeRobot v3.0 datasets into FiftyOne so you can inspect them before you download. * Single Franka arms to full humanoids * Real teleoperation + pure simulation * Fingertip tactile sensing (20 streams) * From 10 to 27,500 episodes What we found digging in: * InternData-A1 is 100% synthetic—and looks photorealistic * droid_3d's depth streams silently drop (importer can't decode the dtype) * Licenses vary within a single export Look at your data before you train on it. Check out @DataScienceHarp 's post. #PhysicalAI #Robotics #VLA #LeRobot
3
5
168