cs @ cmu prev. meta superintelligence labs
Joined August 2023
- Tweets21
- Following14
- Followers14
- Likes43
Performance is pretty good too 👀
built during my time at @Meta Superintelligence Labs!
ExecuTorch WebGPU, PyTorch models on the GPU, in the browser.
Running a PyTorch model in the browser has usually meant converting it to another framework's format first. With ExecuTorch's new WebGPU backend, you export once with torch.export, and the same .pte file runs in WebGPU browsers such as Chrome and Safari. Everything runs locally in the tab, so prompts, photos and audio never leave the device.
The backend already runs Llama 3.2, Qwen3, Gemma 3, SmolVLM, SAM 2, Depth Anything V2, D-FINE, Real-ESRGAN and Whisper, and supports LoRA and DiReFT fine-tuning on-device.
By Julian Ng-Thow-Hing (@hing3074), Siddartha Pothapragada, Stephen Jia, Digant Desai (@digant23), and Bilgin Cagatay (@BilginCatay).
Read the post: pytorch.org/blog/executorch-…
Try the models in the ExecuTorch WebGPU Playground: executorch.ai/playground
Just presented my inference research with @Meta Superintelligence Labs at the @PyTorch Conference!
my research focused on building a new path for fast PyTorch inference and fine-tuning directly in the browser without the cloud. We demonstrated competitive performance against alternative frameworks like WebLLM, llama.cpp, and ONNX Runtime Web, and showcased a few examples of on-device AI experiences!
try out a few examples here: executorch.ai/playground/
4
127