Fast ML inference. Run top AI models using a simple API.
Palo Alto
Joined February 2023
- Tweets798
- Following79
- Followers6.3K
- Likes263
Pinned Tweet
#1 US-based provider on @OpenRouter. 2.4T tokens a day. Zero data retention. No training. Thank you, builders.
We're excited to be at the @Sgl_project & @lmsysorg Summit in SF this week as a sponsor. Some of the best work in open-source AI infra happens in this community, and we’re looking forward to the conversations. Stop by and meet the team 👋
Sponsor booths and Full Passes for SGLang Summit 2026 are SOLD OUT! Thank you to everyone joining us. 🙌
Get your Expo Pass now to watch select main stage sessions broadcast live in the Expo area, join technical breakouts and hands-on workshops, and explore the GPU Expo. Plus, meet the teams building across the AI stack at community events.
📍 Nov 12–13 · Fort Mason, San Francisco
🎟️ Tickets & agenda: sglang.io/summit
Kimi K3.1 Pro is live on DeepInfra Day 0 🚀
Congrats to @Kimi_Moonshot on their most capable open-weight model yet.
2.8T MoE, 1M context, vision. Hosted in the US on NVIDIA Blackwell, zero data retention.
To celebrate, 5% off: $1.90 in / $9.50 out / $0.19 cached per 1M
Link in the comment ⬇️
Proud to be part of the NVIDIA Inception program, and to support the startups in it. Fellow #NVIDIAInception members get 10B free NVIDIA Nemotron tokens on DeepInfra, plus 50B more on 200+ models through DeepStart. Thank you, @NVIDIAAI
#AI
Try it: deepinfra.com/nvidia/NVIDIA-…
2
280
Try it: deepinfra.com/nvidia/NVIDIA-…
Technical blog: deepinfra.com/blog/nvidia-ne…
82
The hard part of an AI in a group chat isn't answering. It's knowing when to stay quiet.
Boba reads the room, speaks up when it can help, and sticks with a goal for weeks.
Ampersand, then Boba, in one week. @humansand keeps shipping. Would you add an AI to your group chat? 🚀🚀🚀
Introducing Boba - the social intelligence that understands your goals and your community. Text Boba today or message it online at boba.app
Today at #NVIDIAGTC Berlin, our CEO @nikolaborisof joined @nvidia panel, “From Capacity to Customers: Building the AI Factory Business.”
The panel brought together leaders across energy, infrastructure, models, and capital. Nikola spoke for inference providers: what customers need, and how providers turn capacity into a sustainable business.
A few takeaways from the discussion:
💡 Open models give customers control. Open-weight models let teams decide how their stack runs, where their data lives, and who they depend on. That’s becoming central to sovereignty conversations.
💡 Inference at scale has to be stable and compliant. Customers moving AI into production need it to be reliable, predictable, and built to meet regulatory requirements.
💡 The AI factory is a supply chain. Financing, power, and infrastructure all have to line up before capacity turns into tokens that customers can use. From there, the business is about yield: getting the most useful output from every GPU.
Thanks to NVIDIA for hosting, and to fellow panelists @hitachienergy , @Macquarie , @MistralAI, and @nscale for a great conversation.
#AIInference #OpenSource #AIFactory
Huge congrats to @humansand on launching Ampersand.
A model trained to collaborate, and measured on what people actually get done together over months, not single-turn benchmarks. That's the right thing to optimize for.
No one changes the world alone
Introducing Ampersand - the first model built for us. Ampersand is a collaborator trained to help people achieve their individual and collective goals. In multi-month simulations, users collaborating with Ampersand accomplished more than with Fable and other frontier models
Available to everyone through our API
Explore the models →
Nemotron 3.5 Embed 1B:
deepinfra.com/nvidia/Nemotro…
Nemotron 3.5 Embed 8B:
deepinfra.com/nvidia/Nemotro…
Nemotron 3.5 Rerank 8B:
deepinfra.com/nvidia/Nemotro…
282
Demand for DeepSeek V4.1 Flash has been nuts. People have agents grinding on it all weekend, nonstop.
So screw it, we're cutting the price 51% 🚀🚀. keep them running.
