Average coder, below average runner, worse cyclist & not able to swim.
India
Joined January 2025
- Tweets473
- Following35
- Followers16
- Likes528
Discovered an interesting Kubernetes gotcha while working on LLM-D EPP configs!
ConfigMaps and Deployments for two different models ended up colliding because of name truncation to 40 characters.
1
17
Same resource kind + namespace + truncated name = collision.
A tiny naming detail, but a potentially cause big outrage 🔥, resources can be confused among themselves 👀…..
#Kubernetes
7
Seems like two of my source proposals are going to be discarded 😭.
github.com/llm-d/llm-d-route…
github.com/vllm-project/vllm…
Anyways will try more in future with great issues 🙌…
#OpenSource #llm
![[RFC] Sampled request/response capture for training-data collection for fine-tuning & RL · Issue...](https://pbs.twimg.com/card_img/2119299566122205184/r-hXP4_A?format=jpg&name=800x419)
1
39
Happy Diwali Everyone 🪔🎊🎆....
This festival season brings one more open source contribution .. yeye ..
Raised a issue github.com/llm-d/llm-d-route…, will be following up with upstream pr soon 🙌..
#diwali #opensource #llmd #RL #LLMs #GPU #Inference #plugin
2
106
Guess who don’t need music for long runs 🙌…
Only good thing accident gave to me is to leave music from running 😂…..
2
39
The Legend of Hanuman is so peak ❤️. Got to know many new stories, and fun part is some of them I played in my childhood in Ramleela 🫡...
Goated webseries...
1
54
kitne ajeeb log hai, telling me on friday morning, we need to do prod cluster migration, friday night cooked 🥲
1
2
57
Getting praised by CTO of my company is not on my 2026 bucket list… 🙈
But it kind of embarrassing/weird over mail with all tech leads 😅.
1
6
95
Open source contributions is more about convincing maintainers for the issue and approach, rather than implementation, felt this most of the time. 🫡
#opensource
1
66
Every time we added a model lane behind our gateway, the bottleneck wasn't only GPUs. It was certificates too.
Each lane had to be distinguished by hostname or port → new SAN entry, DNS record, cert rotation overhead. On managed cert infra, that's the tax on adding a model.
1
2
95
In multi-cluster llm-d, suppose the EPP on cluster A steers requests to gateways on clusters B and C. Those gateways have DNS names. But the proxy only understood IP:port. So we had to hardcode load
balancer IPs — which break silently when an LB is recreated.
1
2
143
The fix turned out to be small. agentgateway already has a Target type with Address + Hostname variants, and DNS resolution for Hostname targets already exists — it's how LLM provider hosts (api.openai.com etc.) are reached.
1
2
66
In networking, the terms target and socket address are used in different layers and contexts, representing different levels of abstraction for where data is being sent.
1
1
64
Corporate is place you find different personalities, found a such generous soul 🤌.
My mentor is so kind n fun loving person, always allow me to explore new things & ideas. Guides me during difficult times, grateful to god to have such good seniors 🧿.
3
89
Felt like went to gym after a decade 😭.
Weight that was gained, gone…
Weights that I used to lift easily, now feeling like failure set 🥲…..
What to do…..
3
1
140
