vLLM Inference Meetup, Mumbai

Whether you’re looking to squeeze every last token out of your GPU cluster or are curious about the latest developments in the vLLM and llm-d ecosystems, this is the room you want to be in.

​What to Expect

• Deep Technical Sessions: Hear directly from the maintainers and core committers of vLLM and llm-d
• Scale in Production: Learn from industry leaders about deploying LLMs in production
• Networking: Stick around for food and soft drinks. It’s a great chance to chat with the speakers and exchange ideas with fellow developers and engineers.

​​Who Should Attend

• vLLM and llm-d users and contributors
• ML and infra engineers working on inference and serving
• Platform teams running GenAI in production
• Anyone curious about efficient inference across local, cloud, and Kubernetes

​​Event Agenda

1:00 PM – 1:30 PM | Registration & Welcome Registration, Keynote session.

2:00 PM – 2:30 PM | Production Deployment of BharatGen Models using vLLM ecosystem. TBD

2:30 PM – 3:00 PM | llm-d for Sovereign & Agentic Workloads TBD

An overview of llm-d’s distributed inference stack, along with ongoing optimization and benchmarking efforts for sovereign and agentic workloads.

3:00 PM – 3:30 PM | Distributed Inference on ROCm with WideEP on vLLM & llm-d by TBD

3:30 PM – 4:00 PM | Tea/Coffee and Snacks

4:00 PM – 4:30 PM | Inside vLLM Semantic Router: Intelligent Routing for LLM Inference TBD

Explore how vLLM Semantic Router uses intelligent, cache-aware routing based on request semantics, model capabilities, workload characteristics, and infrastructure constraints to optimize inference.

4:30 PM – 5:00 PM | Scaling Inference at NxtGen Using the vLLM Ecosystem TBD NxtGen

Learn how NxtGen is leveraging the vLLM ecosystem to scale LLM inference workloads.

5:00 PM – 5:15 PM | Break

5:15 PM – 6:15 PM | Hands-on Workshop: