Red Hat User Group - New Mexico

Red Hat® User Group (RHUG) events offer a unique opportunity for Red Hat technology users to gather and discover solutions to IT challenges with subject matter experts & peers. Join the next RHUG to network and explore cutting-edge solutions for IT modernization. Don’t miss this opportunity to transform your IT services while enjoying great food and building connections with industry professionals.

Deploying large language models at scale presents challenges, including high GPU costs, unpredictable latency, and black-box infrastructure that doesn’t align with cloud-native practices. The solution? llm-d, a new open-source framework developed in collaboration with Red Hat, Google, NVIDIA, and Hugging Face. Built on Kubernetes, llm-d disaggregates LLM inference into composable, observable services — like prefill, decode, and shared caching — all orchestrated by an intelligent Inference Gateway. In this session, we’ll explore the architecture behind llm-d, compare it to traditional inference stacks, and show how it empowers enterprises to run GenAI workloads with greater efficiency, flexibility, and control.

Join the Los Angeles Red Hat User Group (RHUG) and the LA DevOps community for an evening of connection, insight and innovation.