AMD x RedHat AI-Infra Workshop: High performance inference, at scale

Thursday, Oct 8

10:00am – 2:00pm

Hosted by

•‿•

ʘ‿ʘ

¬‿¬

´◡`

◔◟◔

Join AMD, Cerebras, MoonMath AI, Red Hat, and the vLLM project for an in-person half day on open source inference, ending with a hands-on workshop you can follow along with on your own laptop. Self-hosting open models is now a real option for teams that want high performance without per-token costs. We will cover how vLLM and llm-d make distributed inference fast at scale, and how being smarter about which model serves which request cuts your inference bill without giving up quality.