Partiful logo

MIT-IBM / The Open Accelerator - Build-n-Brew Session 1 -- vLLM - #BOSTechWeek

Hosted by MIT-IBM Watson AI Lab
:◗
❛o❛
Learn about efficient AI inference and put it into practice in a hands-on workshop focused on fast, high-performance deployments with vLLM. Together, we’ll deploy a dense LLM with vLLM, benchmark performance using GuideLLM, and explore techniques like quantization and speculative decoding to improve throughput, latency, and overall efficiency. We’ll also showcase LLM Compressor, an open source library for model quantization. As part of the workshop, we’ll deploy a quantized model together, then measure the impact on the AI metrics that matter most in production deployments. The session will conclude with an open community discussion and networking. Who should attend: AI developers, ML engineers, platform engineers, data scientists, and anyone passionate about AI, data, and computer science who wants to get hands-on with modern, open source LLM deployment and optimization techniques. What to bring: A fully charged laptop! _________________ This is the first in a series of four "Build-n-Brew" sessions to be held in the afternoon of each day during Boston Tech Week, hosted at the MIT-IBM Computing Research Lab at "Pi on Main" (314 Main Street) in the heart of Kendall Square. Co-sponsored by The Open Accelerator, RedHat, and IBM, each session starts at 4pm and will be a hands-on "build" experience to learn and use the latest in open source AI tech, to be followed by a reception for a little nosh, "brew", and networking. This first session will be on vLLM. NOTE: Doors open at 3:30p and space is limited to the first 50 to arrive - If you don't make it in time, we'll leave you with a small consolation prize and an invitation to join us at a future event. This event is a part of #BOSTechWeek—a week of events hosted by VCs and startups to bring together the tech ecosystem. Learn more at www.tech-week.com.

Guest List

124 on the list
*◟*
•‿•
ツ

Restricted Access

Must be on the list to view event activity & see list details
Already RSVP'd? Sign in