Scaling AI Infrastructure - From Chiplets to Clusters By Keysight - #BosTechWeek
Hosted by
•‿•
ツ26/50 spots left
AI is a truly system design challenge that balances Compute, Storage and Network. With the inference market growing bigger than training, orchestration of these three infrastructure components is the key to Tokenomics driving the efficiency of every generated token.
This presentation explores the critical journey of scaling AI infrastructure, tracing the evolution from pre-silicon design and multi-die chiplet architectures all the way to fully synchronized data center clusters and edge deployments. Because AI workloads push devices well beyond baseline specifications, small physical margins can quickly compound into network timeouts. A single dropped packet can spike tail latency, inflate Job Completion Time (JCT), and degrade GPU utilization.
You will also learn how AI is scaling in all dimensions, called Scale X (Scale In, Scale Up, Scale Out, Scale Across, and Scale Above), all at once. We present the Challenges in each dimension and how hyper scalers are solving these challenges.
This event is a part of #BosTechWeek—a week of events hosted by VCs and startups to bring together the tech ecosystem. Learn more at www.tech-week.com
Guest List
❛o❛
¬‿¬
ᵔ▾ᵔ