Jesse just let me know that he's come down with something and won't be
able to speak tomorrow. So, we're short one speaker this month at the
moment. Does anyone have anything they could fill in with at the last
minute? If so, please let me know ASAP.
--
Russell Senior
PLUG Volunteer
[email protected]
On 3/31/26 14:24, Russell Senior wrote:
Coming up in a couple days!
On 3/18/26 14:45, Russell Senior wrote:
Who: Jesse Lopez
What: Inside AI Supercomputers: From GPUs to Multi-DC Clusters
Where: 1930 SW 4th Avenue, Portland, Oregon 97201-5304, Room 86-01
When: Thursday, April 2, 2026 at 7 PM
Why: The pursuit of technology freedom
Summary:
Large language models and other frontier AI systems are trained on
clusters with thousands to over a hundred thousand GPUs. But what
does that infrastructure actually look like? This talk walks through
the anatomy of an AI supercomputer from the ground up: individual
GPUs, multi-GPU nodes, racks, and full clusters. We'll cover the
three pillars of compute, storage, and networking, then look at how
training and inference workloads place very different demands on
hardware. Finally, we'll explore how Linux runs the show at every
layer from the OS on each node, to InfiniBand fabric management, to
job scheduling with Slurm, Kubernetes, and Ray.
No AI/HPC background required - just curiosity about what it takes to
build and run the machines behind the models.
Bio:
Jesse Lopez is an AI/ML and Technical Program Manager in the Azure
HPC/AI organization where he helps deploy large-scale AI
infrastructure and works with customers to put it to use. A former
scientist, he has a background in high-performance computing, AI/ML,
and has been a Linux user since the nineteen hundreds.
Calagator: https://calagator.org/events/1250482513
With luck, the talk will also be streamed live here:
http://www.twitch.tv/kngbwlf, and later posted to YouTube.
PLUG is back at Portland State University, thanks to the Computer
Science Department and to Andrew Greenberg. The room is in the
basement of the PSU Engineering Building (also connected underground
to the Fourth Avenue Building, or FAB). Enter through the Engineering
Building. The outside door will be locked, but there should be
someone present at the entrance to let you in starting at 6:40pm
until 7pm. There will be a sign on the door with a phone number you
can SMS if there isn't someone there to let you in immediately.
