We've done over 1,000 episodes of this show on every layer of the A.I. stack... except the one that physically runs all of it: the A.I. data center. Today we fix that in a fascinating episode with Lightning AI's Frank Basso.
Frank is VP of Infrastructure at Lightning AI, a New York-based company that has over 35,000 modern GPUs, over $500m in ARR, and that makes it easy to go from A.I. idea to product, "lightning fast" (I hold a fellowship at Lightning so am not an unbiased source on the business, btw). Frank himself is based in Los Angeles and, prior to Lightning, he spent decades directing the development of data centers in California.
In this exceptionally informative episode, Frank explains:
• How Lightning provisions its 35,000+ GPUs through hyperscale co-location.
• Why everything new is liquid-to-chip cooled.
• How GPUs talk to each other over ultra-fast east-west networks.
• What it’s actually like to stand inside a 110-decibel A.I. data hall.
• The most persistent myths about data-center water and electricity use.
The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.
