Filtering by Category: Accouncement

Building an AI Data Center End to End, with Lightning AI’s Frank Basso

Added on by Jon Krohn.

We've done over 1,000 episodes of this show on every layer of the A.I. stack... except the one that physically runs all of it: the A.I. data center. Today we fix that in a fascinating episode with Lightning AI's Frank Basso.

Frank is VP of Infrastructure at Lightning AI, a New York-based company that has over 35,000 modern GPUs, over $500m in ARR, and that makes it easy to go from A.I. idea to product, "lightning fast" (I hold a fellowship at Lightning so am not an unbiased source on the business, btw). Frank himself is based in Los Angeles and, prior to Lightning, he spent decades directing the development of data centers in California.

In this exceptionally informative episode, Frank explains:
• How Lightning provisions its 35,000+ GPUs through hyperscale co-location.
• Why everything new is liquid-to-chip cooled.
• How GPUs talk to each other over ultra-fast east-west networks.
• What it’s actually like to stand inside a 110-decibel A.I. data hall.
• The most persistent myths about data-center water and electricity use.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Fable 5: The Full Story from Capabilities to Drama

Added on by Jon Krohn.

The dust has settled, allowing me to provide you with all the key context you need to know on Fable 5, the most capable A.I. model ever offered to the public, and the US government forcing it off shelves three days later:

A NEW CLASS OF MODEL
• Anthropic stacks its models in tiers: Haiku (small and fast), Sonnet (the capable middle) and Opus (the powerful top). Sitting above all of them now is a "Mythos-class" tier.
• Fable 5 and its locked-down sibling Mythos 5 are the same underlying model... the only difference is the safeguards.
• Mythos 5 goes to trusted cyberdefenders with guardrails largely lifted; Fable 5 went to the public with them switched on.

WHAT IT COULD DO
• State-of-the-art on nearly every benchmark Anthropic tested... and the lead grows the longer and more complex the task (see chart).
• Stripe ran a codebase-wide migration on 50M lines of Ruby in a single day; work estimated at 2+ months for a full engineering team.
• Beat video "Pokémon FireRed" from raw screenshots alone, and got a 3x bigger memory boost than Opus on "Slay the Spire".
• Priced at $10/$50 per million input/output tokens: roughly 2x Opus 4.8, but under half the original Mythos Preview.

SAFETY BY DESIGN
• Classifiers watch three sensitive areas: cybersecurity, biology/chemistry and distillation (extracting a model to train a rival).
• Flagged requests quietly fall back to Opus 4.8 and the user is told.
• Triggers fire in under 5% of sessions. Anthropic admits it tuned conservatively, so some harmless prompts get bounced too.

THE THREE-DAY SHUTDOWN
• On Friday evening the federal government ordered Anthropic to switch off both Fable 5 and Mythos 5 worldwide, citing national security.
• The mechanism was an export-control action covering foreign nationals everywhere (including even, say, Canadian Anthropic employees living in the US!)... so broad that Anthropic pulled the model for absolutely everyone.
• The trigger was a reported jailbreak of the cyber safeguards by Amazon. Anthropic disputes its severity, calling it narrow and non-universal.

BOTTOM LINE
A premium-tier model, wrapped in deliberately cautious safeguards, pulled by its own government not long before Anthropic's reported IPO and the latest in a public battle between the firm and the federal government. Sessions now fall back to Opus 4.8. Whether Fable returns (and on what terms) depends on a fight that's far from over.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

How AI Erased My Career Moat, an Episode #1001 Special: Jon Krohn interviewed by Kirill Eremenko

Added on by Jon Krohn.

To mark cresting over 1000 episodes, today’s features a role reversal: Kirill Eremenko (who founded the podcast a decade ago) returns to host and welcomes *me* as the guest. Kirill's still got it, enjoy!

Kirill hosted the first 431 episodes of the SuperDataScience Podcast before handing me the reins five years ago. In today's role-reversal episode, we discuss:
• A.I. rapidly usurping our technical skills
• Whether we’re in an A.I. bubble
• The one key reason why I’ve seen A.I. projects fail
• Relationships between A.I. and biological neuroscience.

... so, as usual, lots of A.I. in this episode, but unusually, I’m the one answering the questions instead of asking them!

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Ten Years of the Super Data Science Podcast, with Jon, Kirill and Special Guests

Added on by Jon Krohn.

Today, we published Episode #1000 of the SuperDataScience Podcast! To celebrate, the show's original host Kirill Eremenko joined me and dozens of regular listeners on air to predict what the next 10 years of A.I. will bring.

In a bit more detail:
• We publish 104 episodes per year so Episode #1000 coincides with the show being about ten years old.
• The show was founded by Kirill Eremenko in 2016, who hosted over 400 episodes before handing me the reins in 2021.
• In a first for the show, Episode #1000 was streamed live online with our audience invited to join on air.
• Most folks interacted via chat functionality but a number of surprise guests came right onto the recording including Natalie Ziajski and Mario Pombo from the podcast team, rockstar A.I. entrepreneur Jepson Taylor, my 96-year-old grandmother and my very own pa, William Krohn.
• Kirill and I looked back on a decade of the podcast and fielded listener questions on topics such as A.I.’s biggest opportunities, the build-versus-buy dilemma, how to break into the field today, and how to stay grounded amid the relentless pace of A.I.

Thank you for support and listenership over all these years — we make this show for you and couldn't do it without you! We're excited to see what the next decade brings :)

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

How This Text-to-Video-Game AI Startup Hit 20M Users

Added on by Jon Krohn.

Imagine being able to vibe-code full-blown video games... for free! My returning guest, Dr. Andrey Kurenkov, helped engineer Astrocade to do just that... and already 20 million people have played games through their platform.

More on Andrey:
• Founding A.I. Lead at Astrocade, a Bay Area-based startup that has raised $68m in venture capital to create the TikTok of video games, where creators create games for free and you play them for free.
• Co-host (alongside Jeremie Harris) of my favorite podcast, "Last Week in A.I.".
• Holds a PhD from Stanford University, where his research focused on machine vision and robotics.

In this episode, we discuss:
• The fascinating Astrocade journey, of course.
• The surprising pace of humanoid robotics.
• Why he's a skeptic on Artificial Super Intelligence.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

How to Build AI-First Organizations, with Jacob Miller and Jeremy Mumford

Added on by Jon Krohn.

After today's fun episode with Jacob and Jeremy — authors of the brand-new book "Architected Intelligence" — you’ll have all the key info to build successful AI features, AI products and AI-first companies. Enjoy!

Jeremy Mumford and Jacob Miller serve as Lead AI Engineer and Vice President of Platform Intelligence, respectively, at Pattern, a giant Utah-based tech company that IPO’ed on the Nasdaq exchange about six months ago.

Jacob and Jeremy's brand-new "Architected Intelligence" book was published by Wiley and this episode focuses almost exclusively on this invaluable book.

Episode highlights include:
• The "User Agnosticism Tenet", which means designing products and processes so they can be executed equally well by a human, an AI agent, or any hybrid combo.
• The shift in the "define-build-feedback" loop today where "building" is no longer the bottleneck, which means "definition" and "feedback" are where teams win or lose.
• Why workflows are deterministic, predictable, and cheaper than agents, and why the natural progression is skills first, then workflows, and only then agents.
• Why data engineering is the bedrock of AI engineering.
• Why velocity is the only durable moat in a world where everyone has access to the same frontier models.

Thanks to podcast superfan Jonathan Bown for recommending Jeremy and Jacob as guests!

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.