GPUs are the workhorse of A.I. inference… but they aren’t actually optimized for inference! SambaNova has raised over $2B to build a new chip that is, pushing the frontier of real-time A.I. speed and bandwidth. Hear about it from Anton in today's episode.
More on Anton McGonnell:
• VP of Product at SambaNova, a Bay Area A.I.-hardware business recently valued at $11 billion.
• Was previously Director of Product Management for Machine Learning at UiPath and responsible for A.I. research at Glasswing Ventures.
• Holds an MBA from Harvard Business School and a degree in computer science from Queen's University Belfast.
In today's episode, Anton explains:
• Why agentic A.I. has changed the shape of inference workloads.
• How SambaNova's chip sidesteps the memory bottleneck that slows GPUs when generating output tokens.
The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.
