In Case You Missed It in April 2025

We had a record number of guests on my podcast in April — and they were spectacular! In today's "In Case You Missed It" episode, hear the best parts of my conversations with each of them.

The specific conversation highlights included in today's episode are:

1. Sama Bali from NVIDIA and Logan Lawler from Dell Technologies fill us in on the AI software stack on NVIDIA GPUs, including libraries like CUDA.

2. Continuing on the A.I. hardware topic, Emily Webber details Amazon Web Services (AWS)'s own A.I. accelerator chips.

3. Zerve AI's co-founder Dr. Greg Michaelson describes how data scientists can deploy A.I. models to production without needing to call on an engineering team.

4. Kai Beckmann, CEO of Merck KGaA's semiconductor business, describes intricate details of the semiconductors that make A.I. systems hum.

5. Finally, Shirish Gupta explains his "A-I-P-C" framework for finding out if you should be using edge compute for local A.I. inference instead of relying on cloud compute.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

How to Grow (and Sell) a Data Science Consultancy, with Cal Al-Dhubaib

Today, my ebullient long-time friend Cal Al-Dhubaib makes his debut on my podcast to spill the beans on how you can launch your own thriving (data science / A.I. / ML) consultancy and, eventually, sell it 💰

Cal:

• Is Head of AI & Data Science at Further, a data and A.I. company based in Atlanta that has hundreds of employees.

• Previously, he was founder and CEO of Pandata, an Ohio-based A.I. and machine learning consultancy that he grew for over eight years until it was acquired by Further a year ago.

• Delivers terrific talks — don’t miss him if you have the chance!

• Holds a degree in data science from Case Western Reserve University in Cleveland.

Today’s episode should appeal to any listener, particularly anyone that would like to drive revenue and profitability from data science or AI projects.

In it, Cal covers:

• Why his first startup was unsuccessful, but how the experience allowed him to discover an untapped market and build Pandata, a thriving data science consultancy.

• His unconventional strategy of requiring clients to make a sizable commitment up front that initially scared away clients but ultimately attracted the best ones.

• The way core values inspired by his "tin can to Mars" thought experiment shaped his hiring and company culture.

• How making data science "boring", helping his clients trust AI systems and delivering a clear return on investment became his formula for success.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

In Case You Missed It in July 2024

In July, we had a yet another bevy of extraordinary guests on the SuperDataScience Podcast I host. ICYMI, this episode highlights the most fascinating moments from my convos with them.

Specifically, conversation highlights include:

1. Iconic Daliana Liu (ex-AWS Senior Data Scientist; host of The Data Scientist Show) on the hard skills data scientists need most in today's market.

2. Pulitzer prize-winning journalist and many-time NY Times bestselling author Charles Duhigg on the secrets to being a "Supercommunicator", i.e., getting people invested in your ideas and opening up.

3. Arcee.ai's CEO Mark McQuade and Chief of Frontier Research Charles Goddard detail the frontier "model merging" technique whereby the capabilities of multiple LLMs can be combined without increasing model size.

4. Prolific Google DeepMind researcher Dr. Rosanne Liu (no relation to Daliana!) on her landmark “Beyond the Imitation Game" paper, particularly why all LLM benchmarks are flawed.

5. Andrey Kurenkov, PhD (A.I. Engineering Lead at Astrocade and founder/co-host of my favorite podcast, "Last Week in A.I.") on how Artificial Superintelligence (ASI) may be just a few years and what the implications could be for us as individuals as well as as a society.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

How to Thrive in Your (Data Science) Career, with Daliana Liu

In today's episode, renowned Daliana Liu details how to overcome common (unhelpful!) career mindsets and thrive professionally, including finding your niche and getting promoted... all without burning out!

If you haven’t already heard of her, Daliana:

• Is well-known for her content creation on data science careers, particularly career-growth strategies, leading her to have >280,000 LinkedIn followers.
• Her The Data Scientist Show is in the top 2% of all podcasts globally in terms of downloads.
• Specializes in 1:1 career coaching as well as coaching groups through structured programs like her upcoming "Survive and Thrive in Data Science and AI Careers" course.
• Previously worked as a Senior Data Scientist at AWS and Predibase (a Bay Area open-source LLMs startup).
• Holds a Master's in Statistics from UC Irvine.

Today’s episode is well-suited to *anyone* who’d like to thrive more than ever professionally; it will particularly appeal to data scientists and related professionals like data analysts, ML engineers and software developers… but most of the advice Daliana covers is beneficial to anyone.

In today’s episode, Daliana details:

• Common unhelpful career mindsets and how to overcome them.
• How to find the role you really want as opposed to the one you think you want.
• How to find your niche in a fast-moving field.
• How to offset common professional issues like imposter syndrome, distraction and burnout.
• Her top tips for accelerating a technical career.
• The must-know tech skills for data scientists in today’s market.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Exciting (and Frightening!) Trends in Open-Source AI

Friday's short episode of my podcast features four data-science luminaries (Emily Zabor, James David Long, Drew Conway and Jared Lander) explicating on the most exciting open-source A.I. trends they see.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Q*: OpenAI’s Rumored AGI Breakthrough

Today’s episode is all about a rumored new model out of OpenAI called Q* (pronounced “Q star”) that has been causing quite a stir, both for its purported role in Altmangate and its implications for Artificial General Intelligence (AGI).

Key context:
• Q* is reported to have advanced capabilities in solving complex math problems expressed in natural language, indicating a significant leap in A.I.
• The rumors about Q* emerged during OpenAI's corporate drama involving the firing and re-hiring of CEO Sam Altman.
• Reports suggested a connection between Q*'s development and the OpenAI upheaval, with staff expressing concerns about its potential dangers to humanity (no definitive evidence links Q* to the OpenAI CEO controversy, however, leaving its role in the incident ambiguous).

Research overview:
• OpenAI's recent published research on solving grade-school word-based math problems (e.g., “The cafeteria had 23 apples. They used 20 for lunch and bought 6 more. How many apples do they have?”) hints at broader implications of step-by-step reasoning in A.I.
• While today's Large Language Models (LLMs) show better results on logical problems when we use chain-of-thought prompting ("work through the problem step by step"), the contemporary LLMs do so linearly (they don't go back to correct themselves or explore alternative intermediate steps), which limits their capability.
• To develop a model that can be trained and evaluated at each intermediate step, OpenAI gathered tons of human feedback on math-word problems, amassing a dataset of 800,000 individual intermediate steps across 75,000 problems.
• Their approach involves an LLM generating solutions at each step and a second model acting as a verifier.

The Q* connection:
• The above research merges LLM reasoning abilities with search-tree methods, inspired by Google DeepMind's AlphaGo algorithm and its ilk.
• The decades-old Q* concept is used for training models to simulate and evaluate prospective moves, a concept from reinforcement learning.
• Q*'s potential for automated self-play could lead to significant advancements in AGI, particularly by reducing reliance on (expensive) human-generated training data.

Implications:
• Q* could yield significant societal benefits (e.g., by solving mathematical proofs humans can't or discovering new physics), albeit with potentially high inference costs.
• Q* raises concerns about security and the unresolved challenges in achieving AGI.
• While Q* isn't the final leap towards AGI, it would represent a major milestone in general reasoning abilities.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Scikit-learn’s Past, Present and Future, with scikit-learn co-founder Dr. Gaël Varoquaux

For today's massive episode, I traveled to Paris to interview Dr. Gael Varoquaux, co-founder of scikit-learn, the standard library for machine learning worldwide (downloaded over 1.4 million times PER DAY 🤯). In it, Gaël fills us in on sklearn's history and future.

More on Gaël:

• Actively leads the development of the ubiquitous scikit-learn Python library today, which has several thousand people contributing open-source code to it.

• Is Research Director at the famed Inria (the French National Institute for Research in Digital Science and Technology), where he leads the Soda ("social data") team that is focused on making a major positive social impact with data science.

• Has been recognized with the Innovation Prize from the French Academy of Sciences and many other awards for his invaluable work.

Today’s episode will likely be of primary interest to hands-on practitioners like data scientists and ML engineers, but anyone who’d like to understand the cutting edge of open-source machine learning should listen in.

In this episode, Gaël details:

• The genesis, present capabilities and fast-moving future direction of scikit-learn.

• How to best apply scikit-learn to your particular ML problem.

• How ever-larger datasets and GPU-based accelerations impact the scikit-learn project.

• How (whether you write code or not!) you can get started on contributing to a mega-impactful open-source project like scikit-learn yourself.

• Hugely successful social-impact data projects his Soda lab has had recently.

• Why statistical rigor is more important than ever and how software tools could nudge us in the direction of making more statistically sound decisions.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Decoding Speech from Raw Brain Activity, with Dr. David Moses

Dr. David Moses and his colleagues have pulled off a miracle with A.I.: allowing paralyzed patients to "speak" through a video avatar in real time — using brain waves alone. In today's episode, David details how ML makes this possible.

David:
• Is an adjunct professor at the University of California, San Francisco.
• Is the project lead on the BRAVO (Brain-Computer Interface Restoration of Arm and Voice) clinical trial.
• The success of this extraordinary BRAVO project led to an article in the prestigious journal Nature and YouTube video that already has over 3 million views.

Today’s episode does touch on specific machine learning (ML) terminology at points, but otherwise should be fascinating to anyone who’d like to hear how A.I. is facilitating real-life miracles.

In this episode, David details: 
• The genesis of the BRAVO project.
• The data and the ML models they’re using on the BRAVO project in order to predict text, speech sounds and facial expressions from the brain activity of paralyzed patients.
• What’s next for this exceptional project including how long it might be before these brain-to-speech capabilities are available to anyone who needs them.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Mathematical Optimization, with Jerry Yurchisin

Mathematical Optimization complements Machine Learning and Statistics in the data scientist's tool belt, but before today's episode with Mathematical Optimization guru Jerome Yurchisin, I knew almost nothing about the powerful technique.

Jerry: 
• Works as a Data Science Strategist at Gurobi Optimization, a leading decision-intelligence company that provides mathematical optimization solutions to the likes of Uber, Air France and the National Football League. 
• Spent eight years as a mathematical consultant at Booz Allen Hamilton where he paired mathematical optimization with ML, statistics and simulation to inform decision-making.
• Was also previously an instructor at the University of North Carolina at Chapel Hill, where he obtained his Master’s in Operations Research and Statistics.
• Also holds an additional Master’s in Applied Math from Ohio University.

Today’s episode will appeal most to hands-on data science practitioners such as data scientists and ML engineers.

In this episode, Jerry details: 
• What mathematical optimization is and how it works. 
• Specific real-world examples where mathematical optimization is a better choice than a statistical or machine learning approach. 
• His recommended resources for getting started with mathematical optimization in Python (or whatever your preferred programming language is) today.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Make Better Decisions with Data, with Dr. Allen Downey

Today's episode with many-time bestselling author Allen Downey is incredible. Learn a ton from him about making better decisions with data, including how to prepare for Black Swan events and how your core beliefs will shift over your life.

Allen:
• Is a Professor Emeritus at Olin College and Curriculum Designer at the learning platform Brilliant.org.
• He was previously a Visiting Professor of Computer Science at Harvard University and a Visiting Scientist at Google.
• He has written 18 books (which he has made available for free online but which are also published in hard copy by major publishers. For example, his books "Think Python" and "Think Bayes" were bestsellers published by O'Reilly).
• His next book, "Probably Overthinking It", is available for pre-order now.
• Holds a PhD in Computer Science from University of California, Berkeley and Bachelor's and Masters degrees from the Massachusetts Institute of Technology.

Today’s episode focuses largely on content from Allen’s upcoming book — his first book intended for a lay audience — and so should appeal to anyone who’s keen to learn from an absolutely brilliant writer and speaker on “How to Use Data to Answer Questions, Avoid Statistical Traps, and Make Better Decisions.”

In this episode, Allen details: 
• Underused techniques like Survival Analysis that can be uniquely powerful in lots of ordinary circumstances.
• How to better prepare for rare “Black Swan” events.
• How to wrap your head around common data paradoxes such as Preston’s Paradox, Berkson’s Paradox and Simpson’s Paradox.
• What the Overton Window is and how our core beliefs shift relative to it over the course of our lifetime (this is extra trippy).

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Large Language Model Leaderboards and Benchmarks

Llamas, Alpacas, Koalas, Falcons... there is a veritable zoo of LLMs out there! In today's episode, Caterina Constantinescu breaks down the LLM Leaderboards and evaluation benchmarks to help you pick the right LLM for your use case.

Caterina:
• Is a Principal Data Consultant at GlobalLogic, a full-lifecycle software development services provider with over 25,000 employees worldwide.
• Previously, she worked as a data scientist for financial services and marketing firms.
• Is a key player in data science conferences and Meetups in Scotland.
• Holds a PhD from The University of Edinburgh.

In this episode, Caterina details:
• The best leaderboards (e.g., HELM, Chatbot Arena and the Hugging Face Open LLM Leaderboard) for comparing the quality of both open-source and proprietary Large Language Models (LLMs).
• The advantages and issues associated with LLM evaluation benchmarks (e.g., evaluation dataset contamination is an big issue because the top-performing LLMs are often trained on all the publicly available data they can find... including benchmark-evaluation datasets).

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Six Reasons Why Building LLM Products Is Tricky

Many of my recent podcast episodes have focused on the bewildering potential of fine-tuning open-source Large Language Models (LLMs) to your specific needs. There are, however, six big challenges when bringing LLMs to your users:

1. Strictly limited context windows
2. LLMs are slow and compute-intensive at inference time
3. "Engineering" reliable prompts can be tricky
4. Prompt-injection attacks make you vulnerable to data and IP theft
5. LLMs aren't (usually) products on their own
6. There are legal and compliance issues

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Generative Deep Learning, with David Foster

Today, bestselling author David Foster provides a fascinating technical introduction to cutting-edge Generative A.I. concepts including variational autoencoders, diffusion models, contrastive learning, GANs and (my favorite!) "world models".

David:
• Wrote the O'Reilly book “Generative Deep Learning”; the first edition from 2019 was a bestseller while the second edition was released just last week.
• Is a Founding Partner of Applied Data Science Partners, a London-based consultancy specialized in end-to-end data science solutions.
• Holds a Master’s in Mathematics from the University of Cambridge and a Master’s in Management Science and Operational Research from the University of Warwick.

Today’s episode is deep in the weeds on generative deep learning pretty much from beginning to end and so will appeal most to technical practitioners like data scientists and ML engineers.

In the episode, David details: 
• How generative modeling is different from the discriminatory modeling that dominated machine learning until just the past few months.
• The range of application areas of generative A.I.
• How autoencoders work and why variational autoencoders are particularly effective for generating content.
• What diffusion models are and how latent diffusion in particular results in photorealistic images and video.
• What contrastive learning is.
• Why “world models” might be the most transformative concept in A.I. today.
• What transformers are, how variants of them power different classes of generative models such as BERT architectures and GPT architectures, and how blending generative adversarial networks with transformers supercharges multi-modal models.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Get More Language Context out of your LLM

The "context window" limits the number of words that can be input to (or output by) a given Large Language Model. Today's episode introduces FlashAttention, a trick that allows for much larger context windows.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Contextual A.I. for Adapting to Adversaries, with Dr. Matar Haller

Today, the wildly intelligent Dr. Matar Haller introduces Contextual A.I. (which considers adjacent, often multimodal information when making inferences) as well as how to use ML to build moat around your company.

Matar:
• Is VP of Data and A.I. at ActiveFence, an Israeli firm that has raised over $100m in venture capital to protect online platforms and their users from malicious behavior and malicious content.
• Is renowned for her top-rated presentations at leading conferences.
• Previously worked as Director of Algorithmic A.I. at SparkBeyond, an analytics platform.
• Holds a PhD in neuroscience from the University of California, Berkeley.
• Prior to data science, taught soldiers how to operate tanks.

Today’s episode has some technical moments that will resonate particularly well with hands-on data science practitioners but for the most part the episode will be interesting to anyone who wants to hear from a brilliant person on cutting-edge A.I. applications.

In this episode, Matar details:
• The “database of evil” that ActiveFence has amassed for identifying malicious content.
• Contextual A.I. that considers adjacent (and potentially multimodal) information when classifying data.
• How to continuously adapt A.I. systems to real-world adversarial actors.
• The machine learning model-deployment stack she uses.
• The data she collected directly from human brains and how this research relates to the brain-computer interfaces of the future.
• Why being a preschool teacher is a more intense job than the military.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Business Intelligence Tools, with Mico Yuk

Today's guest is the straight shooter Mico Yuk, who pulls absolutely no punches in her assessment of, well, anything! ...but particularly about vendors in the business intelligence and data analytics space. Enjoy!

Mico:
• Is host of the popular Analytics on Fire Podcast (top 2% worldwide).
• Co-founded the BI Brainz Group, an analytics consulting and solutions company that has taught over 15,000 students analytics, visualization and data storytelling courses — included at major multinationals like Nestlé, FedEx and Procter & Gamble.
• Authored the "Data Visualization for Dummies" book.
• Is a sought-after keynote speaker and TV-news commentator.

In this episode, Mico details:
• Her BI (business intelligence) and analytics framework that persuades executives with data storytelling.
• What the top BI tools are on the market today.
• The BI trends she’s observed that could predict the most popular BI tools of the coming years.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Liquid Neural Networks

Liquid Neural Networks are a new, biology-inspired deep learning approach that could be transformative. I think they're super cool and Adrian Kosowski, PhD introduced them to me for today's Five-Minute Friday episode.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Software for Efficient Data Science

In today's episode, Dr. Jodie Burchell details a broad range of tools for working efficiently with data, including data cleaning, reproducibility, visualization, and natural language processing.

Jodie:
• Is the Data Science Developer Advocate for JetBrains, the developer-tools company behind PyCharm (one of the most widely-used Python IDEs) and DataLore (their new cloud platform for collaborative data science).
• Previously was Data Scientist or Lead Data Scientist at several tech companies, developing specializations in search, recommender systems, and NLP.
• Co-authored two books on data visualization libraries: "The Hitchhiker's Guide to ggplot2" and "The Hitchhiker's Guide to Plotnine".
• Prior to entering industry, was a postdoctoral fellow in biostatistics at the University of Melbourne.
• Holds a PhD in Psychology from the Australian National University.

Today’s episode is primarily intended for a technical audience as it's packed with practical tips and software for data scientists.

In this episode, Jodie details:
• What a data science developer advocate is and why you might want to consider it as a career option.
• How to work effectively, efficiently, and confidently with real-world data.
• Her favorite Python libraries, such as ones for data viz and NLP.
• How to have reproducible data science workflows.
• The subject she would have majored in if she could go back in time.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Blockchains and Cryptocurrencies: Analytics and Data Applications

Today's episode introduces what Blockchains are, what Crypto is, and Data Science applications of these technologies. Philip Gradwell of globally-renowned Chainalysis Inc. is our brilliant guide.

Philip:
• Is Chief Economist at Chainalysis, the world’s leading crypto analytics firm — their analysis is regularly featured by major news outlets.
• Previously worked as Principal at Vivid Economics, where he helped grow the consulting firm to 40 people, eventually culminating in its acquisition by consulting giant McKinsey & Company.
• Holds a Master’s in Economics from UCL and a PPE degree — that’s Philosophy, Politics, and Economics — from the University of Oxford.

Today’s episode will appeal to anyone looking for an introduction to the blockchain and cryptocurrencies. It’ll hold special appeal for people keen to do data science with these technologies.

In this episode, Philip details:
• Similarities and differences between analyzing cryptocurrencies and the established fiat currencies.
• His crypto data analytics pipeline.
• How he develops data products for a wide range of users, including businesses, banks, governments, and law enforcement.
• How the blockchain facilitates innovative computing and machine learning technologies.
• What he looks for in the data scientists he hires.

The SuperDataScience show's available on all major podcasting platforms, YouTube, and at SuperDataScience.com.