Polars: Past, Present and Future, with Polars Creator Ritchie Vink

Because of it's stunningly fast speed, Polars is an extremely popular open-source library for DataFrame operations in Python. Kinda unreal to have Ritchie Vink, Polars' creator, as today's guest!

Ritchie:

• Is CEO and Co-Founder of Polars, Inc., a startup that has raised $4m in seed funding to support his Polars open-source project.

• Previously worked as an ML Engineer, Data Scientist and Data Engineer at companies like adidas and KLM Royal Dutch Airlines.

• Holds a Master’s in Structural Engineering and worked as a civil engineer prior to catching the data-science bug.

Today’s episode will appeal most to hands-on practitioners like data scientists and ML engineers. In it, Ritchie details:

• How Polars regularly achieves 5-20x (sometimes 100x!) speed improvements over Pandas for most DataFrame operations.

• The Eager and Lazy execution APIs Polars offers and when you should use one or the other.

• Ritchie's vision for scaling Polars to handle massive distributed datasets.

• How we can continue to make data-processing efficiency gains even as Moore's Law slows down.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Merged LLMs Are Smaller And More Capable, with Arcee AI’s Mark McQuade and Charles Goddard

Today's episode is seriously mind-expanding. In it, Mark and Charles detail how they're pushing the A.I. frontier through LLM merging, extremely efficient (even CPU-only!) LLM training, and *Small* Language Models.

Mark McQuade:

• Is Co-Founder and CEO of Arcee.ai.

• Previously, he held client-facing roles at Hugging Face and Roboflow as well as leading the data science and engineering practice of a Rackspace company.

• He studied electronic engineering at Fleming College in Canada.

Charles Goddard:

• Is Chief of Frontier Research at Arcee.ai

• Previously, he was a software engineer at Apple and the famed NASA Jet Propulsion Laboratory.

• Studied engineering at Olin College in Massachusetts.

Today’s episode is relatively technical so will likely appeal most to hands-on practitioners like data scientists and ML engineers. In it, Charles and Mark detail:

• How their impressive open-source model-merging approach combines the capabilities of multiple LLMs without increasing the model’s size.

• A separate open-source approach for training LLMs efficiently by targeting specific modules of the network to train while freezing others.

• The pros and cons of Mixture-of-Experts versus Mixture-of-Agents approaches.

• How to enable small language models to outcompete the big foundation LLMs like GPT-4, Gemini and Claude.

• How to leverage open-source projects to land big enterprise contracts and attract big chunks of venture capital.

On that final note, congrats to the Arcee.ai team on announcing their $24m Series A round this very day... unsurprising given their tremendously innovative tech and rapid revenue ramp-up! It's very rare to see runaway A.I. startup successes like this one.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Open-Source Libraries for Data Science at the New York R Conference

For today's short episode, I asked four data-science luminaries about their favorite open-source libraries. Hear what Emily Zabor, James David Long, Drew Conway and Jared Lander chose, live on stage!

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

NumPy, SciPy and the Economics of Open-Source, with Dr. Travis Oliphant

Huge episode today with iconic Dr. Travis Oliphant, creator of NumPy and SciPy, the standard libraries for numeric operations (downloaded 8 million and 3 million times PER DAY, respectively). Hear about the future of open-source, including the impact of GenAI.

More on Travis:

• Founded Anaconda, Inc., the company behind the also-ubiquitous Python package manager.

• Founded the massive PyData conferences and communities as well as its associated non-profit foundation, NumFOCUS.

• Currently serves as the CEO of two firms: OpenTeams and Quansight.

• Holds a PhD in biomedical engineering from the Mayo Clinic in Minnesota.

Today’s episode will primarily be of interest to hands-on practitioners like data scientists, software developers and machine learning engineers.

In it, Travis details:

• How his journey creating open-source software began and how NumPy and SciPy grew to become the most popular foundational Python libraries for working with data.

• How he identifies commercial opportunities to support his vast open-source efforts and communities.

• How AI, particularly generative AI, is transforming open-source development.

• Where open-source innovation is headed in the years to come.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Llama 2, Toolformer and BLOOM: Open-Source LLMs with Meta’s Dr. Thomas Scialom

Thomas Scialom, PhD is behind many of the most popular Generative A.I. projects including Llama 2, the world's top open-source LLM. Today, the Meta A.I. researcher reveals the stories behind Llama 2 and what's in the works for Llama 3.

Thomas:
• Is an A.I. Research Scientist at Meta.
• Is behind some of the world’s best-known Generative A.I. projects including Llama 2, BLOOM, Toolformer and Galactica.
• Is contributing to the development of Artificial General Intelligence (AGI).
• Has lectured at many of the top A.I. labs (e.g., Google, Stanford, MILA).
• Holds a PhD from Sorbonne University, where he specialized in Natural-Language Generation with Reinforcement Learning.

Today’s episode should be equally appealing to hands-on machine learning practitioners as well as folks who may not be hands on but are nevertheless keen to understand the state-of-the-art in A.I. from someone who’s right on the cutting edge of it all.

In this episode, Thomas details: 
• Llama 2, today’s top open-source LLM, including what is what like behind the scenes developing it and what we can expect from the eventual Llama 3 and related open-source projects.
• The Toolformer LLM that learns how to use external tools.
• The Galactica science-specific LLM, why it was brought down after a few days, and how it might eventually re-emerge in a new form.
• How RLHF — reinforcement learning from human feedback — shifts the distribution of generative A.I. outputs from approximating the average of human responses to excellent, often superhuman quality.
• How soon he thinks AGI — artificial general intelligence — will be realized and how.
• How to make the most of the Generative A.I. boom as an entrepreneur.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

Tools for Deploying Data Models into Production

Today's guest is mighty Erik Bernhardsson — creator of Spotify's music recommender, prolific open-source developer, world-leading technical blogger, and now model-deployment-tool entrepreneur via Modal Labs.

Erik:
• Is the Founder and CEO of Modal Labs, a startup building innovative tools and infrastructure for data teams.
• Previously was CTO of the real estate startup Better, where he grew the engineering team from the size of 1 — himself — to 300 people.
• Was also previously an Engineering Manager at Spotify, where he created their now-ubiquitous music-recommendation algorithm.
• Is a prolific open-sourcer, having created the popular Luigi and Annoy libraries, among several others.
• Is an industry-leading blogger with posts that frequently feature on the front page of Hacker News.

Today’s episode gets deep into the weeds at points, so it will be particularly appealing to practicing data scientists, ML engineers, and the like, but much of the fascinating, wide-ranging conversation in this episode will appeal to any curious listener.

In this episode, Erik details:
• How the Spotify music recommender he built works so well at scale.
•The litany of new data science and engineering tools he’s excited about and thinks you should be excited about too.
•What open-source library he would develop next.
•Why he founded his Modal and how their tools empower data teams.
• Having interviewed more than 2000 candidates for engineering roles, his top tips both for succeeding as an interviewer and as an interviewee.

The SuperDataScience show's available on all major podcasting platforms, YouTube, and at SuperDataScience.com.

SuperDataScience Podcast LIVE at MLconf NYC and ScaleUp:AI!

It's finally happening: the first-ever SuperDataScience episodes filmed with a live audience! On March 31 and April 7 in New York, you'll be able to react to guests and ask them questions in real-time. I'm excited 🕺

The first live, in-person episode will be filmed at MLconf NYC on March 31st. The guest will be Alexander Holden Miller, an engineering manager at Facebook A.I. Research who leads bleeding-edge work at mind-blowing intersections of deep reinforcement learning, natural language processing, and creative A.I.

A week later on April 7th, another live, in-person episode will be filmed at ScaleUp:AI. I'll be hosting a panel on open-source machine learning that features Hugging Face CEO Clem Delangue.

I hope to see you at one of these conferences, the first I'll be attending in over two years! Can't wait. There are more live SuperDataScience episodes planned for New York this year and hopefully it won't be long before we're recording episodes live around the world.

ScaleUp: AI Conference

At ScaleUp:AI in New York next month, I'll be moderating a panel on Open-Source Software that features Hugging Face CEO Clem Delangue. Other speakers include Andrew Ng, Allie K. Miller, and William Falcon.

Thanks to the folks at Insight Partners for putting together this high-octane, two-day event, in which you'll hear from the foremost thought leaders and investors on how to unlock your firm's A.I. growth potential.

So excited to be conferencing in-person again and I hope to be able to meet you there! There is a virtual option as well if you can't make it to New York. Whether in-person or virtual, you can use my code "JKAI35" to get 35% off 😀

Conference details/registration here.

Full speaker list here.