Filming "Calculus for Machine Learning"

Same shirt, different day with my "weekend crew". We burnt the midnight oil Friday through Sunday last weekend filming what will be eight hours of interactive videos on Calculus for Machine Learning.

In the above photo, pictured from left to right at New York's Production Central Studios: myself, technician Guillaume Rousseau, and producer Erina Sanders.

All of the code (featuring the Python libraries NumPy, TensorFlow, and PyTorch) is available open-source in GitHub today.

The videos themselves will appear in the O'Reilly learning platform later this year, with thanks to Pearson's Debra Williams Cauley for bringing another project concept of mine to life.

Deep Q-Learning Networks tutorial on YouTube

Here's a free 72-minute intro to Deep Reinforcement Learning with Deep Q-Learning Networks. It's my most popular video, with 44k views. I'd never have predicted it to do so well, which goes to show how important it is to produce on a schedule.

Don't wait for inspiration; it's unlikely to ever come. Simply commit to regular deadlines and produce, produce, produce because some content you release that you think is rushed, that won't be interesting to your audience, will end up surprising you by being right on the money.

As an added benefit, studies show that focusing on quantity over quality paradoxically tends to result in significantly higher quality products.

Anyway, enjoy the video, which I've never shared on my website before. It uses hands-on code demos in Python to bring the mathematical theory of Deep Q-Learning to life (Jupyter notebook is here).

Free Launch of Udemy Course

My first Udemy course, Machine Learning and Data Science Foundations Masterclass, went live on Monday and is free (for now)! An astounding 20,000 students signed up in the first 24 hours and they've given it a five-star average rating.

The course is currently two hours long because Udemy has a two-hour cap on free courses. In about a month, we'll add four more hours of content, which will put us well over the two-hour cap. From that point on, the course will be paid in Udemy, but anyone who enrolled while the course was free will automatically get unlimited access to all of the paid-tier content.

Eventually the course will grow to be ~30 hours long and provide a comprehensive overview of all the subjects -- linear algebra, calculus, probability, and computer science -- that underlie modern machine learning. Again, by signing up now, all of that content will be available to you for free when it comes out; no strings attached!

Many thanks to the super-duper SuperDataScience Team (especially Kirill Eremenko, Leonid Golub and Roberto Lambertini) for partnering with me on this course. And thanks as ever to Sangbin Lee, who flawlessly produced and edited all of the video content.

Filming "Linear Algebra for Machine Learning" Videos

Back in studio this past weekend with magical producer Erina Sanders, creating seven hours of interactive Linear Algebra for Machine Learning videos.

All of the code (featuring the Python libraries NumPy, TensorFlow, and PyTorch) is available open-source in GitHub today.

The videos themselves will appear in the O'Reilly learning platform later this year, with thanks to Pearson's Debra Williams Cauley for bringing another project concept of mine to life.

(December 2020 update: These videos are now live in O'Reilly here.)

"Intro to Linear Algebra": The First Subject of my ML Foundations Series is Live!

Intro to Linear Algebra, the first subject of my Machine Learning Foundations tutorial series, is now available in its entirety! It's three content-rich hours, featuring code demos and exercises, split over a total of 24 YouTube videos.

I released the final Intro to Linear Algebra videos over the past week, all of which are from the Matrix Properties segment of the subject (see the segment intro video below):

• Topic 18: The Frobenius Norm
• Topic 19: Matrix Multiplication
• Topic 20: Symmetric and Identity Matrices
• Topic 21: Matrix Multiplication Exercises
• Topic 22: Matrix Inversion
• Topic 23: Diagonal Matrices
• Topic 24: Orthogonal Matrices

The YouTube playlist for the entire Machine Learning Foundations series is here.

The series is full of hands-on code demos in Python (particularly the NumPy, TensorFlow, and PyTorch libraries) and all of the code is available open-source in GitHub.

Please let me know what you think of the series so far as it will shape my creation of the remaining seven subjects. Up next in the series will be the second subject, Linear Algebra II: Matrix Operations. Stay tuned!

TensorFlow vs PyTorch for Deep Learning

The question I get asked most is, "Should I use TensorFlow or PyTorch for deep learning?" The YouTube video above is my 26-minute response, detailing the pros and cons of both libraries.

The talk begins with a survey of the primary families of deep learning approaches: Convolutional Neural Networks, Recurrent Neural Networks, Generative Adversarial Networks, and Deep Reinforcement Learning. (Thanks to the Belgian artist Aglaé Bassens for the stunning illustrations that feature throughout this section of the slide deck.)

If you're already familiar with deep learning, you can skip ahead to the 12:24 mark. Via interactive demos, the meat of the talk appraises the two leading deep learning libraries: TensorFlow and PyTorch. With respect to both model development and production deployment, the strengths and weaknesses of the two libraries are detailed with code examples from reference Jupyter notebooks. There's a particular focus on the TensorFlow 2 release that integrates the easy-to-use, high-level Keras API as a formal module within the library.

Thanks to Jared Lander and Amada Echeverría for hosting me at the terrifically well-executed virtual version of this year's New York R Conference, where I provided this lecture. (Note that the content I covered is equally relevant to folks working primarily in Python.)

ODSC West Virtual Conference

Open Data Science Conference (ODSC) West, my favorite conference, is virtual this year and coming up soon, October 27-30. Deeply honored to be speaking alongside these industry legends.

All in all, there will be over 200 speakers this year, and I'll be giving a four-hour workshop that introduces deep learning via hands-on demos featuring TensorFlow 2.

Registration is here.

Techniques for Solving Linear Systems of Equations

Two further videos from my Machine Learning Foundations series out today! Both cover techniques for solving systems of linear equations algebraically:

• The first video (and 16th topic in the series overall) introduces substitution for solving linear systems by hand.
• The second video (17th topic in the series) uses elimination, which comes in handy in other situations where we'd like to solve linear systems by hand.

These videos wrap up Segment Two, "Common Tensor Operations". They set us up perfectly for Segment Three, "Matrix Properties", in which we'll cover computational approaches to solving linear systems.

The playlist for the entire series, which will consist of 30+ hours of videos, is here.

Common Tensor Operations: A Fresh Segment of my ML Foundations Series

As detailed on GitHub and covered in the short explanatory video above, the ML Foundations series consists of eight subjects:

1. Intro to Linear Algebra
2. Linear Algebra II
3. Calculus I: Limits & Derivatives
4. Calculus II: Partial Derivatives & Integrals
5. Probability & Information Theory
6. Statistics
7. Algorithms & Data Structures
8. Optimization

Each of the eight subjects consists of two or three segments, which group together closely related topics and make a given subject more structured and readily digestible. The Intro to Linear Algebra subject, for example, consists of three segments:

1. Data Structures for Algebra
2. Common Tensor Operations
3. Matrix Properties

All of the previously released videos in the ML Foundations YouTube playlist featured topics from the first segment, Data Structures for Algebra. Today, we released five new videos, which mark the beginning of Common Tensor Operations, the second segment:

• The first topic in the segment (and Topic 11 in the series overall) is Tensor Transposition.
• Topic 12 is Basic Tensor Arithmetic, including coverage of the Hadamard product.
• Topic 13 is Reduction from higher-dimensional tensors to lower-dimensional ones.
• Topic 14 introduces the Dot Product of two vectors.
• And, finally, video 15 provides exercises to test your comprehension of the content covered in the segment so far.

We aim to release two further videos next week, which will wrap up Segment 2, leaving us well-positioned to tackle Segment 3, Matrix Properties.

Modeling Natural Language Data

Here's a new two-hour video on:

• Preprocessing natural language data,
• Creating word vectors, and
• Designing convolutional neural networks for NLP.

Thanks to Debra Williams Cauley for believing in my vision for this video and to Erina Sanders for her always flawless editing.

These two hours come from a complete five-hour tutorial on Deep Learning for Natural Language Processing. It's available here in the O'Reilly learning platform. Or, if you'd like to purchase it, my publisher is running an extreme 75%-off sale on all my videos through September 10th. Use code LEARNDL after following this link.

Final videos of "Data Structures for Algebra" segment of ML Foundations

The final videos from the first segment of my Machine Learning Foundations series, Data Structures for Algebra, are out today:

• Video 8 in the series is on matrix tensors.
• Topic 9 is Generic Tensor Notation.
• And the tenth video is a quick one that provides three comprehension questions on the content covered thus far.

In the second, forthcoming segment of the ML Foundation series, we'll move from primarily creating static tensors to interacting with them via common tensor operations.

The playlist for the entire series, which will consist of 30+ hours of videos, is here.

These particular videos feature hands-on demos in PyTorch and TensorFlow, and all of the code is in GitHub.

Superb editing from Sangbin Lee, as always. Thank you!

Minimizing Unwanted Biases (e.g., by Gender, Ethnicity) within ML Models

Here's a new blog post I wrote on how my team eliminates unwanted biases (e.g., by gender, ethnicity) from algorithms we've deployed in the recruitment sector.

Devising algorithms that stamp out unwanted biases without skimping on accuracy or performance adds time and effort to the machine learning model-design process. When algorithms can have a considerable social impact, as ours do in the human-resources space at GQR Global Markets, investing this time and effort is essential to ensuring equitable treatment of all people.

Vectors and Norms: Three New "ML Foundations" Videos

Three further videos in my Machine Learning Foundations series out today! Taking it up a dimension, these are on vector tensors and the norm functions we use to measure them:

• Video 5 in the series is "Vectors and Vector Transposition"
• Topic 6 is "Norms and Unit Vectors"
• And topic 7 is a quick one on "Basis, Orthogonal, and Orthonormal Vectors"

The YouTube playlist for the entire series, which will consist of 30+ hours of videos, is here.

The series is full of hands-on demos in NumPy, PyTorch, and TensorFlow, and all of the code is in GitHub here.

As usual, producer/editor Sangbin Lee did some fine work here.

"Hidden in Plain Sight" Podcast

I've been a guest on many wonderful podcasts, but this one on Hidden in Plain Sight easily takes the cake in terms of production value. I highly recommend tuning in for a candid take on the impacts of A.I. today and in the years to come: It’s titled Deep Learning Illustrated with Jon Krohn and can be found here.

Thank you Chad Grills and Lacey Peace for having me on the program. I've been thoroughly impressed by your operation from start to finish! 

Next Three Videos in the ML Foundations Series are Live

I published three new videos in my Machine Learning Foundations series today, including an introduction to tensors, with a focus on handling scalar tensors in PyTorch and TensorFlow (vectors and matrices coming up next).

I hope you enjoy them! The response to the first videos in the series -- released a fortnight ago -- has blown me over. I'm excited to continue to get more of these out on YouTube ASAP.

The playlist for the entire series, which will consist of 30+ hours of videos, is here.

The series is full of hands-on demos in Python and all of the code is in GitHub here.

Thanks to Sangbin Lee for continuing to be an outstanding producer and editor.

The "Machine Learning Foundations" video series is here!

Today I released the first videos of my popular Machine Learning Foundations series onto YouTube. It covers all the math and computer science needed to be an outstanding ML practitioner. 

Since May, I've been launching the content as live 3.5-hour webinars in the O'Reilly online learning platform and the response has been overwhelmingly positive, with classes garnering over 1200 registrations each and net promoter scores above 90%. In all, the series consists of eight of these 3.5-hour classes covering linear algebra, calculus, probability, statistics, algorithms, data structures, and optimization. (More detail on the series in GitHub here.)

As of this morning, thanks to superb editing from the talented Sangbin Lee, we're rolling out all of the content in the series as free YouTube videos.

A short welcome video is featured above, while the first true tutorial, on "What Linear Algebra Is", is featured below.

The playlist for the entire series, which will consist of 30+ hours of videos, is here.

Finally, the series is full of hands-on demos in Jupyter notebooks featuring Python, PyTorch, and TensorFlow code, and all of it is available via the GitHub link above.

More videos to come soon... 

New ODSC AI+ Training Platform

The brilliant folks behind the Open Data Science Conference (ODSC) are launching a new online training platform called AI+ and I'm delivering the inaugural class — Deep Learning with TensorFlow 2 and PyTorch — on July 29th!

New 2-Hour Tutorial on Machine Vision

New two-hour video introducing all the major machine vision concepts and (TensorFlow-based) applications, including:

• Convolutional neural networks (CNNs)

• Residual networks

• Object detection

• Image segmentation

• Transfer learning

• Capsule networks

We worked hard and long through filming, production, and editing to push the standard of what's possible in a software tutorial; I'm confident it's the best video I've ever been a part of.

All of the code demos are in Python and available in GitHub here.

DataScienceGO -- wow!

Thanks to the SuperDataScience team for providing me the opportunity to open up Day 2 of the tightly-run DataScienceGO conference on Sunday! For my talk on deep learning model architectures for natural language processing, there were over 400 advanced practitioners from 93 countries. They were attentive throughout the session and asked fabulously thoughtful questions during an extensive Q&A afterward.