Learning rate schedulers
Learning rate schedulers
What’s a learning rate? Why might you want to schedule it? How does the LR scheduler API in PyTorch work? What the heck ... Read more
13 Jun 2022
•
19mins
Weak references
Weak references
What are they good for? (Caches. Private fields.) C++ side support, how it’s implemented / release resources. Python sid... Read more
6 Jun 2022
•
16mins
Similar Podcasts
Lex Fridman Podcast
Freakonomics Radio
All-In with Chamath, Jason, Sacks & Friedberg
Conversations with Tyler
a16z Podcast
What's Your Problem?
Talk Python To Me
Gradient Dissent: Exploring Machine Learning, AI, Deep Learning, Computer Vision
Indie Hackers
EconTalk
My First Million
Machine Learning Street Talk (MLST)
The Supermassive Podcast
Clearer Thinking with Spencer Greenberg
Strides
Strides
Mike Ruberry has an RFC about stride-agnostic operator semantics (https://github.com/pytorch/pytorch/issues/78050), so l... Read more
30 May 2022
•
20mins
AOTAutograd
AOTAutograd
AOTAutograd is a cool new feature in functorch for capturing both forward and backward traces of PyTorch operators, lett... Read more
9 May 2022
•
19mins
Most Popular Podcasts
The Joe Rogan Experience
TED Talks Daily
The Tim Ferriss Show
The Daily
Stuff You Should Know
Oprah's SuperSoul Conversations
Armchair Expert with Dax Shepard
Dispatcher questions with Sherlock
Dispatcher questions with Sherlock
Sherlock recently joined the PyTorch team, having previously worked on ONNX Runtime at Microsoft, and Sherlock’s going t... Read more
2 May 2022
•
18mins
New CI
New CI
PyTorch recently moved all of its CI from CircleCI to GitHub Actions. There were a lot of improvements in the process, m... Read more
25 Apr 2022
•
16mins
Python exceptions
Python exceptions
C++ has exceptions, Python has exceptions. But they’re not the same thing! How do exceptions work in CPython, how do we ... Read more
17 Apr 2022
•
14mins
Torch vs ATen APIs
Torch vs ATen APIs
PyTorch’s torch API is the Python API everyone knows and loves, but there’s also another API, the ATen API, which most o... Read more
11 Apr 2022
•
15mins
All about NVIDIA GPUs
All about NVIDIA GPUs
PyTorch is in the business of shipping numerical software that can run fast on your CUDA-enabled NVIDIA GPU, but it turn... Read more
24 Sep 2021
•
19mins
Tensor subclasses and Liskov substitution principle
Tensor subclasses and Liskov substitution principle
A lot of recent work going in PyTorch is all about adding new and interesting Tensor subclasses, and this all leads up t... Read more
16 Sep 2021
•
19mins
