▶

Paul Lessard on Categorical Deep Learning

Machine Learning Street Talk · Podcast · 1 h 49 min · 2024 · YouTube title: WE MUST ADD STRUCTURE TO DEEP LEARNING BECAUSE...
Why it's here

Mostly cited in passing, e.g. regarding claims that transformers cannot do recursion and as an example of structured deep learning work.

What it covers

Machine Learning Street Talk interviews Paul Lessard about Categorical Deep Learning, which uses category theory and monads to make neural network architectures more interpretable and composable. They also discuss neural networks' limits in reasoning and unbounded computation.