Paul Lessard on Categorical Deep Learning
Machine Learning Street Talk · Podcast · 1 h 49 min · 2024 · YouTube title: WE MUST ADD STRUCTURE TO DEEP LEARNING BECAUSE...
Why it's here
Mostly cited in passing, e.g. regarding claims that transformers cannot do recursion and as an example of structured deep learning work.
What it covers
Machine Learning Street Talk interviews Paul Lessard about Categorical Deep Learning, which uses category theory and monads to make neural network architectures more interpretable and composable. They also discuss neural networks' limits in reasoning and unbounded computation.