Why Transformers Replaced LSTMs in NLP
Seattle Applied Deep Learning · Lecture · YouTube title: LSTM is dead. Long Live Transformers!
Why it's here
Recommended as a clear explanation of why RNNs fall short and how transformers solve it.
What it covers
Leo Dirac explains how transformer models have replaced LSTMs in NLP. He gives background from bag of words through RNNs and LSTMs, then a technical deep dive into multi-headed self-attention and positional encoding, with sample code.