Attention Is All You Need: Transformer paper walkthrough
Yannic Kilcher · Explainer · 27 min · 2017 · YouTube title: Attention Is All You Need
Why it's here
HN recommends it as an accessible, clear walkthrough of the transformer paper for people with some AI background.
What it covers
Yannic Kilcher walks through the Attention Is All You Need paper, which introduced the Transformer, a sequence model based solely on attention without recurrence or convolutions. He reviews the architecture and the paper's translation results.