▶

Attention Is All You Need: Transformer paper walkthrough

Yannic Kilcher · Explainer · 27 min · 2017 · YouTube title: Attention Is All You Need
Why it's here

HN recommends it as an accessible, clear walkthrough of the transformer paper for people with some AI background.

What it covers

Yannic Kilcher walks through the Attention Is All You Need paper, which introduced the Transformer, a sequence model based solely on attention without recurrence or convolutions. He reviews the architecture and the paper's translation results.