How Language Models and Transformers Generate Text

Pointed to as an accessible early explanation of transformers and attention for newcomers.

Rob Miles explains on Computerphile how language models generate plausible text and how transformers improved on recurrent networks, with a look at what comes next.