GPT 3

A Walkthrough of the GPT3 Paper



Cedric Warny

We present and discuss the GPT3 paper “Language Models are Few-Shot Learners” (https://arxiv.org/abs/2005.14165).
I did a poor job acknowledging sources for some of the illustrations used in the Power Point. The most important one is Jay Alamar’s amazing “The Illustrated GPT2” (http://jalammar.github.io/illustrated-gpt2/). Most other illustrations are taken straight from the paper.