GPT 3

Generative Sequence Modeling – from Markov Chains to GPT-3



Zain Shah

In this presentation Zain Shah, former researcher at OpenAI, YC startup founder, and data scientist at the real estate unicorn Opendoor, covers the history and fundamentals of generative sequence modeling, all the way from basic Markovian sequence modeling to the latest and greatest language model, GPT-3.
You will learn:
* How does GPT-3 work?
* How does it differ from what came before?
* Which limits have we broken? And which haven’t we (yet)?