GPT 3

Supersize Me! Natural Language Processing Models in 2020 and beyond



Women Who Code DC

Why all the hype about OpenAI’s GPT-3? The field of Natural Language Processing (NLP) has ended up with bigger and bigger models, yet innovation seems to have stagnated.

Learn more:
Can We Kill ‘Artificial Intelligence,’ Yet? – https://medium.com/better-programming/kill-artificial-intelligence-7bc02f85ea70
GPT-3: Is AI Deepfaking Understanding? – https://youtu.be/FMfA6i60WDA

Resources:
The Illustrated Transformer – http://jalammar.github.io/illustrated-transformer/
Pruning Deep Learning Models for Success in Production – https://youtu.be/KRlOEGtb3gk
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks – https://arxiv.org/abs/1803.03635
OpenAI API – https://openai.com/blog/openai-api/

Nicole’s YouTube Channel: https://www.youtube.com/channel/UCO6JE24WY82TKabcGI8mA0Q/