mangate85
GPT-3 is considered by some to be one of the biggest breakthroughs in NLP and in AI in general.
But what exactly is GPT-3 and where is it located in the current state of NLP.?
In this lecture, I review the past present and (a the possible) future of NLP. I review what are language models, how computers represent language, and meaning and some of the cool features of word embeddings.
I explain how we got from simple word representations to GPT-3 and what is so unique in the GPT-3 model. I show many cool examples of what GPT-3 can do and what it might be used for.
Finally, I review some of the limitations of GPT-3 and NLP in general and discuss what might be the future of NLP and what might lead us to the holy grail of AGI.
The Engineering of Conscious Experience
AI, Art & Consciousness