mangate85
GPT-3 is considered by some to be one of the biggest breakthroughs in NLP and in AI in general.
But what exactly is GPT-3 and where is it located in the current state of NLP.? In this lecture, I review the past present and (a the possible) future of NLP. I review what are language models, how computers represent language, and meaning and some of the cool features of word embeddings.
I explain how we got from simple word representations to GPT-3 and what is so unique in the GPT-3 model. I show many cool examples of what GPT-3 can do and what it might be used for. Finally, I review some of the limitations of GPT-3 and NLP in general and discuss what might be the future of NLP and what might lead us to the holy grail of AGI.
Can GPT-3 think? Past Present and Future of Natural Language Processing (NLP) – Hebrew
