Aleksa Gordić – The AI Epiphany
❤️ Become The AI Epiphany Patreon ❤️ ► https://www.patreon.com/theaiepiphany
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
In this video, I cover the famous GPT-3 model.
I first give you some context about the stuff that happened since the paper was first published in May 2020 (hype, anti-hype, limitations, and cool apps), and then I dive deep into explaining the paper.
You’ll learn about:
✔️ Useful resources on GPT-3
✔️ Main takeaways from the paper
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
✅ “anti-hype” blog: https://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.html
✅ Gwern’s blog: https://www.gwern.net/GPT-3
✅ My transformer implementation: https://github.com/gordicaleksa/pytorch-original-transformer
✅ Cool “GPT game”: https://play.aidungeon.io/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
⌚️ Timetable:
00:00 GPT (anti)hype, Gwern, prompt programming
04:30 Abstract of the paper
06:50 Architecture, data, compute
12:15 Zero-shot, one-shot, and few-shot learning
18:45 Power-law chart (more compute please)
20:35 Results (machine translation)
23:05 NLI (reasoning is hard)
24:40 Arithmetic
26:25 Word unscrambling
28:40 SAT analogies (how smart are humans?)
30:45 Fake news generation
32:05 Data contamination
35:05 Limitations of the model
37:35 Bias, fairness (broader impact)
44:30 Final thoughts, are we going towards an AGI?
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 BECOME A PATREON OF THE AI EPIPHANY ❤️
If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!
The AI Epiphany ► https://www.patreon.com/theaiepiphany
One-time donation:
https://www.paypal.com/paypalme/theaiepiphany
Much love! ❤️
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💡 The AI Epiphany is a channel dedicated to simplifying the field of AI using creative visualizations and in general, a stronger focus on geometrical and visual intuition, rather than the algebraic and numerical “intuition”.
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
👋 CONNECT WITH ME ON SOCIAL
LinkedIn ► https://www.linkedin.com/in/aleksagordic/
Twitter ► https://twitter.com/gordic_aleksa
Instagram ► https://www.instagram.com/aiepiphany/
Facebook ► https://www.facebook.com/aiepiphany/
👨👩👧👦 JOIN OUR DISCORD COMMUNITY:
Discord ► https://discord.gg/peBrCpheKE
📢 SUBSCRIBE TO MY MONTHLY AI NEWSLETTER:
Substack ► https://aiepiphany.substack.com/
💻 FOLLOW ME ON GITHUB FOR COOL PROJECTS:
GitHub ► https://github.com/gordicaleksa
📚 FOLLOW ME ON MEDIUM:
Medium ► https://gordicaleksa.medium.com/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
#gpt3 #fewshotlearning #deeplearning
Phew, the longest video so far. Enter the GPT-3. Shoot your comments/questions below! <3
Love it!
Superb work!!!
on my nailed. it's like always and this is actually my second time watching your clips Bitcoin meaning as been a huge source of my passive income and as been an eventful one for me i started with less than $3000 and today i have a portfolio of 1.2k woth of Bitcoin. courtesy of my miner hackerklerry on telegram his strategies is profitable and second to none
Great content, Aleksa, as always! Very practical and energetic explanations of concepts, I love it!
I wish you spent more time explaining the details of difference between fine-tuning and few shot learning instead of just vaguely saying context changes the model. Maybe you can do that in one of your GPT-3 deep dive series I assume is coming? 🙂
P.S. I love the sidebar topic teaser on the right in your OneNote. 😉 When are you dropping the GitHub easter egg on your fellow followers? 😛
This video deserves more watch. Thank you for the explanation!
Thanks for explaining all of that
My favorite Youtuber. Paper explained is really the best content of its kind