CodeEmporium
Let’s talk about GPT, GPT-2, GPT-3 and ChatGPT in 10 minutes
ABOUT ME
⭕ Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1
📚 Medium Blog: https://medium.com/@dataemporium
💻 Github: https://github.com/ajhalthor
👔 LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[ 1🔎] GPT-3 Main Paper: https://arxiv.org/pdf/2005.14165.pdf
[2 🔎] GPT-2 Main Paper: https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
[3 🔎] GPT original paper: https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
[4 🔎] A very Nice intuitive understanding of GPT-3 architecture: https://dugas.ch/artificial_curiosity/GPT_architecture.html
PLAYLISTS FROM MY CHANNEL
⭕ ChatGPT Playlist of all other videos: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
⭕ Transformer Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
⭕ Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
⭕ The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
⭕ Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
⭕ Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
MATH COURSES (7 day free trial)
📕 Mathematics for Machine Learning: https://imp.i384100.net/MathML
📕 Calculus: https://imp.i384100.net/Calculus
📕 Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics
📕 Bayesian Statistics: https://imp.i384100.net/BayesianStatistics
📕 Linear Algebra: https://imp.i384100.net/LinearAlgebra
📕 Probability: https://imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
📕 ⭐ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
📕 Python for Everybody: https://imp.i384100.net/python
📕 MLOps Course: https://imp.i384100.net/MLOps
📕 Natural Language Processing (NLP): https://imp.i384100.net/NLP
📕 Machine Learning in Production: https://imp.i384100.net/MLProduction
📕 Data Science Specialization: https://imp.i384100.net/DataScience
📕 Tensorflow: https://imp.i384100.net/Tensorflow
i dont understand the generative part of gpt . no body talked about it
Bro your videos are really good.
But I am not able to get an order to watch things. This is the 5th Or 6th video on gpt from your channel.
Can you make an ordered playlist for all yours video for deep learning? That will be very helpful for people who want to consume your content
But why is GPT better than for example BLOOM? Isn’t the architecture almost the same? So what makes the difference? (And here with GPT I mean gpt3, what makes GPT3 so good in comparison to others, even GPT2)
Hi bro you make crazy content. I really like your content.
I am from Pakistan
Really nice video, can I simply use pre-training GPT or BERT after fine-tuning for video captioning, which one is better for this task?
Is it that the GPT models can tokenize the text into the character-level for the lowest level? I was impressed by how it generated those very rare words which that BERT can't.
nice thx! like the explanation of self-supervised in particular! wasn't aware of that
It's only know I understood why you were talking about workable memory lol, a working memory you work on…
This channel is so underrated. The way he explains complex subjects is remarkable.
Wow, this video was so informative and well-explained. I appreciated the clear and concise way the subject was covered. Great job!!!!!!
After having ChatGPT talk to ALICE and other chatbots, I am convinced that ChatGPT is just another chatbot and not as revolutionary as people are claiming. I say this because it's very limited in its ability respond and falls back on repeating statements. Also after talking to it directly, I found it to be very simplistic in it' ability to converse. I'm sure the coding and underlying technology is very impressive but what it's doing isn't much better than a nearly 30-year-old chatbot and thus unimpressive from the standpoint of what it's supposed to be.
I know someone is going to be very offended by what I just said and all I can say is, go tell it to the chatbot.
Great work!
My lawd Ajay this is absolutely amazing! Just binged watched this at the gym. Your ability to distill something so hardcore into such a simple explanation is nuts. Bravo homie!
If you think I deserve it, please consider liking the video and subscribing for more content like this 🙂
These videos are content free. Its press science.
Great video! Where did you get the numbers indicating how many samples it takes a human to learn those specific tasks? I'm wondering because it surprises me how low they are considering it takes humans years to learn how to form their first sentence.
🔥🔥🔥
Loved the video, it really helped me. I had a problem with understanding how the jump from language modeling to other tasks works. You saying that it's a finetuning step helped
Amazing Explanation
It's absolutely astounding how transformers learn to reason. It's ChatGPT's ability to reason that sets it (and others like it) apart from anything done previously in Machine Learning and Artificial Intelligence. We are truly living in the dawning of the age of artificial intelligence.