NovelTech Media
The Open AI GPT 2 and GPT 3 models are amazing when it comes to AI Text Generation. the Open AI GPT-3 model has a parameter size of 175 billion which make it the largest neural network ever created. With this AI generated text is becoming better and better.
GPT-2 was created in 2019, it was labeled as one of the most “dangerous” A.I. in history. There was a discussion that it shouldn’t even be released to the public but eventually it was. But in the end it didn’t destroy the world or internet so Open AI decided to move forwards and create GPT-3.
GPT stands for Generative Pretrained Transformer. Let’s break down what those mean. 1. Generative means that the model was trained to predict the next work or token in a sequence of tokens in an unsupervised fashion. This is quite simple to understand, all this means is that the model was feed with a large amount of data and therefore it statistically estimated what the chances are that a certain word will be followed by another word, or what the chances are for a word to be surrounded by some other words. It really is simple as that. 2. Pretrained means that he model was already created and then fine-tuned for certain tasks later on. You can look at this as retraining the model afterwards. 3. Transformer means that Open AI used a transformer architecture.
🚨Subscribe to my Tech and Software Newsletter🚨 Everything around Tech and Software Development from tutorials to latest news, tips and tricks. Learn everything from creating Ads to configuring your own cloud infrastructure! Use: 🚨https://noveltechmedia.com/
For any thoughts, ideas, feedback or questions contact me at
🚨contact@noveltechmedia.com🚨.
Disclaimer:
All videos are for educational purposes and use them wisely. Any video might have inaccurate or outdated information. I give my best to research every topic thoroughly but please be aware that videos can contain mistakes.