GPT 3

Build GPT-3-like Language Model on Google Colab with minGPT [PyTorch]



1littlecoder

Andrej Karpathy – the name that needs no intro in Deep Learning community a day back released a new library `minGPT` that’s a Pytorch Implementation of GPT (Language Model). It’s basically the core or minimalistic version of what GPT-3’s been doing in the news and media. This video helps you take the minGPT library that Karpathy has put together and take the example notebook that he’s shared and immediately use it with a Google Colab Notebook. This video doesn’t get into the technical details of the code rather focused on how to use the example and get your desired output. Building a mini GPT-3 like Language Generation Model was the main intention of this video and hope it was helpful in doing something exciting with a fast and quick minGPT!

Andrej Karpathy’s minGPT – https://github.com/karpathy/minGPT
Karpathy’s Example Play_char – https://github.com/karpathy/minGPT/blob/master/play_char.ipynb
Google Colab Notebook – https://colab.research.google.com/drive/1SoRVLxlx8H7Qk84ra2c5WguhYUtPpwbA?usp=sharing