Pradip Nichite
Learn How to Finetune GPT-3 to Get Better Results and Save Cost.
Fine-tuning lets you get more out of the models available through the API by providing:
1. Higher quality results than prompt design.
2. Ability to train on more examples than can fit in a prompt.
3. Token savings due to shorter prompts.
4. Lower latency requests.
Code: https://github.com/PradipNichite/Youtube-Tutorials/blob/main/Youtube_GPT_3_Finetuning.ipynb
GPT-3 Playlist:
https://youtube.com/playlist?list=PLAMHV77MSKJ4QOIS86OiXMtb3-4TUUzho
1. Learn how to build NLP applications using GPT-3. Learn to Write GPT-3 prompt.
2. Learn How to integrate GPT-3 Prompt into Python.
3. Aspect-Based Sentiment Analysis using GPT-3 | Prompt Design
4. GPT-3 Embeddings: Perform Text Similarity, Semantic Search, Classification, and Clustering.
5. Finetuning GPT-3.
I am a Freelance Data Scientist working on Natural Language Processing (NLP) and building end-to-end NLP applications.
I have over 7 years of experience in the industry, including as a Lead Data Scientist at Oracle, where I worked on NLP and MLOps.
I Share Practical hands-on tutorials on NLP and Bite-sized information and knowledge related to Artificial Intelligence.
LinkedIn: https://www.linkedin.com/in/pradipnichite/
#gpt3 #openai #nlp #fintuning #artificalintelligence #machinelearning
Hi nice video I am working on a project related to Q and A thing where I will ask a question related to a particular specific domain along with that I will finetune the openAi api in that domain can it answer questions in an much more descriptive way, like can it type a whole paragraph of answer by itself after fine tuning.
hi, watched your video and everything is clear, but i need your help with something. I'm running the codes on jupyter notebook "!openai tools fine_tunes.prepare_data -f intent_sample.jsonl". When i try running this, my whole notebook just crashes. Do you know what i can do to solve this?
hey bro do you know what bittensor is?
I'm somehow unable to proceed further, I'm stuck at this cmd:
openai api fine_tunes.create -t "intent_sample.jsonl" -m 'davinci'
I'm getting this error:
Stream interrupted (client disconnected).
To resume the stream, run:
openai api fine_tunes.follow -i ft-BAyMSys9M25GnL2IPkvzG2W6
Any idea how can I get it working?
@Pradip, quick question: what's the mechanism behind the fine-tuning? Is that telling the GPT3 if I input this prompt, please response this.If I input that prompt, please response that. Just build the links between promt and response?
Would you please refer more study material on fine-tuning mechanisms behind the scene, Thanks!
Hi, i followed all th steps and successfully created a fine tuned model. However, after I used it, it answered all questions like an error (e.g., enter multiple symbols to the response), do you know why it happends?
Can I fine tune with a excel file with almost 1000+ rows ?
hi pradip,
when i run this command : !export OPENAI_API_KEY="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"; openai api fine_tunes.create -t "intent_sample_prepared_train.jsonl" –model 'davinci' –n_epochs 5
getting this error : [organization=abc-2179] Error: No file with ID: intent_sample_prepared_train.jsonl (HTTP status code: 400)
Great video Pradip. Is there a possibility that a single or same prompt can provide 2 different completions? say prompt is about monthly sales figure Jan sales 10k, Feb sales 15k, Mar sales 20k and so on then the completion can be "Q1 Sales 45k" or "Yearly Sales 100k". How to manage such scenarios?
Am I able to hire you?
This is really great. I have recently done some fine-tuning and understand everything you did here except for including "nnIntent:nn" in the prompt. Why did you do that?
Great Video Pradip!
Clear explanation and clean code. Thanks!
Very nicely explained. I need some help how can I contact you?
thank you for your video ,
1)if i fine tune my dataset will i get the exact out put from completion, if i set temperature to zero,
2)while giving prompt ,do i have to give the exact prompt that i have set in dataset?
Thanks Pardip, very good detail explanation. One thing I would like to ask here, I was experimenting the fine tuning with similar data and then also I was passing generic prompt to check if chatgpt is also showing its generic knowledge. But the generic answers were not correct sometimes quite random meaningless. Also I wanted to combine the prompt to get response from my data as well as generic knowledge of chatgpt. Again it was not able to answer. Any thought around this?
any way to finetune SVGs
📌 Hey everyone! Enjoying these NLP tutorials? Check out my other project, AI Demos, for quick 1-2 min AI tool demos! 🤖🚀
🔗 YouTube: https://www.youtube.com/@aidemos.futuresmart
We aim to educate and inform you about AI's incredible possibilities. Don't miss our AI Demos YouTube channel and website for amazing demos!
🌐 AI Demos Website: https://www.aidemos.com/
Subscribe to AI Demos and explore the future of AI with us!
Thank you for your tutorial, just the problem in real life we can't share private data like that in the open model for everyone. So is there a possibility to create a private model for my own usé.
Thanks
Bhai tumse bat kese ho skti he?
Hi Sir,
thanks for video.
Q1- How can we add parameters in fine tuning like we want to fine tune data with specific number of tokens, temperature how can we add that.
Q2- For example we want content Generation from GPT-3 Model do we need to use different prompt's for reference because we want to generate unique content every time in same domain
Q3- If we fine tune Model without max token's how can we decide max token's while using that Model because if we select less max token's then we don't get complete results with fine tuned Model.
(I am working on content generation in sport's domain like (write a unique article on how to play t20 match?))
Thank You Pradip.. i looked for a couple of videos of fine tuning models, but nobody could give the clarity you gave in this video. All the best
Thanks for this video. I keep getting the error "Stream interrupted (client disconnected).To resume the stream, run". How can I fix this?