Weights & Biases
Clem explains the virtuous cycles behind the creation and success of Hugging Face, and shares his thoughts on where NLP is heading.
—
Clément Delangue is co-founder and CEO of Hugging Face, the AI community building the future. Hugging Face started as an open source NLP library and has quickly grown into a commercial product used by over 5,000 companies.
Connect with Clem:
📍 Twitter: https://twitter.com/ClementDelangue
📍 LinkedIn: https://www.linkedin.com/in/clementdelangue/
—
🌟 Transcript: http://wandb.me/gd-clement-delangue 🌟
⏳ Timestamps:
0:00 Sneak peek and intro
0:56 What is Hugging Face?
4:15 The success of Hugging Face Transformers
7:53 Open source and virtuous cycles
10:37 Working with both TensorFlow and PyTorch
13:20 The “Write With Transformer” project
14:36 Transfer learning in NLP
16:43 BERT and DistilBERT
22:33 GPT
26:32 The power of the open source community
29:40 Current applications of NLP
35:15 The Turing Test and conversational AI
41:19 Why speech is an upcoming field within NLP
43:44 The human challenges of machine learning
Links Discussed:
📍 Write With Transformer, Hugging Face Transformer’s text generation demo: https://transformer.huggingface.co/
📍 “Attention Is All You Need” (Vaswani et al., 2017): https://arxiv.org/abs/1706.03762
📍 EleutherAI and GPT-Neo: https://github.com/EleutherAI/gpt-neo]
📍 Rasa, open source conversational AI: https://rasa.com/
📍 Roblox article on BERT: https://blog.roblox.com/2020/05/scaled-bert-serve-1-billion-daily-requests-cpus/
—
Get our podcast on these platforms:
👉 Apple Podcasts: http://wandb.me/apple-podcasts
👉 Spotify: http://wandb.me/spotify
👉 Google Podcasts: http://wandb.me/google-podcasts
👉 YouTube: http://wandb.me/youtube
👉 Soundcloud: http://wandb.me/soundcloud
Join our community of ML practitioners where we host AMAs, share interesting projects and meet other people working in Deep Learning:
http://wandb.me/slack
Check out Fully Connected, which features curated machine learning reports by researchers exploring deep learning techniques, Kagglers showcasing winning models, industry leaders sharing best practices, and more:
https://wandb.ai/fully-connected