Jay Alammar
Since its introduction in 2018, the BERT machine learning model has continued to perform well in a lot of language tasks. This video is a gentle introduction into some of the tasks that BERT can handle (in search engines, for example). The first 3 minutes goes over the some of its applications. Then the video discusses how the model works at a high level (and how you may use it to build a semantic search engine which is sensitive to the meanings of queries and results).
Introduction (0:00)
You have used BERT (applications) (0:25)
How BERT works (2:52)
Building a search engine (4:30)
——
The Illustrated BERT
http://jalammar.github.io/illustrated-bert/
BERT Paper:
https://www.aclweb.org/anthology/N19-1423/
Understanding searches better than ever before
https://blog.google/products/search/search-language-understanding-bert/
Google: BERT now used on almost every English query
https://searchengineland.com/google-bert-used-on-almost-every-english-query-342193
——
Twitter: https://twitter.com/JayAlammar
Blog: https://jalammar.github.io/
Mailing List: http://eepurl.com/gl0BHL
More videos by Jay:
Explainable AI Cheat Sheet – Five Key Categories
https://www.youtube.com/watch?v=Yg3q5x7yDeM
The Narrated Transformer Language Model
https://youtu.be/-QH8fRhqFHM
Jay’s Visual Intro to AI
https://www.youtube.com/watch?v=mSTCzNgDJy4
How GPT-3 Works – Easily Explained with Animations
https://www.youtube.com/watch?v=MQnJZuBGmSQ