The Royal Institution
How are technologies like ChatGPT created? And what does the future hold for AI language models?
This talk was filmed at the Royal Institution on 29th September 2023, in collaboration with The Alan Turing Institute.
Join this channel to get access to perks:
https://www.youtube.com/channel/UCYeF244yNGuFefuFKqxIAXw/join
Watch the Q&A with Mirella here: https://youtu.be/9i2x2HyeW-Y
Generative AI refers to a type of artificial intelligence that involves creating new and original data or content. Unlike traditional AI models that rely on large datasets and algorithms to classify or predict outcomes, generative AI models are designed to learn the underlying patterns and structure of the data and generate novel outputs that mimic human creativity.
ChatGPT is perhaps the most well-known example, but the field is far larger and more varied than text generation. Other applications of generative AI include image and video synthesis, speech generation, music composition, and virtual reality.
In this lecture, Mirella Lapata will present an overview of this exciting—sometimes controversial—and rapidly evolving field.
Mirella Lapata is professor of natural language processing in the School of Informatics at the University of Edinburgh. Her research focuses on getting computers to understand, reason with, and generate natural language. She is the first recipient (2009) of the British Computer Society and Information Retrieval Specialist Group (BCS/IRSG) Karen Sparck Jones award and a Fellow of the Royal Society of Edinburgh, the ACL, and Academia Europaea.
00:00 Intro
2:38 Generative AI isn’t new – so what’s changed?
8:43 How did we get to ChatGPT?
12:38 How are Large Language Models created?
22:48 How good can a LLM become?
26:57 Unexpected effects of scaling up LLMs
28:05 How can ChatGPT meet the needs of humans?
32:30 Chat GPT demo
38:07 Are Language Models always right or fair?
40:21 The impact of LLMs on society
42:54 Is AI going to kill us all?
—
A very special thank you to our Patreon supporters who help make these videos happen, especially:
modsiw, Anton Ragin, Edward Unthank, Robert L Winer, Andy Carpenter, William Hudson
Don McLaughlin, efkinel lo, Martin Paull, Ben Wynne-Simmons, Ivo Danihelka, Kevin Winoto, Jonathan Killin, Stephan Giersche, William Billy Robillard, Jeffrey Schweitzer, Frances Dunne, jonas.app, Tim Karr, Alan Latteri, David Crowner, Matt Townsend, THOMAS N TAMADA, Andrew McGhee, Paul Brown, David Schick, Dave Ostler, Osian Gwyn Williams, David Lindo, Roger Baker, Rebecca Pan
—
The Ri is on Twitter: http://twitter.com/ri_science
and Facebook: http://www.facebook.com/royalinstitution
and TikTok: https://www.tiktok.com/@ri_science
Listen to the Ri podcast: https://podcasters.spotify.com/pod/show/ri-science-podcast
Our editorial policy: https://www.rigb.org/editing-ri-talks-and-moderating-comments
Subscribe for the latest science videos: http://bit.ly/RiNewsletter
Product links on this page may be affiliate links which means it won’t cost you any extra but we may earn a small commission if you decide to purchase through the link.
Source
😂😂😂This really shows that we shouldn't leave it up to a group of tech engineers to shape the world and hold all the power. They show to know little about the broader world and simply reinvent the wheel for others like them, making the rest of us believe they've created something truly new and amazing. 😢
One of the best presentations I have ever watched. You have just debunked this complex topic for us.
This lecturer was great, simple and created great impact about AI.
how smooth and beautifully explained. It is super easy and cool. thank you Mirella.
33:05 i kinda like long responses idk maybe its the questions i ask i use a.i to research topics so i guess i kinda want and need long responses
if trump was a dictator who wouldnt have given up the election free and square
2:23 I really thought Master oogway said that quote.🥲
interesting discussion i wonder where it is all headed.
[19]:[19] The King of AI Architecture
19:19 ai
I come to listen with a lot of enthusiasm your courses about GPT and generative AI .
Altogether, i retained an important parts of those aspects about those tools which are efficient in research matter including learning ..Once more thank you for offering me the opportunity to boost my knowledge , skill and competency.
Introducing bias by labelling Trump as Dictator.
It’s not just analyzing data, it’s creating from it.
🤖 Intro: Understanding Generative AI
[00:12] What IS Generative AI? (Simply Put: AI Creating New Stuff!)
[01:16] What Can It Create? (Text, Images, Code, Video, Audio & More)
[01:36] Today's Focus: Generating Text
📜 The Past: How We Got to Today's AI
[02:50] This Isn't Brand New: Early Examples We Already Used (Google Translate, Siri)
[05:07] The 2023 Breakthrough: GPT-4's Impressive Capabilities (Passing Tests, etc.)
[07:31] Unprecedented Growth: How ChatGPT Went Viral Faster Than Anything Before 🚀
💡 The Present: How Generative AI Works NOW
[08:28] The Core Idea: Language Modeling (AI Predicts the Next Word)
[09:41] How It Learns: Neural Networks Finding Patterns in Massive Text Data
[12:29] Building the AI Brain: Data Collection & The Training Process 🏗
[14:44] Tech Deep Dive: Neural Networks, Parameters & The Transformer Architecture
[22:53] What Makes a "Great" Language Model? The Importance of SCALE (Data & Size) 🔑
[26:03] The Price Tag: Training These Huge Models is Expensive 💰
[28:03] Tailoring the AI: Fine-Tuning Models for Specific Jobs
[29:28] The Alignment Problem: Making AI Helpful, Honest & Harmless (The 3 H's) ✅
[32:22] Live Demo Time: Watch GPT Work (Showcasing Abilities & Weaknesses)
🔮 The Future: Risks, Ethics & What's Next
[38:03] Proceed with Caution: Major Risks to Consider (Misinformation, Bias, Environmental Impact) ⚠
[40:57] The Big Question: How Will AI Impact Jobs? 🤔
[42:53] Looking Forward: Superintelligence, Managing Risks & Insights from Tim Berners-Lee
[44:47] The Path Ahead: Balancing AI's Huge Benefits with Essential Regulation & Ethics
maybe it would be better to underline more that AI is a stocastic process .
an extremely powerfull stocastic process.
that also means nobody knows howbit really works
because the neural connections are programmed by developed during the training phase
is AI correct ?
jist statiscally
but what happens when fake is more common that proven data ?
The rise of AI is creating so many exciting career opportunities! I’ve seen more people starting to learn how to work with these tools, and it's great to see the industry grow. If you're curious about exploring AI in depth, GenAI99 offers courses to help you get started and progress at your own pace.
Thanks Mirella
Ask Chat GPT about AI's impact on climate change.
informative
UI
There's not a single thing she's said so far in the first ten minutes that makes me feel comfortable with this existing.
Gen AI is so powerful! And for my work, I love using ChatGPT and Powerdrill AI to do data analysis, which are so cool!
A Smithsonian article containing historic photos of enslaved africans with various heinous injuries was posted online and many of the comments were people accusing it of being AI images. This technology is not 'bad' or 'good' but it doesn't exist in a vacuum. It also takes a lot of energy, which would be fine if we weren't already suffering rolling blackouts and an aging power grid. We are building the carriage before buying the horse and not even considering where we'll be riding to.
My chat has not been updated since June 2024.Hello AI?
What is Google aim at taking away jobs
I wonder which type of gen ai is worst in terms of processing power and heat generation.
Here, learning approaches infinity
An outstanding presentation by Professor Mirella Lapata. Her exposition on Generative AI was both intellectually rigorous and highly accessible. The structured narrative, combined with clear examples, provided valuable insights into the current capabilities and future directions of the field. A commendable contribution to AI education and public understanding.
I want to be in her class. So eye opening and simple to understand.
That's called "The Art of Story Telling " !!