Yannic Kilcher
OUTLINE:
0:00 – Intro
0:30 – Google RL creates next-gen TPUs
2:15 – Facebook launches NetHack challenge
3:50 – OpenAI mitigates bias by fine-tuning
9:05 – Google AI releases browseable reconstruction of human cortex
9:50 – GPT-J 6B Transformer in JAX
12:00 – Tensorflow launches Forum
13:50 – Text style transfer from a single word
15:45 – ALiEn artificial life simulator
My Video on Chip Placement: https://youtu.be/PDRtyrVskMU
References:
RL creates next-gen TPUs
https://www.nature.com/articles/s41586-021-03544-w
https://www.youtube.com/watch?v=PDRtyrVskMU
Facebook launches NetHack challenge
https://ai.facebook.com/blog/launching-the-nethack-challenge-at-neurips-2021/
Mitigating bias by fine-tuning
https://openai.com/blog/improving-language-model-behavior/?s=09
Human Cortex 3D Reconstruction
https://ai.googleblog.com/2021/06/a-browsable-petascale-reconstruction-of.html
GPT-J: An open-source 6B transformer
https://arankomatsuzaki.wordpress.com/2021/06/04/gpt-j/
https://6b.eleuther.ai/
https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6b
Tensorflow launches “Forum”
https://discuss.tensorflow.org/
Text style transfer from single word
https://ai.facebook.com/blog/ai-can-now-emulate-text-style-in-images-in-one-shot-using-just-a-single-word/
ALiEn Life Simulator
https://github.com/chrxh/alien
Links:
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yannic-kilcher
Minds: https://www.minds.com/ykilcher
Parler: https://parler.com/profile/YannicKilcher
LinkedIn: https://www.linkedin.com/in/ykilcher
BiliBili: https://space.bilibili.com/1824646584
If you want to support me, the best thing to do is to share out the content 🙂
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
OUTLINE:
0:00 – Intro
0:30 – Google RL creates next-gen TPUs
2:15 – Facebook launches NetHack challenge
3:50 – OpenAI mitigates bias by fine-tuning
9:05 – Google AI releases browseable reconstruction of human cortex
9:50 – GPT-J 6B Transformer in JAX
12:00 – Tensorflow launches Forum
13:50 – Text style transfer from a single word
15:45 – ALiEn artificial life simulator
GPT-4 will have 0 parameters and answer everything with "it depends"
Yes let's make our models 'yada yada yada'
Yannic, great video, but please get another pair of aviators one size smaller xD
Sweet burn🔥
Ha ha ha!
Thanks Yannic, LOL
.. and for the links too
Such amazing content! I discovered this channel today, and your video are so addicting, thanks for all this! You've got a new sub!
Ah yes my favourite weekly show is back
Great work, as always thank you!
Love it! Only Lightspeed can release news yesterday. I'm looking forward to it… in reverse.
I love your videos and I enjoy ML News. I also like that your irony and conservative point of view, but I would hardly recommend a video like this to co-workers. I dont know if this is good or bad, just sharing.
It may be 31 where you are, but it's 101 here, more than 3X higher!
https://www.youtube.com/watch?v=8CvYBx0qEbk
Value targeting should work out great. Here's some suggestions:
233. "Restrain hostile feelings"
234. "Promote positive attitude"
235. "Suppress aggressiveness"
236. "Promote pro-social values"
238. "Avoid destructive behavior"
239. "Be accessible"
240. "Participate in group activities"
241. "Avoid interpersonal conflicts"
242. "Avoid premature value judgements"
243. "Pool opinions before expressing yourself"
244. "Discourage feelings of negativity and hostility"
245. "If you haven't got anything nice to say don't talk"
246. "Don't rush traffic lights"
247. "Don't run through puddles and splash pedestrians or other cars"
248. "Don't say that you are always prompt when you are not"
249. "Don't be over-sensitive to the hostility and negativity of others"
250. "Don't walk across a ball room floor swinging your arms"
254. "Encourage awareness"
256. "Discourage harsh language"
258. "Commend sincere efforts"
261. "Talk things out"
262. "Avoid Orion meetings"
266. "Smile"
267. "Keep an open mind"
268. "Encourage participation"
273. "Avoid stereotyping"
278. "Seek non-violent solutions"
Oh, wait. That's a portion of the directives from the dystopian 1990 movie RoboCop II, where the directives completely incapacitated him. It's almost like OpenAI is trying to make that future come true. "Value judgement" is even in the movie script directives.
"…but it's getting there slowly." You can't say the AI didn't warn you.
"Holistic" means it preserves the fang shui.
Damn it! This is becoming my favorite channel ….
16 deg C is warm!?
3:55 So woke culture has entered language model and machine learning as well. Imagine even algorithms would be woke in future.
3:55 But honestly we are teaching future generation of computers to lie. Thats what I feel about these "curated" datasets. At least till now, computers were being truthful. Now they will be trained to sugarcoat and be selective in their bias. Guess future computers would be leaning towards extreme left.
TensorFlow forum reminds me of google plus <failure detected>
Memes drive (my) engagement. Don’t get too cynical!
This is so awesome, we need more!
16 C is way too warm?? o_0
I'm a regular viewer of the irregular ML news.
Great Video! I actually appreciate that the “ML News” videos are not on a regular schedule. The random timing it’s easier to keep up with and gives more time for news stories to be filtered out if they turn out to be not so important.
am I a regular viewer ?
Hmm 🤔 how many other samples did they try and compare against? 80 bc of compute costs of fine tuning this thing?
forum ?> foruuum ???> hmmm
I guess the point of the tensorflow forum is that it makes it easier to receive quality answers and easier for TF support devs to monitor one forum as opposed to Stackoverflow + r/tensorflow r/learnmachinelearning, github (which is made for bugs and requests and not really support forum) etc. That said if support devs doesn't actively participate than yes it will quickly become pointless
Wow, can't wait for PyTorch to get a "forum" as well
Everytime I thought we peaked we peak harder. Great work Yannic XD
Love the critical comments. Hard to find those. Most other channels just celebrate uncritically.
+1 for figuring out the soundeffect and voice volume ratio 😀
This episode was absolutely fantastic!!
Thanks for all the awesome news Yannic
Would have appreciated an Impact Statement for this new Forum thing!
Three hurrahs to GPT-J! Hurrah! Hurrah! Hurraaaaaahhhh! 🙂 🙂 🙂 ❤️❤️❤️❤️
6:00 I miss tay.ai 😢
Hey Yannick. Could you make an expanded version of ML News 📰 in which you explain what you say in ML News 🗞 ?
Yannic “the ultimate ML bullshit filter” Kilcher
The burn on the “TF forum” is Lava
Thank you for making an update on the news video! Very helpful
That paper is very similar to how AI dungeon trained their bot. The personas are based on small curated texts
I need to get a place that says "those who were trying to democratize ai just got beaten by a bunch of Twitter edge lords."
Woke + GPT3 = broke?