Yannic Kilcher
#artificialintelligence #musicvideo #clip
I used OpenAI’s CLIP model and BigGAN to create a music video that goes along with the lyrics of a song that I wrote. The song lyrics are made from ImageNet class labels, and the song itself is performed by me on a looper.
OUTLINE:
0:00 – Intro
1:00 – AI-generated music video for “be my weasel”
3:50 – How it was made
7:30 – My looping gear
9:35 – AI-generated music video #2
12:45 – Outro & Credits
Code and references: https://github.com/yk/clip_music_video
Links:
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yannic-kilcher
Minds: https://www.minds.com/ykilcher
Parler: https://parler.com/profile/YannicKilcher
LinkedIn: https://www.linkedin.com/in/yannic-kilcher-488534136/
BiliBili: https://space.bilibili.com/1824646584
If you want to support me, the best thing to do is to share out the content 🙂
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
OUTLINE:
0:00 – Intro
1:00 – AI-generated music video for "be my weasel"
3:50 – How it was made
7:30 – My looping gear
9:35 – AI-generated music video #2
12:45 – Outro & Credits
Code and references: https://github.com/yk/clip_music_video
Great work! Can't wait to hear a rock version!
How hell do you find the time for all this work? Coming up with the idea, writing the music, training the networks, performing the music, creating the video, and also explaining how the music video gan works… Amazing! (And also the song is very catchy 🙂 )
Friend : What kind of music do you listen to?
Me : It's complicated…
Epic.
ah yes, neural country, my favourite music genre
harika
When can we expect this on spotify? Need this in my playlist for reasons.
This is my brain (I make a music video to every song I hear, almost like a type of synthesia).
[edit] PS, not quit like "clip" though, as the words are not always as important as the music. For example, a music video might be someone reminiscing on the past in the words, but the current video/scene completely different.
Why can't I like this more than once?!?
Amazing! Great work!
This is Cool
Who edited this video? This is GOLD.
8:22 😂😂
O-M-G-! 🤯🤯🤯
although the lyrics don't make any sense
but the tone is lit
i have listened this on loop 15-20 times
bars
Sounds like your average "they might be giants" song lol
This was a delightful, lighthearted treat at the end of an arduous day. Thank you very much, Yannic.
gross
Next: AI to trigger the looper, making a usable song from random playing. Hilarious idea and execution
edit: and pedals. More pedals. All of them!
Every AI conference should open with this
Great video! Not only from a perspective of a fellow ML student, but from a perspective of a graphic designer (my wife).
Please upload this to Spotify!!
Super Yannic 😀👍
Yannick after his PhD:
https://www.instagram.com/p/CPD9NYrjgvy/?utm_medium=share_sheet
You should make the guitar tab public, id like to cover this 🙂
This song makes me happy on how far we have come in Machine Learning.
Super Catchy… That the horizontal bar is actually vertical is something that really bothers me 😛
DO ANDROIDS DREAM OF ELECTRIC SHEEP?
I have two questions :
1. Yannic, is this song available on Spotify?
2. what are the chords you used in the song any open version of chords, I was planning to try singing it with my friends
The song is nonsense but it performed beautifully
Okay, Why is this stuck in my head since last 4 days !!?
Yannic: "As soon as a camera is rolling my brain just turns off."
Also Yannic: Makes videos explaining machine learning papers.
This is actually a pretty good song. I would love to hear you write the official anthem for AI.
My spine is like a horizontal bar!!
Not the weirdest music video (or lyrics) I've ever seen, but I appreciate how all of the images in the video evolve into eldritch abominations.
This should be anthem of next NeurIPS!!
the real question is: will you be my weasel? Or my pig?
This is gonna blow up when the yt algorithm decides to drop it on everyone. And it will be super funny.