Marc Evanstein / music․py
In which I see whether GPT-4 is any better than GPT-3 at composing music.
Resources I recommended at the end:
– Bret Devereaux, “Collections: On ChatGPT”: https://acoup.blog/2023/02/17/collections-on-chatgpt/
– Sebastien Bubeck, “Sparks of AGI”: https://youtu.be/qbIk7-JPB2c
– Gary Marcus and Ernest Davis, “How not to test GPT3”: https://garymarcus.substack.com/p/how-not-to-test-gpt-3
– Ezra klein episodes: https://www.nytimes.com/2023/04/07/opinion/ezra-klein-podcast-ama-april2023.html & https://www.nytimes.com/2023/04/11/opinion/ezra-klein-podcast-alondra-nelson.html
Other self-promotion:
Check out my SCAMP libraries: http://scamp.marcevanstein.com/
Take my course on Kadenze.com: https://www.kadenze.com/courses/computer-assisted-music-in-python-i
Support me on Patreon: Patreon: https://www.patreon.com/marcevanstein
Private Lessons: http://teaching.marcevanstein.com
Someone made a video that really reminds me of playing anti-tic-tac-toe with GPT-4: https://youtu.be/yGe7p98Wagg
The answer is no
Yeah, I wasn't impressed with ChatGPT's musical abilities either. I asked it to write lyrics for a rock song, it gave me a good laugh. It wrote a cheesy song about city, cars, tatoos, neon lights and some other random shit 😆
maybe I am an ai because all i thought was oh yea a purple block would be placed under the blue box(I think I play to much Minecraft)
I think it is completely useless at this point and laughable to hear that this might one day take over the world. In my opinion it isToo early for saying a thing like this.
As someone who was in the HS wind ensemble on sheer gumption but only got the bare minimum theory and composition (maybe 2 weeks per year), good to know GPT4 seems to have surpassed the compositional creativity of child musicians.
About the incorrectly placed green, blue and red tiles: Some programming languages by default start counting with 0, some start counting with 1. Maybe something got messed up here?
this sucks and is a waste of time
ok
Everyone everywhere calling and treating these things like true “AI” is jumping the gun and I think it’s confusing people. It’s more like a sophisticated language bot.
1:20 it doesn't neroscientist to know that.
I thought a green block would be placed next to the orange
We should keep ai away from music
Basically cruel angels thesis
Sadly gpt4 cant write tabs that make sense (for harmonica).
Good lord, some of that was good but most of it was more dissonant than modern jazz!
Getting AI to play tic-tac toe is the first step to getting it to not play thermonuclear war.
I once asked chat gpt to write me a progressive metal riff and It came back with this
A——9-9———–
E-7-7—-10-10—
Thats when I realized that ai isnt gonna take over music any time soon.
"His creators were proud of their brainchild" is quite a statement. True, yet condescending haha 0:48
Garbage in, garbage out.
It may not have a music expert's understanding, but for something that is essentially still a toddler, I'd have to say it's impressive, and you can certainly see that the software is improving. I wonder where it will be in a few more generation.
A computer will get music technically correct but it will NEVER have the soul component as found in works by Bach, Handel, Mozart, et al.
Langauge logically models the world, so of course an advanced chatbot does.
Learning algorithms trained on music, (e.g. all of Bach's works) have already done a lot better compising music decades ago.
melody
AI is too late to the game for melody. Most of the great tunes already written, possibility set pretty well mined out by thousands of talented human songwriters and composers over several hundred years.
AI has a strong role in music in the future (to answer your final questions – what do I want it to be). Specifically, If I give it a tune, it should be able to generate several countermelodies that adhere to the styles of various composers – meaning that it would follow the conventions prevailing at the time of that composer and give similar statistics as the original composer (his style). A HUMAN could then choose among the results, picking the one he thought best. So AI would present legitimate options, in the sense that people said that Bach on hearing a tune could see all the counterpoint options in his head. AI would replace that part, but then the human (Bach) would select and combine them.
Hit the Code, Jack
I think it's a mistake to assume that our brains have some kind of 'magic' that AI can't emulate. We learn by imitation, trial-and-error and by looking for reward-responses; just like AI does. The difference is simply that we've been trained on a different set of data.
What if the blue block identifies as a red block?
This is the best video on the real abilities of AI in the examples of Chat GPT 3 & 4. Thanks so much for pointing out that this form of AI has no real sense of a relationship between words and what those words represent in the real world. Without that ability, A I will only get better at creating a dangerous illusion of intelligence.
It is also interesting that several programs created for the express purpose of writing music do quite a lot better at the job of composing music than Chat GPT 4. However those also have a lot of short comings. For instance David Chope's program has a penchant for fairly glaring plagiarism, and it also unwittingly tends to make it's "own" generations more bland and boring than the music from which it has supposedly learned .
By the way. About 28 years ago i created a program that could generate better music than chat GPT 4, although I lacked the knowledge and patience to deal with learning enough code to produce better results. Mine was based on my knowledge of music structures, based in math, and the probabilities of combinations of notes, that occur in sequences & vertical structures together. Very much earlier (1970's) I had done some experiments with generating melodies by using divider circuits, and sample hold circuits (for electronic music).
Just replacing song names with the word “code”
Ok Reddit 🙄
I love your puns with the Melody Names
Is there an AI that allows composers to input their compositions and then generates new compositions in the style of the composer?
The way I see GPT right now is like a probe into the system 1 brain of a superintelligence. Our human brains work on two different levels: System 1, and System 2. System 1 does not care about the truthfulness or correctness of its thoughts, it just does as it knows. Think of it like the muscle memory of a boxer, it doesn't think "this move is correct", it just does. System 2 is the one governing System 1, making sure that its "thoughts" are correct and appropriate. If they're not, the process is repeated again until System 1 spits out something System 2 think is proper.
I think that once we have proper tools that use this System 1 System 2 dynamic properly, we are going to see a massive increase in the quality of the outputs of these AI models.
Awesome!
I think it wouldn’t be too hard to teach an AI how to write music that sounds good. After all there are many distinct rules for what sounds good and what sounds bad. For example like how many pop songs have similar chord changes.
6:58 sounds like something that would be in a video game. at least the start of it
Hit the code Jack sounded almost identical to a the music in a LDS Hymn in the Hymn book, just slightly off.
There was significant improvement from GPT-3 to GPT-4, and that's just with a few months of additional training and improvements. Imagine what ChatGPT will become in 2 years!
human cognition and emotion also involves neurotransmitters, hormones…how we gon fake them
Here's what a really intelligent system should be able to handle: "Create a 3 minute piece of music that Beethoven might write and provide me with the sheet music." Until that is possible, we are just working with "toy AI."
Some of the best pop songs end abruptly. 😆
concise prompting is required for concise results. GPT was pretty accurate based on your prompts.
This is the same experience I'm having with coding. The best way to get good code out of ChatGPT is to go back and forth, speaking the language that programmers would use, managing the iterations, until you have enough good pieces for form something useful. Without being able to speak that language to begin with – something that comes from experience – it won't scale very well. I would be useless speaking to it using the language of music that you're obviously fluent in! Unless it speaks "guitar tab" 🙂
i got a really good one once. it was an epic adventure like song. i used abcjs though