ChatGPT is asked to handle all kinds of weird tasks, from determining whether written text was created by an AI, to answering homework questions, and much more. He is good at some of these tasks and absolutely incapable of others. (Filipe dos Santos Branco) and (Edward Gu) however had an original idea. What if ChatGPT could do something musical?
They built a system that, with the press of a button, would query ChatGPT for a 10-note melody in a given musical key. Once the sequence of notes is generated by the large language model, it is played by a PWM-based synthesizer running on a Raspberry Pi Pico.
Ultimately, ChatGPT is not a musical genius. It’s simply a matter of picking a bunch of notes from a list that are known to work together melodically; that’s the whole point of musical keys. It would have been crazy if it generated riffs on the level of Stairway to heaven Or Spontaneous devotion, but that might be too much to ask.
Here’s the question though. If you trained a large language model, but managed to digest sheet music instead of written texts…could he learn to write music in different genres and styles? If someone isn’t already working on it, surely there’s an entire PhD you could get from this one idea. We should talk!
Either way, this is one of the most creative projects in Cornell’s very popular ECE 4760 class. We’ve showcased many of the class’ projects over the years and noted how the course now runs on the RP2040.
Gn En tech