sample-generator VS jukebox

yes, Harmon.ai 's Dance Diffusion https://github.com/Harmonai-org/sample-generator

Here's my take. AI is coming, whether you like it or not. In some respects it's already here. Take a look at Dance Diffusion, https://github.com/Harmonai-org/sample-generator a tool that can generate endless new samples for you at the click of a button. We aren't at the point yet where it can generate full songs, but within a few months we will get there. The team that developed Dance Diffusion is doing some amazing work in this space, and I suggest that you learn about it ASAP if you don't want to get left behind. Worrying about stuff like this is ultimately pointless because it's coming whether you like it or not, and while I know it sounds a bit harsh to say, you should learn the tools that are available and use them to your advantage. Think of this more as a creative partner that you can bounce ideas off of, someone to collaborate with. It's just helping you come up with new ideas, not completely replacing you as a producer and engineer. Just relax, and have fun with it.

Harmonai from Stability AI has done a lot of work on music. There is a dedicated Discord , a github for their Dance Diffusion , and even a live 24/7 YT stream of their generated music

Have a look at Dance Diffusion from Harmonai (which is a project from Stability AI). There's also a Discord for it and a Collab for you to try.

That's a good attitude to have, more people should adopt it. Here's a treat for ya https://github.com/Harmonai-org/sample-generator. This is going to be the next big I believe thing once the team finaddles with it some more.

openai/jukebox: Music Generation

https://github.com/openai/jukebox The demo code is there.

I didn't even know about it until I heard Sam Altman casually mention it in an interview, I was expecting some basic tunes generator, but this is so amazing! I mean yeah the voices are not clear, it's muffled, but look at how far have image models progressed, if you applied the same amount of collaborative effort here, the results could be amazing! ElevenLabs showed how good and clear can AI-created voices sound. The only reason I can think of is that the Jukebox code is under view license only.

OpenAI had this figured out 3 years ago: https://openai.com/blog/jukebox/ . You could then even define your own text. Model is open source too.

They've had jukebox for a few years now, so I'm sure some new model will get released and explode overnight, like what chatGPT did.

That already exists

This model is designed to output raw audio.

However, there are many models which do output midi. That's actually much simpler, and has been done already a few years ago.

I thought OpenAI did this. But then, I might misremember, because their Jukebox actually also seems to produce raw audio (https://openai.com/blog/jukebox/).

However, midi generation is so easy, you even find it in some tutorials: https://www.tensorflow.org/tutorials/audio/music_generation