This is almost the exact approach I took for my project Neptunely (https://neptunely.com/). Working on bringing it to a VST at the moment so it's more portable.
Abstract: We introduce MusicLM, a model for generating high-fidelity music from text descriptions such as “a calming violin melody backed by a distorted guitar riff”. MusicLM casts the process of conditional music generation as a hierarchical sequence-to-sequence modeling task, and it generates music at 24 kHz that remains consistent over several minutes. Our experiments show that MusicLM out-performs previous systems both in audio quality and adherence to the text descriptions. Moreover, we demonstrate that MusicLM can be conditioned on both text and a melody in that it can transform whistled and hummed melodies according to the style described in a text caption. To support future research, we publicly release MusicCaps, a dataset composed of 5.5k music-text pairs, with rich text descriptions provided by human experts.
I've been building a procedural music generation engine for the last 2 years. It's been a passion project. There are a handful of videos on youtube that showcase it. It can generate pretty good songs and transitions based on established rules. I'm hoping to make it more generally accessible soon, but so far I've just been using it to help me make my music: https://open.spotify.com/artist/3Xtq9IlfA0l3dNPe3lhGAY
I dont think its possible to make a compelling song in quite the same way. At Neptunely, we are pursuing a route that keeps the human in the picture. More of a collaboration. https://neptunely.com
I think this is a good point. To make this useful for music creators, and to make music creation more generally accessible, the output needs to be more useful. We are working on that at https://neptunely.com
I'd love to get connected. I've been working on an online DAW interface to make trying out these models more approachable. It also currently contains many useful heuristic based generative models. https://neptunely.com -- see https://www.youtube.com/watch?v=T93tfPgKhhA for a recent demo of the generative radio station.
The comparison between a ML model and a human is often used but it is not very useful.
The problem is in most of these cases is that a powerful entity is profiting off of other people's work without their consent and gives nothing to the exploited members in return. Sure, an individual human learns from copyrighted works and reincorporates to make something slightly new all the time. And then they may also profit from it and not give anything in return to those that came before.
The problem here is the scale and the power that enables that scale. This is industrial level mining of non-consenting humans, exploiting their life's work in many cases.
I think the problem is that a powerful entity is profiting off of other people's work without their consent and gives nothing to the exploited members in return. Sure, an individual human learns from copyrighted works and reincorporates to make something slightly new all the time. And then they may also profit from it and not give anything in return to those that came before.
The problem here is the scale and the power that enables that scale. This is industrial level mining of non-consenting humans, exploiting their life's work in many cases.
I agree with you. There was no attempt to engage the material of your original post. It was classified as psycho-babble from the outset and thus engaging it seriously would nullify that classification.
If you like this, I’ve been working on something for the last two years that you might be interested in! Imagine Dalle2, but open and interactive and collaborative for musicians in a new type of web-based DAW.
I believe strongly that the creation of music can be much more satisfying than listening to music! This just isn’t accessible to everyone. Some forms of ai generation will be able to encourage this creative and human interactive spirit.
Neptunely (https://neptunely.com) is a collaborative ai music platform that empowers musicians of all levels to jam and find flow in an interactive feedback loop. The way it works is audio to audio generation so you can receive original samples that fit with any track your working on in whatever style you want!
The aim in not to dis-intermediate artists but to enable more artists to exist and explore their unique creations while also empowering existing artist to explore creation of their own models that they can choose to allow others to use. Please feel free to reach out if you want to learn more or get involved!
It would not be as high level, at least initially. It's more querying for distinct layers of a song to compile together.
The tools are intended to be an interaction between the artist and the computer to form a feedback loop similar to what is found when you are able to play an instrument, but more accessible. The idea is that everyone knows what sounds good to them when they hear it, but very few comparatively are currently able to make what sounds good. In the same way that dalle aims to empower everyone to make digital art, neptunely aims to empower everyone to make music.
I'm sorry to hear you're struggling. I've definitely been here a handful of times.
Hope and Help for your Nerves by Claire Weekes is the single best resource I have found for for learning to cope with Anxiety long term. I come back to it any time I find myself in similar patterns to what you describe.
Self compassion is another key coping tool. Being hard on yourself when you are in this state only makes things worse.
I highly recommend finding a therapist (I prefer ACT but traditional CBT is good too) and/or finding medication that works for you. The process of finding the right medication takes time, and cannot be rushed. Often, finding a Direct Primary Care provider trained in integrative medicine and is able to take the time to work with you as you are finding medication that works for you is a smoother path than going to the first psychiatrist you find on google IMO.
Just remember that everyone struggles like this at some point in their life. It is virtually unavoidable. Try to be kind to yourself in this time as you would a good friend. With patience and the right help, you will get past it.