Adobe is getting into the music business as the company previews its new experimental generative AI that can create backing tracks.
It doesn’t have an official name yet as the technology is called Project Music GenAI. The way it works, according to Adobe, is that you enter a text prompt into the AI describing what you want to hear; whether it’s ‘powerful rock’, ‘happy dance’ or ‘sad jazz’. Additionally, users can upload music files to the generative engine for further manipulation. There will even be some editing tools in the workflow for on-the-fly adjustments.
If this sounds familiar, it’s because we’ve seen this kind of technology several times before. Last year, Meta launched MusicGen for creating short instrumentals and Google opened the doors to its experimental audio engine called Instrument Playground. But what’s different about Adobe’s tool is that it’s easier to edit, yet more robust – as far as we can tell.
Project Music GenAI is not publicly available. However, Adobe recently released a video on the official YouTube channel shows the experiment in detail.
Adobe in consultation
The clip mainly follows a researcher at Adobe demonstrating what the AI can do. He starts uploading the song Habanera from the opera by Georges Bizet Carmen and then proceeds to change the melody via a prompt. In one case, the researcher commissioned Project Music to create music Habanera sounds like an inspiring film score. And sure enough, the output became less playful and more uplifting. In another example, they gave the song a hip-hop style accompaniment.
When it comes to generating new content, Project Music can even create songs with different tempos and structures. There is a clear demarcation between the intro, verse, chorus and other parts of the song. It can even loop music indefinitely for videos, as well as fade outs for the outro.
No experience necessary
These editing capabilities can make Adobe’s Project Music better than Instrument Playground. Google’s engine has its own editing tools, but they are difficult to use. It seems like you’ll need some production experience to get the most out of Instrument Playground. Project Music, on the other hand, aims to be more intuitive.
And if you must know, Meta’s MusicGen has no editing tools. To make changes, you have to create the song from scratch.
In a report from TheVerge, Adobe states that the current demo uses “public domain content” to generate content. It’s not entirely clear whether people will be able to upload their own files to the final release. Speaking of which, a launch date for Project Music has yet to be revealed, although Adobe will hold its Summit event in Las Vegas early March 26. Still, we contacted the company and asked for information. This story will be updated at a later date.
In the meantime, check out Ny Breaking’s list of the best audio editors for 2024.