Nvidia, a global AI chip and software solutions provider, has unveiled Fugatto, an artificial intelligence model designed to bolster the creation and modification of music, sound effects, and other audio content.
The innovative technology is aimed at professionals in the music, film, and video game industries, providing tools to generate original sounds and alter existing audio recordings.
Fugatto, an acronym for Foundational Generative Audio Transformer Opus 1, leverages advanced AI capabilities to create sounds based on text prompts.
It also has the ability to modify existing audio, such as converting piano notes into a human-sung melody or altering the emotional tone and accent in recorded speech. This dual functionality distinguishes it from other generative AI tools available today.
Unlike similar technologies developed by companies like Meta Platforms or emerging startups such as Runway, Nvidia’s Fugatto offers features targeting professionals.
For instance, it can produce imaginative soundscapes—such as a trumpet imitating a barking dog—or craft dynamic audio transitions, like a shift from a thunderstorm to a serene dawn.
Bryan Catanzaro, Nvidia’s vice president of Applied Deep Learning Research, revealed how generative AI could redefine audio production. “Over the past 50 years, computers and synthesizers have significantly changed how music sounds. Generative AI now brings even greater potential to music, gaming, and creative projects for everyone.”
Nonetheless, Nvidia has cautioned regarding Fugatto’s public release. The model, trained on open-source audio data, carries ethical risks, including potential misuse for generating misinformation or violating copyright laws.
“Any generative technology carries risks. We need to be cautious, which is why we don’t plan to release this immediately,” Catanzaro explained.
Concerns over generative AI misuse have prompted Nvidia and other developers to carefully evaluate safeguards before public deployment. The industry is still facing challenges such as unauthorised imitation of protected content and potential legal issues.
While Nvidia’s Fugatto is still unavailable for public use, the announcement comes as generative AI tools for creative industries are gaining more interest. These technologies are seen as important for enhancing content personalisation and offering new possibilities in advertising, education, and entertainment.
Earlier this year, Nvidia briefly surpassed Apple in market valuation, achieving a peak of $3.53 trillion. Its success has been driven by strong demand for advanced chips used in AI applications.
Nvidia’s influence in the sector was further strengthened by its partnership with OpenAI, whose ChatGPT relies heavily on Nvidia GPUs for training.
