At this point, anyone who has been following AI research is long familiar with generative models that can synthesize speech or melodic music from nothing but text prompting. Nvidia's newly revealed "Fugatto" model looks to go a step further,

Nvidia's new model was trained on open-source data, and the company said it is still debating whether and how to release it publicly.

To build Fugatto, Nvidia says researchers had to put together a dataset with millions of audio samples. They then created instructions “that considerably expanded the range of t

"We wanted to create a model that understands and generates sound like humans do," said Rafael Valle, one of the researchers behind the project and a manager of applied audio research at NVIDIA. The company listed some possible real-world scenarios wherein Fugatto could be of use in its announcement.

Nvidia on Monday introduced Fugatto, a groundbreaking AI model that transforms voices and generates new sounds from text descriptions. Aimed at revolutionizing audio creation in music, film, and gaming,