Explorer

Nvidia Introduces Fugatto, An AI Tool That Can Turn Text Prompts Into Music, Speech, New Sounds

While other tech leaders like OpenAI, Google DeepMind, and Stability AI have entered the AI audio space, Nvidia claims Fugatto’s ability to generate entirely novel sounds sets it apart.

Nvidia has launched Fugatto, a cutting-edge AI-powered audio editor designed to create original and unique soundscapes. Billed as a “creative breakthrough,” the tool transforms user prompts—text or audio—into imaginative outputs, producing sounds, music, and speech it hasn't explicitly learned. Examples include a trumpet emitting cat-like meows or a saxophone mimicking barking dogs.

With Fugatto, users can craft audio from innovative and unconventional prompts. One example showcased the tool creating a composition titled “Saxophone howling, barking, and transitioning into electronic music with dogs barking.” The AI can also produce intricate audio layers, such as “low, rumbling bass pulses mixed with sharp, digital chirps, evoking the awakening of a massive sentient machine.”

Fugatto Can Go Beyond Music

Fugatto isn’t limited to music creation. Its capabilities extend to:

  • Voice transformation: Modify tones, accents, or emotional delivery, such as shifting a calm voice to sound angry.
  • Music editing: Alter compositions by isolating vocals, adding instruments, or replacing elements—for instance, swapping a piano with an opera singer.
  • Custom sound effects: Generate effects tailored to detailed textual descriptions.

Developed using a dataset comprising millions of audio samples, including contributions from major sound libraries like the BBC’s archives, Fugatto leverages advanced instruction-based models. Nvidia highlights that this approach allows the AI to learn new tasks without requiring additional training data, enhancing its adaptability and creative potential.

A Step Ahead

While other tech leaders like OpenAI, Google DeepMind, and Stability AI have entered the AI audio space, Nvidia claims Fugatto’s ability to generate entirely novel sounds sets it apart. Most existing tools rely on pre-trained datasets, often producing derivative content, whereas Fugatto pushes the boundaries of originality.

AI In Music: Copyright & Controversies

AI in music creation has sparked debates over copyright, with several startups facing legal challenges. Nvidia, too, has been under scrutiny for its training practices, including the use of YouTube video subtitles in its AI models. Although Fugatto’s development drew from millions of audio samples, Nvidia has not disclosed how licensing and copyright concerns are addressed. However, its focus on producing wholly unique outputs might help it navigate potential legal challenges.

ALSO READ: Digital Disconnect: Where Should Artistes Draw The AI Line?

Despite its game-changing potential for artists, filmmakers, and sound designers, Nvidia has yet to confirm if Fugatto will be released for public use. For now, the tool remains a fascinating glimpse into the future of AI-driven audio innovation.

View More
Advertisement
Advertisement
25°C
New Delhi
Rain: 100mm
Humidity: 97%
Wind: WNW 47km/h
See Today's Weather
powered by
Accu Weather
Advertisement

Top Headlines

Video: Dense Layer Of Fog Covers Delhi, Several Flights Affected
Video: Dense Layer Of Fog Covers Delhi, Several Flights Affected
Manipur Violence: Mob Attacks SP’s Office In Kangpokpi Over Deployment Of Central Forces, Cop Among Several Injured
Manipur: Mob Attacks SP’s Office In Kangpokpi Over Central Forces' Deployment, Cop Among Injured
Ramlala Idols To Rs 2-Crore Statues: How Aligarh Is Crafting A New Identity With Brass Work
Aligarh, The City Of Locks, Is Unlocking New Potential With Ramlala Idols
India Slams China’s Announcement Of 2 New Counties In Ladakh, Makes This Request Over Brahmaputra Dam Project
India Slams China’s Announcement Of 2 New Counties In Ladakh, Makes This Request Over Brahmaputra Dam Project
Advertisement
ABP Premium

Videos

Police Lathi Charge on Locals in Madhya Pradesh's DharDelhi Election: PM Modi to Launch Multi-Crore Development Projects, Including Flats and WTCDelhi Election: PM Modi to Announce Crores Worth Development Projects, including Flats and WTCBreaking News: Plane Crashes into Building in California, 2 Dead, 18 Injured

Photo Gallery

Embed widget