Connect with us

Hi, what are you looking for?

Tech News

Google DeepMind’s new AI tool uses video pixels and text prompts to generate soundtracks

Illustration: Cath Virginia / The Verge | Photos: Getty Images

Google DeepMind has taken the wraps off of a new AI tool for generating video soundtracks. In addition to using a text prompt to generate audio, DeepMind’s tool also takes into account the contents of the video.

By combining the two, DeepMind says users can use the tool to create scenes with “a drama score, realistic sound effects or dialogue that matches the characters and tone of a video.” You can see some of the examples posted on DeepMind’s website — and they sound pretty good.

For a video of a car driving through a cyberpunk-esque cityscape, Google used the prompt “cars skidding, car engine throttling, angelic electronic music” to generate audio. You can see how the sounds of skidding match up with the car’s movement. Another e…

Continue reading…

You May Also Like

Tech News

Rufino Choque, from the Urus Indigenous community, stands over a boat in the middle of the extinct Poopó Lake, which disappeared in 2015. |...

Politics

When word first broke that Joe Biden would be sitting down with Howard Stern for a live interview Friday on his SiriusXM show, it...

Editor's Pick

Paul Best Merry Oaks Baptist Church in Chatham County, North Carolina, near the site of a new VinFast factory. North Carolina officials announced a long sought‐​after...

Editor's Pick

Michael F. Cannon Rena Conti, Richard Frank, and David Cutler recently published a very useful piece in the New England Journal of Medicine under the title,...

Generated by Feedzy