- Luma Labs’ dream machine can now add audio to video clips for free
- You can invite audio or let AI offer something it decides is appropriate
- Sora and other IA video manufacturers are mostly lacking in an Imperfect audio creator to go with their visuals
Luma Labs added a score to the Ai videos produced on his Dream Machine platform. The new feature brings the audio to your video, generated to measure to correspond to an invite written or created by AI, and is based solely on what is happening in the video. This could mean chirping birds on the sunrise scene, a distant buzzing a spacecraft for your science fiction animation, the chaotic clicking of an animated coffee or everything you want to hear.
The new feature is free in beta version for all users. After having generated a video with Dream Machine, you will see a new “Audio” button along the line at the bottom of the video next to the “extends” and “improving” buttons. Click on it and you get two choices: let the AI Decide the best adjusted sounds, or take the wheel and provide a text prompt describing exactly what you want. Perhaps you have a scene of dreamy nature and that you want to hear a distant waterfall, or maybe you want to hear how the fact; Anyway, it works.
To watch
Solid idea
This update is large because the videos generated by AI, although sometimes visually amazing, have always felt incomplete without sound. It’s a lot of work to carefully add audio yourself. Even some of the biggest names in the AI video have not yet audio as an option, including Openai Sora.
Of course, the sound generation of AI is not unique. There are a lot of AI music manufacturers, even producers of voice and songs. But, production in the video linked to video already made Dream Machine a real real. That said, it’s not perfect. You can see it in the way movement and sound do not quite correspond to this dog when it swims.
On the other hand, when it is encouraged correctly, this crackling fire and this laugh of people around it seems quite well.
But, I would not count on Dream Machine to create a single sound without any indication in an prompt. With a virgin audio prompt, AI took the same short clip of people around a fire and offered something much more scary.
