- Bytedance shows the new Omnihuman ai video model.
- Omnihuman transforms a single photo into a completely body video.
- The videos show realistic song, word and movement.
Tiktok’s parent company, Bytedance, shows a new AI videos creator who can produce live videos of people who speak, sing and move with a single photograph. The new omnihuman model can bring an image to a strangely precise body movements, facial expressions and gestures.
The breakthrough of Omnihuman involved training on more than 18,700 hours of video. AI can now imitate how humans move, speak and interact in videos. In particular, this AI can create characters entirely in motion rather than simply animating a face or upper body. This means that one image can be transformed into a video of someone who gives a speech, dancing or even playing an instrument.
The result is a very realistic video, whether the character is a human of a more stylized photograph or painting. You can see examples below.
Omnihuman everywhere
If and when bytedance makes Omnihuman available, it is easy to imagine exploding it on Tiktok. The company already offers an AI video manufacturer named Jimeng on the platform, and something like Omnihuman could encourage many more people to play with Tiktok and its other features.
Of course, Bytedance will not enter into space without competition. OpenAi’s Sora has drawn distinctions and is a big name in AI video space, but there are many others, such as Pika, Runway, Pollo and Dream Machine by Luma Labs.
There is a lot of potential use for the Bytedance model, whether actors of the past for more films or teaching students in the history of simulated mouths of historical figures. Even digital avatars for social media and games could become more realistic, adapting in real time depending on the contribution of users.
Omnihuman is always a research project for the moment, but the fact that Bytedance already presents its capacities suggests that practical applications are not far behind. The character of the AI below could be the next face of a video trend on Tiktok.
