- Bytedance is showing the new AI Omnihuman video model.
- Omnihuman transforms a single photo into a realistic video of full body.
- The videos show realistic song, talk and movement.
The parent company of Tiktok, Bytedonce, is showing a new video creator of AI who can produce vivid videos of people who speak, sing and move in a single photograph. The new Omnihuman model can give life to an image with mysteriously precise body movements, facial expressions and gestures.
The Omnihuman advance meant training in more than 18,700 hours of video. AI can now imitate how humans move, speak and interact in videos. In particular, this can create completely moving characters instead of just cheering a face or upper body. That means that a single image can become a video of someone who gives a speech, dancing or even touching an instrument.
The result is a very realistic video, whether the character is a human of a photograph or one of a more stylized painting. You can see examples below.
Omnihuman everywhere
Yes and when the Byteye makes Omnihuman available, it is easy to imagine that he explies in Tiktok. The company already offers an AI video called Jimeng on the platform, and something like Omnihuman could attract many more people to play with Tiktok and their other features.
Of course, the Bytedonce will not enter the space without competition. Sora de Openai has drawn praise and is a great name in the video space AI, but there are many others, such as Pika, Runway, Chicken and Luma Labs' Dream Machine.
There is a lot of potential use for the Bytedonce model, either by recreating actors from the past for more films or teaching students' history of simulated mouths of historical figures. Even digital avatars for social networks and games could become more realistic, adapting in real time depending on the user entry.
Omnihuman is still a research project for now, but the fact that the Bytedance already shows its capabilities suggests that practical applications are not far behind. The AI character could then be the next face of a video trend on Tiktok.
