OpenAI's Sora, your equivalent of image creation but for video, caused quite a stir in the rapidly advancing world of AI last month, and we just captured some new videos that are even more amazing than the ones we've already seen . .
In case you missed it, Sora is a text-to-video AI, meaning you can type a simple request and it will compose a video (just like generating images worked before, but obviously it's a much more complex task) .
Now, OpenAI's Sora research lead Tim Brooks has posted new Sora-generated content on X (formerly Twitter).
This is Sora's chance to fulfill the following request: “Fly through a museum with many paintings, sculptures, and beautiful works of art of all styles.”
Pretty impressive to say the least. In addition to that, Bill Peebles, also Sora research leader, showed us a clip generated from the following message: “An alien that blends naturally with New York City, paranoia thriller style, 35mm film.”
Then, content creator Blaine Brown stepped in to embellish the clip above, cutting it to repeat the footage and make it longer, while the alien rapped, complete with lip-syncing. By the way, the music is generated by Suno AI (with lyrics written by Brown, of course), and the lip syncing is done with Pika Labs AI.
This Sora clip is 🔥 when the alien guy breaks out into a lip-synced rap about how hard it is to be different from everyone else. Workflow in the thread.@suno_ai_ @pika_labs (lip sync) Stay away 🆙🔊🔊 pic.twitter.com/kc5FI83q5RMarch 3, 2024
Analysis: It's still early for Sora
It's worth underlining how quickly things seem to be progressing with AI capabilities. Imaging powers were one thing (and extremely impressive in and of themselves) but this is completely different. Especially when you remember that Sora is still in testing at OpenAI, with a limited set of 'red teams' (testers who look for bugs and smooth out those wrinkles).
The camera work on the museum tour flows realistically and feels very imaginative in the way it pans (albeit with the occasional judder). And the latest tweet shows how you can take a base clip and flesh it out with content that includes AI-generated music.
Of course, AI can also write a script, so the question arises: how long will it be before a blue alien stars in an AI-generated post-apocalyptic drama? Or maybe an (unintentional) comedy?
You get the idea, and we're getting carried away, of course, but still, frankly, what AI could be capable of in just a few years is potentially mind-blowing.
Naturally, we'll see the best of what Sora is capable of in these trailers, and some strange and buggy efforts have aired as well. (Just like when ChatGPT and other AI chatbots first appeared on the scene, we saw AI hallucinations and deranged behavior and responses in general.)
Perhaps the broader concern with Sora, however, is how this could eventually displace, rather than help, content creators. But that's a fear we need to discuss for another day, not forgetting the potential for misuse of AI-created videos, which we recently looked at in more depth here.
you might also like
