Imagine being able to create high-definition videos with just a text prompt, an image, or an existing video as input. Thanks to Meta’s new AI tool, Movie Gen, this is now a reality. This innovative tool can automatically generate videos, edit them, and even add AI-generated sound for a seamless video clip experience.
But Movie Gen doesn’t stop there. Users also have the option to personalize their videos by adding a personal picture, allowing them to see themselves in the video. And to top it off, you can create a custom audio soundtrack by simply typing in a text prompt.
A peek into a video Meta Movie Gen created from an image. Credit: Meta
While Meta claims that Movie Gen’s videos are “the first of its kind in the industry,” there are still some limitations to consider. The AI can currently only generate videos up to 16 seconds long, and there may be occasional mistakes in its assignments, as demonstrated by a mishap with a dog in a park scenario.
? Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date.
Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in… pic.com/NDOnyKOOyq
— AI at Meta (@AIatMeta) October 4, 2024
In a Threads post, Chris Cox, Meta’s chief product officer, highlighted the industry-leading quality of Movie Gen’s videos. However, the tool is not yet available to the public due to cost and time constraints in video generation.
Despite these challenges, Meta continues to share its progress with Movie Gen, acknowledging the impressive outputs they have achieved so far. This cutting-edge technology is pushing boundaries in the world of AI-generated video content.
Meta is not the only player in the game, as OpenAI’s text-to-video model, Sora, made waves earlier this year. In partnership with artists and entrepreneurs, OpenAI showcased Sora’s capabilities by creating fantastical short films through YouTube videos.
As the AI landscape continues to evolve, tools like Movie Gen and Sora are revolutionizing the way we interact with video content. Stay tuned for more exciting developments in the world of AI-generated media!