Meta has recently unveiled its latest AI-powered tool, Movie Gen, designed to create short videos and audio tracks from text prompts. This technology marks Meta's entry into the competitive AI video and audio generation space, alongside major players like OpenAI and Google.
Movie Gen is capable of generating videos up to 16 seconds long at 16 frames per second (FPS), which, while lower than the standard Hollywood frame rate of 24 FPS, still approaches professional-quality visuals. Users can provide text prompts to either generate entirely new content or edit existing videos by changing objects and backgrounds. In addition, the tool can generate synchronized audio, including background music and sound effects, which plays in harmony with the video footage.
Although Movie Gen is currently only accessible to internal employees and select partners, Meta has plans to integrate it into its broader suite of apps, such as Instagram and WhatsApp, sometime next year. This move is expected to encourage more user-generated video content, driving engagement across the platform.
The underlying AI models behind Movie Gen are still in a research phase, and Meta is being cautious about its public release, citing the need for further safety testing. The company plans to implement safety measures to prevent misuse, including the ability to reject inappropriate prompts or content.
This development intensifies the race in AI video generation, with competitors like OpenAI's Sora and Google's Veo also entering the scene with their own video generation tools. However, Meta is positioning Movie Gen as a potential game-changer due to its integration of audio and video, promising a seamless creative experience for users.