Meta showcases Movie Gen AI, able to turn text prompts and images into short videos with audio

SAN FRANCISCO, Oct 5 — Meta provided a look at a generative artificial intelligence model it is working on that lets people create short videos yesterday, complete with audio, from text prompts and photos.

The tech titan touted Meta Movie Gen as a “breakthrough” when it comes to using an AI engine to crank out video and audio.

Meta said it will get feedback from filmmakers and creators as it eases toward making the video-generating AI engine publicly available.

No release plans for Movie Gen were disclosed.

“While there are many exciting use cases for these foundation models, it's important to note that generative AI isn't a replacement for the work of artists and animators,” Meta said in a post.

The model lets people use text prompts to create custom videos, including clips based on people's photos, of up to 16 seconds long, according to Meta.

“Our model achieves state-of-the-art results when it comes to creating personalised videos that preserve human identity and motion,” Meta said.

“Imagine animating a ‘day in the life’ video to share on Reels and editing it using text prompts or creating a customized animated birthday greeting for a friend and sending it to them on WhatsApp.”

Movie Gen is the third wave of AI-powered video generation at Meta, according to the company.

The rise of AI-powered tools for creating realistic videos has prompted worries about “deepfakes” that pirate people's likenesses. — AFP