Meta unveils 'Movie Gen', a new movie-making AI model

Meta has unveiled a new AI model called 'Movie Gen'. The new technology can produce custom videos and sounds, edit existing videos, and transform personal images into a unique video through simple text inputs. 

Given a prompt text, Movie Gen can create high-quality and high-definition images and videos. The model also has the ability to generate videos of up to 16 seconds at a rate of 16 frames per second.

Meta expanded the above foundation model to support personalised video generation where it can take a person's image and combine it with a text prompt to generate a video. The generated video will contain the referenced person and visuals informed by the text prompt. 

Don't miss: How AI will impact our planet and how we can embrace green AI

In addition, the editing variant of Movie Gen combines video generation with image editing and will allow users to add, remove or replace elements in the video. It can also change the background or style of the video. 

Finally, the new AI model can take a video and optional text prompts and generate audio up to 45 seconds. This includes ambient sound, sound effects and instrumental background music. 

Furthermore, Movie Gen has an audio extension technique that can generate coherent audio for videos. 

To showcase Movie Gen's capabilities, Meta has released a short film.

In a statement seen by MARKETING-INTERACTIVE, Meta said that generative AI isn't a replacement for the work of artists and animators. 

"We’re sharing this research because we believe in the power of this technology to help people express themselves in new ways and to provide opportunities to people who might not otherwise have them," said Meta. 

"Our hope is that perhaps one day in the future, everyone will have the opportunity to bring their artistic visions to life and create high-definition videos and audio using Movie Gen," added Meta. 

Moving forward, Meta said it will work closely with filmmakers and creators to integrate their feedback. "By taking a collaborative approach, we want to ensure we’re creating tools that help people enhance their inherent creativity in new ways they may have never dreamed would be possible," explained Meta. 

"With creativity and self-expression taking charge, the possibilities are infinite," it added. 

This initiative comes after Meta expanded its suite of generative AI products in May this year. 

The expansion included tools that could create full image variations of original ad creatives and overlay text atop them. 

It also included an image expansion feature which can adjust creative assets to fit different aspect ratios across multiple surfaces.

At the same time, Meta expanded its text-generation offerings for headlines and key selling points. 

Related articles: 
Meta pulls the plug on AR effects platform Meta Sparks
Google and Meta accused of secretly targeting teens on YouTube
Meta apologises for removing PM Anwar's posts