Meta Announces New AI model, Movie Gen that can Generate Video With Sound

Photo of author

By Muhammad Hussain

Meta launched the new AI tool, Movie Gen, that can generate and edit videos with audio in response to simple text prompts.

Key Takeaways

  • Meta launched the new AI tool, Movie Gen, challenging Open AI and Google.
  • It is designed to generate and edit videos with audio in response to simple text prompts. 
  • It creates realistic video clips up to 16 seconds, and audio can be up to 45 seconds long.
  • Meta officials said, “The company is unlikely to release Movie Gen for free use by developers.”
Meta AI logo is seen on phone.

On 4 October Friday, Meta made an announcement and introduced a new AI tool, Movie Gen. It is designed to generate and edit videos with audio in response to simple text prompts. Their new AI model is a direct challenge to the rivals OpenAI and Google. 

The Movie Gen, New Meta AI model can create realistic video clips up to 16 seconds long, with the option to incorporate synced sound effects and music. While audio can be as lengthy as 45 seconds. Additionally, it can modify current videos and create personalized video content using real-life photographs of people.

Meta gave samples of Movie Gen’s productions, which included movies of animals surfing and swimming, as well as videos portraying people executing acts like painting on a canvas.

Likely, in another video, Meta used the tool to alter the parking lot from a dry area where a man was skating to one with a splattering puddle by inserting pom-poms into the hands of the man running alone in the desert.

Meta officials said,

 “The company is unlikely to release Movie Gen for free use by developers, as it has with its Llama series of large-language models, and the dangers are assessed separately for each model. They declined to comment on Meta’s evaluation of Movie Gen specifically.”

However, they stated that 

“Meta was collaborating directly with the entertainment community and other content creators on Movie Gen applications, which will be incorporated into Meta’s own products sometime next year.”

The launch of Movie Gen highlights a growing trend in the IT industry, where firms are investigating AI-powered movie generation to improve user content creation. 

Rivals like OpenAI and Google have also entered this field, with OpenAI unveiling their video-generating tool, Sora, earlier this year, which can create longer videos of up to a minute. Google’s DeepMind has also released a video AI tool called Veo, which adds to the competition.

OpenAI is also poised to maintain its position in the AI industry. Their statement on Thursday that they had obtained a $4 billion revolving line of credit adds to their status as an empire. It attracts investors, bringing its total liquidity to more than $10 billion.

For more AI, cyber security, and digital marketing insights, visit Daily Digital Grind

If you’re interested in contributing, check out our Write for Us page to submit your guest posts!