Luma AI launches Dream Machine, an AI-powered text-to-video generation platform

Date:

Luma AI on Wednesday launched its artificial intelligence (AI) text-to-video generation model, Dream Machine, globally. The platform can create videos of up to five seconds from simple or descriptive text prompts. The AI ​​model can create videos in cinematic, animation, realistic, and many other genres. The AI ​​firm claims that Dream Machine was trained entirely on videos, and is capable of creating “anatomically accurate, consistent, and eventful shots.” The platform is currently free to use, but it is likely to have a daily generation limit.

Luma AI introduces the Dream Machine

According to the website, the Dream Machine AI model is built on a Transformer model and was trained directly on videos. Typically, large language models (LLMs) are trained on text and images and then moved to videos, as they require more spatial and motion understanding. “Dream Machine is our first step towards building a universal imagination engine,” the company said.

Dream Machine joins video generation platforms like Runway AI and Pika 1.0 that are also available in the public domain and offer video generation between three to five seconds. Gadgets 360 tried out the platform and found that the platform’s prompt adherence is poor. It struggles with multiple characters or when the prompt is too complex. However, compared to the other two, it is capable of generating high-quality cinematic videos.

The AI ​​platform takes 120 seconds to create a video, which the company claims will consist of 120 individual frames. Dream Machine is also said to understand how people, animals, and objects interact with the physical world and create videos with accurate physics and character consistency.

However, Luma AI also highlighted several limitations in the current mode, such as movement, text, morphing, and the famous Janus problem, where instead of showing a consistent 3D output, the AI ​​model shows multiple canonical views of an object in different directions.

Luma AI’s Dream Machine made a video about Stormtroopers
Photo credit: Luma AI/Dream Machine

Luma AI has not shared any technical details about the AI ​​model, so there is no information about the parameter size, benchmarks, architecture, and training methods. The company also did not share any details about the purchase of training data. Notably, Gadgets 360 was able to create several videos with copyrighted characters.

To try out the platform, enthusiasts can visit the website and click on the ‘Try Now’ button. Users need to sign up for the platform before they can create videos.


Affiliate links may be automatically generated – see our ethics statement for details.

For the latest tech news and reviews, follow Gadgets 360 XFacebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who’sThat360 on Instagram and YouTube.

MiCA crypto framework finalized by European Banking Authority ahead of July deadline

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Share post:

Subscribe

spot_imgspot_img

Popular

More like this
Related

Neo-Nazis rely entirely on AI

Extremists across the US have weaponized artificial intelligence tools...

Paris-based VC Breega achieves first close of $75m Africa fund to support pre-seed and seed startups

Paris-based VC firm Breega has seen Africa’s tech ecosystem...

Today’s Wordle hints, answers and help June 20, #1097

Today's Wordle answer shouldn't be too difficult, but if...