Zuckerberg: Our AI Program Can Create Video From a Line of Text
We’ve seen AI programs that can generate professional-looking still art from a mere line of typed text, but now Facebook parent company Meta is bringing the technology to the video realm.
The company today introduced Make-A-Video(Opens in a new window), which can create short videos from whatever you tell it to. For example, it can generate a clip of a robot surfing an ocean wave, a teddy bear painting a self-portrait, or a spaceship landing on Mars.
Although the video quality is a little low, the results are still stunning, as Meta CEO Mark Zuckerberg showed(Opens in a new window) in a demo. The technology is able to create consistent, realistic-looking images frame by frame, without any major flaws.
“It's much harder to generate video than photos because beyond correctly generating each pixel, the system also has to predict how they'll change over time,” Zuckerberg wrote in a Facebook post(Opens in a new window). "Make-A-Video solves this by adding a layer of unsupervised learning that enables the system to understand motion in the physical world and apply it to traditional text-to-image generation."
Like other AI art programs, Make-A-Video was trained on “text-image data” or existing images that have been labeled with a description explaining the object, person, or setting depicted. But on top of this, the technology was also programmed to study video footage to understand “how the world moves,” Meta says(Opens in a new window).
“With just a few words or lines of text, Make-A-Video can bring imagination to life and create one-of-a-kind videos full of vivid colors, characters, and landscapes,” the company adds. “The system can also create videos from images or take existing videos and create new ones that are
Read more on pcmag.com
