Google Research has developed another generative artificial intelligence (AI) capable of producing short videos by simply entering a prom in text form. Lumiere can not only generate realistic high-resolution images but can also mimic user-provided image styles.
Lumiere can also create animations through user uploaded images. Through the video above, a cinemagraph-like animated image can be produced by Lumiere with the user setting the animation area to be produced such as flowing water or smoke coming out of a train chimney.
Another interesting feature of Lumiere is changing some elements in the video. The type of clothing, shirt color and other elements in the original video can be changed according to the prom entered by the user. Not stopping there, Lumiere can also be directed to completely change the video style of the video. For example, a normal video is changed to a cubism style or like a Lego block.
Through Lumiere, a five-second video at a resolution of 1024×1024 pixels at a rate of 15 FPS can be produced. It is an improvement from Google Imagen from 2022 which generates only 24×24 pixel video at 3FPS rate.