Many people are already familiar with generative artificial intelligence technology, whether it helps to write or generate images for inspiration. But generating videos by just entering text proms is still new. We have already seen the capabilities of Sora by OpenAI produced by Hollywood movie creators. Recently, Adobe announced that its Generative AI video-generating feature is coming to Premiere Pro.
For this feature, Adobe has developed the Firefly Video Model language model. It is part of Firefly Image, Vector, Design, and Text Effects Models. Then with Adobe Premiere Pro ready to support a diverse ecosystem of plugins, support for integrating third-party language models such as OpenAI Sora, RunwayML and Pika will also be provided.
Here are the generative AI features Adobe will bring to Premiere Pro;
Generative Expand
Similar to Photoshop's Generative Expand for images, this feature is for adding video to empty space when the Crop tool is used to enlarge the canvas.
Object Addition and Object Removal
Like the Generative Fill feature in Photoshop, this new feature in Premiere Pro can add or remove objects in a video. Interestingly, users don't need to edit each frame of the video because if you do it once, the entire video will be affected.
Generative B-Roll
Adobe says don't waste time shooting b-roll video to fill just a few seconds in a long video. Use generative AI and highlight each other's creativity to generate the most unique b-roll videos that are difficult to do yourself in real life.
Adobe will also use their Content Credential to label their AI-generated videos so that viewers are not confused with the real facts. Adobe still hasn't announced when this new feature will be available and Sora isn't yet available either. If you want to try, Haiper also has AI technology to generate videos. Currently the free account is limited to generating 2 second videos.