It is fairly common knowledge in the creative community that Adobe has been looking at ways to use machine learning to optimise editing workflows in Photoshop, Lightroom and Premiere. At its annual Adobe MAX creative conference, they teased work-in-progress “cutting-edge, experimental technologies that could someday become features in Adobe products“.
Project Fast Fill for video incorporates Generative Fill and Firefly and allows users to enter simple text prompts to remove or add an object or change background elements in a video sequence. The edit is applied to one frame, then the tool talkies over and automatically applies it to all of the frames of the video. It also automatically adjusts for lighting changes, shadows, the object moving and so on.
Source: ZDNet