Adobe has placed its bets on artificial intelligence. This technology is set to play a pivotal role in the future of its applications, which will now incorporate enhanced features for image and video editing through a tool known as Firefly. At the recent Adobe MAX conference, the spotlight was on several intriguing developments, particularly around experiments that could emerge in upcoming versions of software such as Photoshop and Premiere Pro.
During its annual conference, Adobe introduced Snacks, a series of research projects that debut every year. While some innovations find a permanent place in the Creative Cloud suite, others may fade away into obscurity. This year, AI took center stage in most of these projects, promising to streamline the creative process.
One of the standout projects is Project Frame Forward, a tool designed to significantly reduce the time spent on video editing. During demonstrations, Adobe showcased a remarkable capability: the ability to remove a person or object from an entire video by simply editing a single frame. This means no more tedious work of editing each frame with masks and other correction tools, as AI handles it effortlessly.
How Project Frame Forward works: Adobe’s AI that edits videos with a click
The functionality of Project Frame Forward is quite practical in terms of workflow. First, the tool extracts the first frame from the video for direct editing in Photoshop. Users can utilize tools like Content-Aware Fill to eliminate unwanted elements with the aid of AI.
After editing the frame, users upload the modified image back into the tool. Adobe states that Project Frame Forward will analyze both the original video and the edited frame to make adjustments without compromising quality. To demonstrate its effectiveness, the company conducted two demos, which yielded astonishing results.
In one instance, Adobe successfully removed a car and its smoke trail during a drifting session. This task was particularly complex due to the amount of smoke present in the shot and the dynamic nature of the video. Ultimately, AI reconstructed the track and background without altering quality, color, or introducing artifacts.
Project Frame Forward also supports editing through text instructions. Users can extract a frame and draw a mask over the area where items should be added or removed. Subsequently, it’s as simple as typing a prompt in the designated sidebar text box to generate the object that will extend throughout the video.
A representative from Adobe highlighted that Project Frame Forward provides “interactive video editing with surgical precision” through Photoshop. Unfortunately, the company has not yet confirmed whether this experiment will be integrated into Premiere Pro in the future.
