Adobe Firefly Video Tested: The Surprising Results

Man, I feel like we’ve all been waiting for Adobe to make its big move in the AI video space. Well, the wait is over! I just stumbled upon this incredible video where an AI professional finally got his hands on the public release of Adobe Firefly Video and put it through an absolutely epic test.

This wasn’t just a quick look, either. The creator ran around 50 different prompts, testing everything from text-to-video to image-to-video, and then compared the results against other major players like Kling, Runway, and Minimax. I was blown away by how thorough this was!

✨ First Look at Firefly Video

The YouTuber breaks down the user interface, which is pretty straightforward. You’ve got your standard options:

  • Aspect Ratio: The usual suspects are all there.
  • Shot Types: Close-up, medium shot, long shot, etc.
  • Camera Angles: Aerial, eye-level, high angle, and more.
  • Motion Control: Options to control camera movement.

This industry pro mentioned that while the buttons are helpful, he prefers just typing the commands directly into the prompt since it feels more natural. A great tip for anyone already comfortable with prompting!

✍️ How Did It Perform?

This is where it gets interesting. The creator tested a huge variety of scenes, and the results were a real mixed bag.

The Wins: For simple prompts like a jungle waterfall or a close-up of a steak being cut, Firefly did a really solid job. It even nailed generating text in a video, perfectly spelling out the difficult word “futurepedia,” which is something many other models struggle with.

🤔 The So-So: When it came to generating people, the results were decent. It managed to create a stylish man walking down a street from a detailed prompt, but it missed a key detail about him having gold teeth.

The Fails: The moment the YouTuber tried a prompt with complex motion, a man shooting a basketball, it all fell apart. He described it as having:

“all sorts of morphing and bad physics.”

It seems high-action scenes are still a major challenge.

🥊 The Ultimate Showdown: Firefly vs. The Competition

This is the part of the video that I found most valuable. The expert didn’t just test Firefly in a bubble; he ran the same prompts across the board to see who came out on top. He tallied up the wins for which tool produced the best clip for each of the 50 prompts.

Here are the final scores the creator came up with:

  • 🥇 Kling: 27 Wins (11 in text-to-video, 16 in image-to-video)
  • 🥈 Minimax: 19 Wins (4 in text-to-video, 15 in image-to-video)
  • 🥉 Adobe Firefly: 17 Wins (7 in text-to-video, 10 in image-to-video)
  • 🏅 Runway: 5 Wins (3 in text-to-video, 2 in image-to-video)

I was genuinely surprised by these results! The innovator declared Kling the overall winner “by far,” with almost three times the wins of the next closest competitor. While Adobe Firefly had some strong moments, especially with text, it just couldn’t consistently beat the quality coming from Kling.

The creator’s final take is that Firefly is a solid tool, but it’s not the one he’ll be choosing most of the time, especially considering the price.

This summary just scratches the surface. For the full, detailed breakdown and to see all the side-by-side video comparisons, make sure to watch the original video from this expert, it’s a must-see!

Scroll to Top