At Adobe MAX 2024, Adobe revealed exciting updates to its Firefly generative AI models. This latest expansion introduces video capabilities, further enhancing its offerings in Image, Vector, and Design models. The standout addition, the Firefly Video Model, now in a limited public beta, marks a milestone as the first commercially safe AI model for video production. Since its beta launch in March 2023, Firefly has generated a staggering 13 billion images, with an impressive surge of over 6 billion in just the past six months.
The new Firefly Video Model enriches Adobe’s generative AI toolkit, which includes existing Image, Vector, and Design models. This comprehensive suite caters to the diverse needs of creative teams aiming to optimize their content creation processes. Currently, the video model is available to a select group of creative professionals for testing and feedback.
In less than a year, Firefly has integrated into major Adobe applications like Photoshop, Illustrator, Substance 3D, and Express, enhancing various workflows across Creative Cloud. With the ability to process text prompts in over 100 languages, Firefly empowers users worldwide to craft visually stunning and commercially viable content.
Here are some of the key new features now rolling out in Creative Cloud:
- Generative Extend (beta) in Premiere Pro: This feature is a game changer for video editors, allowing them to seamlessly fill gaps in footage, smooth transitions, and extend shots for polished edits.
- Text to Video & Image to Video (beta): These capabilities enable users to generate videos from text prompts, offering various camera controls such as angle, motion, and zoom. Additionally, creators can turn static images into vibrant live-action clips.
- Firefly Image 3 Enhancements: Users can now create images up to four times faster than before, available via the Firefly web app.
- Generative Workspace (beta) in Photoshop: This innovative environment allows designers to brainstorm and iterate their ideas rapidly and intuitively.
- Firefly Vector Model (beta) in Illustrator: New features such as Generative Shape Fill, Generative Recolor, and Text to Pattern empower designers to produce detailed vectors with enhanced control over element density.
In a forward-thinking move, Adobe also previewed Project Concept, a collaborative tool for real-time creative development. This feature allows multiple professionals to remix images on a shared canvas, fostering creativity and collaboration.
For enterprises, Adobe introduced new functionalities within Firefly Services, including Dubbing and Lip Sync in beta. This feature uses generative AI to translate spoken dialogue into different languages while ensuring the original voice’s tone and lip movements remain in sync. The Bulk Create function further streamlines high-volume image editing tasks, such as resizing and background removal.
Adobe Firefly has gained traction with leading brands like PepsiCo, IBM, Mattel, IPG Health, and Deloitte, allowing them to optimize their creative workflows and scale content production. By embracing Firefly, these companies enable their teams to focus on innovation and creative exploration, paving the way for groundbreaking ideas in content creation.