Adobe is rolling out three AI audio generation tools—music, speech, and sound effects—across its Firefly platform, all available for commercial use.
The company has also integrated Google's Gemini Omni Flash model, which processes video, audio, images, and text prompts.
These additions expand Firefly's creative capabilities beyond text and image generation, allowing creators to produce complete multimedia content within a single platform.
What happened
Adobe is releasing three AI audio tools — Generate Music (royalty-free music for videos), Generate Speech (script-to-voiceover conversion), and Generate Sound Effects (scene audio) — across its Firefly platform, all cleared for commercial use. Firefly AI Assistant now offers free daily generations, and Adobe has integrated Google's Gemini Omni Flash model, which accepts video, audio, image, and text inputs alongside existing third-party models from Kling AI, Luma AI, and Runway.
Why it matters
The audio tools extend Firefly's creative suite beyond text and image generation, letting creators produce video soundtracks and voiceovers within a single platform without licensing concerns. Gemini Omni Flash's multimodal input (video, audio, images, text) broadens the range of creative tasks Firefly can handle, potentially streamlining workflows for content producers.
What to watch
Adobe reports that "Create Storyboard" and "Create Brand Kit" are among the most-used Firefly features, suggesting demand for integrated creative tooling; uptake of the audio tools will signal whether users adopt these features at similar rates.
Ask the AI about this article →
Adobe's expansion of Firefly with dedicated audio tools addresses a gap in its creative platform. While Firefly already supported text-to-image and image editing, voiceover and sound design typically required separate tools or outsourced work. By bundling Generate Speech, Generate Music, and Generate Sound Effects alongside existing features, Adobe is attempting to consolidate video production workflows—a meaningful efficiency gain for creators who currently switch between multiple vendors.
The integration of Gemini Omni Flash complements this strategy. Unlike single-modality models, Omni Flash's ability to ingest video, audio, and images alongside text means creators can feed raw footage or audio into Firefly and receive creative suggestions or edits without pre-processing. This multimodal capability sits alongside existing partnerships with Kling AI, Luma AI, and Runway, suggesting Adobe is positioning Firefly as an orchestration layer for multiple generative models rather than betting exclusively on its own models.
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytime
Ask AI anything about this article. Q&As are published on this page for other readers too.
Coca-Cola faced consumer backlash in late 2024 for releasing fully AI-generated holiday ads designed to echo i…
Adobe announced general availability of audio generation capabilities in Firefly, its creative AI suite
Scammers are increasingly using AI-powered voice-cloning and deepfake technology to imitate trusted contacts…
Researchers at MIT's Computer Science and Artificial Intelligence Laboratory found that generative AI models t…
A study examining AI-generated images found that many cannot be reliably traced back to their original trainin…
A developer created pagedMark, a tool designed to remove AI provenance markers—both visible labels and invisib…
