AITodayYour daily AI briefing

Audio & Speech

Jun 4, 2026

Audio & Speech

The Gist

MOSS-TTS 1.5 emerged as the top voice cloning model for English, allowing anyone to create realistic AI voices from short audio samples. ElevenLabs released Music v2 that can seamlessly blend different music genres like opera and metal in a single song. A developer made speech-to-text processing 5x faster by converting NVIDIA's Parakeet model to run without Python programming language.

Today's Stories

  1. 1

    MOSS-TTS 1.5 becomes best voice cloning model for creating realistic AI voices

    The OpenMOSS team released MOSS-TTS 1.5, which can clone voices more accurately than previous models like Fish Audio and Qwen 3. The model can generate speech in multiple languages and allows precise control over speaking duration and pronunciation. It improves on the previous version with more stable voice cloning that produces consistent results across multiple generations.

    Content creators and businesses can now create more realistic AI voiceovers for videos, podcasts, and customer service without needing expensive voice actors.

  2. 2

    ElevenLabs Music v2 creates songs that shift between opera and heavy metal seamlessly

    ElevenLabs launched Music v2, an AI system that can generate music across multiple genres within a single song, transitioning from opera to heavy metal to rap while maintaining musical coherence. The new version includes 'inpainting' technology that lets users regenerate specific sections of a song without affecting the rest of the composition.

    Musicians and content creators can now experiment with genre-blending compositions that would be difficult or expensive to produce with human musicians.

  3. 3

    Developer makes NVIDIA speech recognition 5x faster by removing Python dependency

    A programmer converted NVIDIA's Parakeet speech-to-text models to run in pure C++ without Python, achieving up to 5x speed improvements on graphics cards and processing one hour of audio in roughly 6 seconds. The new version uses less memory and can be quantized (compressed) to run on smaller devices while maintaining identical accuracy to the original.

    Companies can now deploy speech recognition systems more efficiently in real-world applications like call centers and voice assistants without requiring complex Python setups.

  4. 4

    LongCat-Video-Avatar 1.5 improves AI-generated talking head videos with better lip sync

    Meituan released LongCat-Video-Avatar 1.5, which creates realistic talking head videos from audio input with improved lip synchronization. The system uses Whisper-Large audio processing (replacing the previous Wav2Vec2) to generate smoother, more natural mouth movements and can handle long-form video generation while maintaining consistent facial identity.

    Businesses can create more convincing virtual presenters and avatars for customer service, training videos, and marketing content without hiring human actors.

  5. 5

    Developers seek better speech-to-text alternatives to match commercial services

    Users are reporting that current self-hosted speech recognition models like Whisper Large V3 Turbo still lag behind commercial services like AssemblyAI in accuracy, particularly for noisy or multilingual audio. Some developers are building custom pipelines that combine multiple models with audio preprocessing and AI-powered transcript correction to improve results.

    Companies wanting to keep sensitive audio data private may need to accept lower accuracy or invest in more complex setups until better open-source alternatives emerge.

What to Watch

The race between open-source and commercial speech AI models is intensifying, with developers actively working to close the accuracy gap. More companies are likely to release improved voice cloning and speech recognition models in the coming months as competition heats up.

Sources

Share this with a friend

Send today's roundup to anyone who wants to keep up.

Get daily AI news free with AIToday

200+ AI sources, summarized in 1 minute. Email / LINE / Slack.

Sign up free