AITodayYour daily AI briefing

Audio & Speech

Jun 2, 2026

Audio & Speech

The Gist

New AI voice cloning tool MOSS TTS 1.5 can copy anyone's voice from a short sample, beating previous models in quality. NVIDIA's speech recognition software was ported to run faster without Python programming, making it easier for developers to use. ElevenLabs released Music v2, which can create songs that seamlessly switch between different music genres like opera and heavy metal.

Today's Stories

  1. 1

    MOSS TTS 1.5 becomes best voice cloning AI model for English speakers

    A new AI model called MOSS TTS 1.5 can clone voices more accurately than previous tools like Fish Audio and Qwen 3 TTS. The model can generate speech that sounds like a specific person after analyzing just a short sample of their voice. Users report the quality can be improved further by adjusting settings like speech duration and voice variation.

    Content creators, audiobook producers, and businesses could use this to generate personalized voice content without hiring voice actors for every project.

  2. 2

    Developer ports NVIDIA speech recognition to run 5x faster without Python

    A programmer converted NVIDIA's Parakeet speech-to-text software to run in pure C++ instead of Python, making it up to 5 times faster on graphics cards and using half the memory. The new version produces identical results to the original while supporting multiple platforms including CPU and various graphics cards. It can process one hour of audio in about 6 seconds on a GPU.

    Apps that convert speech to text could become much faster and more responsive, improving real-time transcription services and voice assistants.

  3. 3

    ElevenLabs Music v2 creates songs that switch between opera and metal seamlessly

    ElevenLabs released Music v2, an AI system that can generate music transitioning between completely different genres within a single song, such as shifting from opera to heavy metal to rap. The new version includes an 'inpainting' feature that lets users regenerate specific sections of a song without affecting the rest of the composition.

    Musicians and content creators can experiment with genre-blending compositions that would be difficult or expensive to produce with human musicians.

  4. 4

    Developers seek better alternatives to Whisper for speech recognition accuracy

    Users are reporting that OpenAI's Whisper Large V3 Turbo, currently the most popular self-hosted speech recognition tool, still falls short of cloud services like AssemblyAI in transcription accuracy. Developers are looking for locally-hosted alternatives that can match commercial services without sending audio data to external servers.

    Businesses handling sensitive audio content may need to wait longer for accurate speech recognition tools they can run privately on their own servers.

  5. 5

    LongCat Video Avatar 1.5 improves AI-generated talking head videos

    Meituan released LongCat Video Avatar 1.5, an upgraded system for creating realistic talking head videos from audio input. The new version uses Whisper-Large instead of Wav2Vec2 for audio processing, resulting in smoother lip synchronization and more natural-looking facial movements in generated videos.

    Virtual presenters, educational content, and customer service videos could become more realistic and engaging without requiring human actors.

What to Watch

Multiple companies are racing to improve voice cloning and speech recognition accuracy while making these tools run faster on local hardware. The competition between cloud-based services and self-hosted solutions will likely intensify as privacy concerns grow.

Sources

Share this with a friend

Send today's roundup to anyone who wants to keep up.

Get daily AI news free with AIToday

200+ AI sources, summarized in 1 minute. Email / LINE / Slack.

Sign up free