Audio & Speech
Jun 4, 2026

The Gist
MOSS-TTS 1.5 emerged as the top voice cloning model for English, allowing anyone to create realistic AI voices from short audio samples. ElevenLabs released Music v2 that can seamlessly blend different music genres like opera and metal in a single song. A developer made speech-to-text processing 5x faster by converting NVIDIA's Parakeet model to run without Python programming language.
Today's Stories
- 1
MOSS-TTS 1.5 becomes best voice cloning model for creating realistic AI voices
The OpenMOSS team released MOSS-TTS 1.5, which can clone voices more accurately than previous models like Fish Audio and Qwen 3. The model can generate speech in multiple languages and allows precise control over speaking duration and pronunciation. It improves on the previous version with more stable voice cloning that produces consistent results across multiple generations.
Content creators and businesses can now create more realistic AI voiceovers for videos, podcasts, and customer service without needing expensive voice actors.
- 2
ElevenLabs Music v2 creates songs that shift between opera and heavy metal seamlessly
ElevenLabs launched Music v2, an AI system that can generate music across multiple genres within a single song, transitioning from opera to heavy metal to rap while maintaining musical coherence. The new version includes 'inpainting' technology that lets users regenerate specific sections of a song without affecting the rest of the composition.
Musicians and content creators can now experiment with genre-blending compositions that would be difficult or expensive to produce with human musicians.
- 3
Developer makes NVIDIA speech recognition 5x faster by removing Python dependency
A programmer converted NVIDIA's Parakeet speech-to-text models to run in pure C++ without Python, achieving up to 5x speed improvements on graphics cards and processing one hour of audio in roughly 6 seconds. The new version uses less memory and can be quantized (compressed) to run on smaller devices while maintaining identical accuracy to the original.
Companies can now deploy speech recognition systems more efficiently in real-world applications like call centers and voice assistants without requiring complex Python setups.
- 4
LongCat-Video-Avatar 1.5 improves AI-generated talking head videos with better lip sync
Meituan released LongCat-Video-Avatar 1.5, which creates realistic talking head videos from audio input with improved lip synchronization. The system uses Whisper-Large audio processing (replacing the previous Wav2Vec2) to generate smoother, more natural mouth movements and can handle long-form video generation while maintaining consistent facial identity.
Businesses can create more convincing virtual presenters and avatars for customer service, training videos, and marketing content without hiring human actors.
- 5
Developers seek better speech-to-text alternatives to match commercial services
Users are reporting that current self-hosted speech recognition models like Whisper Large V3 Turbo still lag behind commercial services like AssemblyAI in accuracy, particularly for noisy or multilingual audio. Some developers are building custom pipelines that combine multiple models with audio preprocessing and AI-powered transcript correction to improve results.
Companies wanting to keep sensitive audio data private may need to accept lower accuracy or invest in more complex setups until better open-source alternatives emerge.
What to Watch
The race between open-source and commercial speech AI models is intensifying, with developers actively working to close the accuracy gap. More companies are likely to release improved voice cloning and speech recognition models in the coming months as competition heats up.
Sources
- Moss tts 1.5 8b Examples. It is the currently best voice cloning model for English as of June 2026
- What's the status of non-CUDA inference?
- I ported NVIDIA Parakeet (speech-to-text) to ggml: same output as NeMo, faster, GGUF-quantized, no Python
- ElevenLabs Music v2 promises opera-to-metal transitions without losing musical coherence
- OpenMOSS-Team/MOSS-TTS-v1.5 · Hugging Face
- Self-hosted STT better than Whisper Large V3 Turbo that matches AssemblyAI quality?
- Best architecture for seamless Bilingual TTS? (Azure / English + Korean) [D]
- My pipeline for the best speech to transcript results
- You can't whisper at an AI agent
- meituan-longcat/LongCat-Video-Avatar-1.5 · Hugging Face
Share this with a friend
Send today's roundup to anyone who wants to keep up.
Get daily AI news free with AIToday
200+ AI sources, summarized in 1 minute. Email / LINE / Slack.
Sign up free