A developer has created LiveTranscriber, an open-source iOS app that runs modern speech and language models completely offline on iPhones.
The app supports multiple models including Whisper, Qwen3-ASR, NVIDIA Nemotron Streaming, and MOSS Multi-Speaker, offering features like offline transcription, real-time translation, and on-device summarization without any cloud connectivity.
What happened
A developer has built LiveTranscriber, an open-source iOS app that runs speech and language models entirely on-device, supporting Whisper, Qwen3-ASR, NVIDIA Nemotron Streaming, MOSS Multi-Speaker, and Qwen3 for transcription, translation, summarization, and analysis.
Why it matters
The app demonstrates that recent open-source models can become practical mobile products rather than research demos. Users get full offline speech recognition, multi-speaker transcription, real-time translation, and transcript analysis without sending audio to the cloud—important for privacy-conscious users and those without reliable internet.
What to watch
The app includes Apple Watch recording with automatic sync, downloadable and switchable local models, and searchable transcript history. The main engineering challenge was optimizing memory management to make models usable on iPhone hardware.
LiveTranscriber is an open-source iOS application designed to bring modern speech and language models to the iPhone while keeping all processing local. Built over the course of a month, the app embodies the premise that recent open-source AI models are mature enough to power practical consumer software, not merely serve as technical demonstrations.
The app's supported models span multiple vendors and use cases. Whisper provides general offline transcription; Qwen3-ASR handles multilingual speech recognition; NVIDIA Nemotron Streaming is optimized for low-latency live transcription; MOSS Multi-Speaker recognizes and distinguishes between multiple speakers; and Qwen3 enables on-device analysis tasks like summarization, key-point extraction, title generation, and transcript analysis. This breadth allows users to choose models suited to their specific workflow.
Key features include 100% offline speech recognition (no cloud dependency), offline multi-speaker transcription, on-device summaries and key-point extraction, real-time translation, Apple Watch integration with automatic sync to the phone, downloadable and switchable local models to balance speed and accuracy, and searchable transcript history stored locally. The engineering challenge was not simply loading and running the models but making them perform acceptably on iPhone hardware—primarily by solving memory management constraints. The open-source release lowers the barrier for other developers to extend or adapt the tool for their own use cases.
The project addresses a practical gap between academic open-source models and consumer-ready mobile applications. While Whisper, Qwen3-ASR, and other models have been available to researchers and developers, adapting them for real-world use on iPhone required solving non-trivial engineering problems—principally memory management on devices with limited resources. The builder's framing of the goal ("not just technical demos") signals that the barrier was not model capability but usability: making inference fast and responsive enough that the app feels natural to use.
The feature set reflects common transcription workflows: offline operation addresses privacy and connectivity concerns; multi-speaker identification adds value over single-speaker models; real-time translation and on-device summarization extend the utility beyond transcription alone. The inclusion of Apple Watch recording and sync suggests thought toward capturing audio on low-power hardware and synchronizing it seamlessly. By making models downloadable and switchable, the app lets users trade off accuracy, speed, and storage based on their needs.
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytime
Ask AI anything about this article. Q&As are published on this page for other readers too.
A new platform called frontier.fast has launched an open competition where anyone can submit code patches to m…
After former lead writer Stella Sacco posted on Bluesky that Saber replaced her with ChatGPT midway through de…
NVIDIA and partners released multiple open-source AI models optimized for local execution throughout August, i…
Gregory Kurtzer, founder of Rocky Linux and co-founder of CentOS, released OpenWALDO, an open-source project d…
Meta released a new open-weight AI model this week—one with publicly accessible core components that users can…
Nvidia released Nemotron 3.5 Lightning, a compact open-weights model with 31.6 billion total parameters (only…
The AI news that matters, in one minute each morning.
Sign up free