Writekin: Fine-tune local LLM on your Mac with your own writing

Writekin addresses a specific gap in the AI writing-assistance market: users who want personalization without surrendering their writing data to cloud providers. By running the entire pipeline—ingestion, fine-tuning, and inference—on-device using Apple Silicon, the app avoids the privacy tradeoff many cloud-based writing tools impose. The architecture uses QLoRA (Quantized Low-Rank Adaptation), a parameter-efficient fine-tuning technique that reduces memory and compute requirements, paired with MLX, an Apple-optimized machine learning framework. This technical choice makes the task feasible on consumer hardware (16–32 GB RAM) rather than requiring expensive GPUs or cloud subscriptions.

The transparency model—publishing source code and documenting the architecture—is a deliberate choice to let users verify privacy claims rather than rely on the developer's assertions. Model weights come from Hugging Face, and optional integrations (like Messages export) use open-source tools (imessage-exporter) with checksum verification, lowering the risk of supply-chain compromise. The licensing split (free personal, paid commercial) targets hobbyist and professional writers separately, positioning Writekin as a tool for users who value control over convenience.