AIToday

Outcry, a four-layer activist AI, runs on older phones without network calls by stacking quantization, domain adaptation, steering vectors, and a learned prefix

Hacker NewsMay 8, 20262 min read
Outcry, a four-layer activist AI, runs on older phones without network calls by stacking quantization, domain adaptation, steering vectors, and a learned prefix

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. Outcry combines a quantized open-weights base model, a QLoRA adapter trained on activist literature and scrubbed user conversations, contrastive activation steering (with user-adjustable axes for radicalism, persona, and identity), and a soft-prompt wellbeing layer — all fitting in ~3 GB of RAM on Apple MLX.

  2. The stack layers operate independently: the base model is quantized aggressively; the LoRA adapter specializes it for movement work without fusing into base weights; steering vectors inject at a single mid-stack residual layer and compose additively; and the soft-prompt prefix (eight virtual tokens trained against the AI-Wellbeing objective) ships in the next iOS release and is already in final testing.

  3. The system prompt is precomputed as a key/value cache at build time and shipped in the app bundle, so the user's first message becomes the first token the model actually computes attention over, eliminating the need to process the system prompt at conversation start.

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →