AIToday
Large Language ModelsOpen-Source AIHacker NewsPublished: Jul 17, 2026, 13:00 JST4 min read

SAM: free local AI agent that runs offline on your computer

SAM: free local AI agent that runs offline on your computer

Key takeaway

  • SAM is a free, open-source desktop AI agent that lives entirely on your computer, performs real work (web research, file management, terminal commands, email, GitHub), and remembers everything across sessions.

  • Unlike cloud-based AI assistants, it keeps your data local and runs for free using free-tier AI providers (Groq, Cerebras, NVIDIA, DeepSeek, Gemini, Mistral, GitHub Models) that auto-rotate, or fully offline with Ollama.

  • The latest v1.4 release is ~86% cheaper and ~46% faster per task than the previous version, with a smart routing system that always tries the cheapest option first and a 2ms semantic cache for instant answers to repeated queries.

3 Key Points

  1. What happened

    SAM (Smart Artificial Mind), an open-source AI agent platform, launched as a free desktop application for macOS, Windows, and Linux. It runs entirely on your own machine, assembles teams of specialist agents in parallel, and integrates with 178 real tools (web, files, terminal, email, GitHub, calendar, camera). The latest v1.4 release claims to be ~86% cheaper and ~46% faster per task than v1.3, with a "Cascade brain" classifier that routes requests to the cheapest AI provider (free tier first, local Ollama model, or escalates only on failure) and a semantic cache that answers repeated queries in ~2ms using zero tokens.

  2. Why it matters

    Unlike chatbots, SAM performs autonomous action on your computer—researching, remembering, and executing tasks without subscription. All data (keys, memory, vault, documents) stays on your machine; only the prompt goes to the AI provider, and nothing leaves in offline mode. For business users, this combines privacy, zero monthly cost, and a practical alternative to $20/month desktop AI assistants that run in the cloud. It ships with 40 free AI brains (Groq, Cerebras, NVIDIA, DeepSeek, Gemini, Mistral, GitHub Models, and others) that auto-rotate when one hits rate limits.

  3. What to watch

    Installation is one paste (curl or PowerShell command) on macOS/Linux/Windows, or a direct download; it opens on http://localhost:8787 and works free out of the box with no API key required. The app includes a global hotkey (Alt+Space / ⌥Space) to summon SAM from anywhere, an iOS Companion to drop voice/text notes from iPhone, scheduled background tasks (hourly/daily/weekly cron-like routines), and offline mode via Ollama. Code is MIT-licensed and open-source on GitHub (richhabits/sam).

Ask the AI about this article →

Context & Analysis

SAM positions itself as a counter to subscription-based cloud AI assistants by eliminating recurring costs and keeping user data on-device. The core innovation is its "Cascade brain" classifier, which routes each task to the cheapest suitable provider—local model first (via Ollama), then free-tier APIs, escalating only if a cheap answer fails. This approach removes the friction of choosing an API key upfront; instead, SAM tries free options first and rotates across 40 free providers (Groq, Cerebras, NVIDIA, DeepSeek, Gemini, Mistral, GitHub Models, SambaNova, Together, Fireworks, and 20 others). The semantic cache—answering the same question twice in ~2ms with zero tokens—directly addresses a use case most chat interfaces miss: repeated queries on the same topic (e.g., "what did my meeting notes say?").

The comparison to ChatGPT Desktop and typical open-source chat UIs highlights SAM's practical angle: it is not a chatbot alternative, but an autonomous agent that takes real action. Its 178 tools span desktop automation (terminal, files), communication (email, iMessage, calls, GitHub), and sensing (camera with person recognition, voice via Whisper). The team-of-agents feature—assembling specialist workers (research, code, writing, strategy, growth, deals) in parallel—appeals to users with complex tasks that would normally require manual coordination or multiple tool hops. For business users, the combination of privacy (no cloud account, no telemetry, no request to an external API in offline mode), cost ($0/month vs. $20/month for ChatGPT Desktop), and autonomous work capacity positions SAM as both a productivity and compliance win, especially in regulated sectors.

FAQ

Do I need an API key or subscription to use SAM?
No. SAM works free out of the box with no API key, no cost, and no subscription. It ships with access to 40 free AI brains (Groq, Cerebras, NVIDIA, DeepSeek, Gemini, Mistral, GitHub Models, and others) that auto-rotate when one hits a limit, or you can run it fully offline using Ollama.
How does SAM keep my data private?
SAM is local-first: your keys, memory, vault, and documents stay on your machine only. Only the prompt you send goes to the AI brain you choose (and nothing at all in offline/Ollama mode). SAM sends no telemetry and never phones home.
What can SAM actually do on my computer?
SAM integrates 178 real tools: web browsing, file management, terminal commands, email, iMessage, calls, calendar, music, camera and vision, screenshots, GitHub (read, commit, push, pull requests), and background scheduled tasks (hourly, daily, weekly routines). It can also assemble teams of specialist agents to work in parallel on larger jobs.
How much faster and cheaper is v1.4 compared to v1.3?
v1.4 is ~86% cheaper and ~46% faster per task than v1.3, with improved routing that uses ~35% fewer tokens by routing requests to the cheapest brain that fits before escalating to costlier options.

Get the latest Large Language Models news every morning

For example, today's edition would include:

  • Visko raises $10M, launches live AI video model OrbisSiliconANGLE AI · 1h ago
  • Runway unveils Solaris, an AI that generates app interfaces in real timeTHE DECODER · 1h ago
  • Google AI Search flags Facebook users as dangerTHE DECODER · 1h ago

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleAI Safety Seeding Initiative launches to build university groups