AIToday

SAM: free local AI agent that runs offline on your computer

Hacker News1h ago
SAM: free local AI agent that runs offline on your computer

Key takeaway

SAM is a free, open-source desktop AI agent that lives entirely on your computer, performs real work (web research, file management, terminal commands, email, GitHub), and remembers everything across sessions. Unlike cloud-based AI assistants, it keeps your data local and runs for free using free-tier AI providers (Groq, Cerebras, NVIDIA, DeepSeek, Gemini, Mistral, GitHub Models) that auto-rotate, or fully offline with Ollama. The latest v1.4 release is ~86% cheaper and ~46% faster per task than the previous version, with a smart routing system that always tries the cheapest option first and a 2ms semantic cache for instant answers to repeated queries.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  • What happened

    SAM (Smart Artificial Mind), an open-source AI agent platform, launched as a free desktop application for macOS, Windows, and Linux. It runs entirely on your own machine, assembles teams of specialist agents in parallel, and integrates with 178 real tools (web, files, terminal, email, GitHub, calendar, camera). The latest v1.4 release claims to be ~86% cheaper and ~46% faster per task than v1.3, with a "Cascade brain" classifier that routes requests to the cheapest AI provider (free tier first, local Ollama model, or escalates only on failure) and a semantic cache that answers repeated queries in ~2ms using zero tokens.

  • Why it matters

    Unlike chatbots, SAM performs autonomous action on your computer—researching, remembering, and executing tasks without subscription. All data (keys, memory, vault, documents) stays on your machine; only the prompt goes to the AI provider, and nothing leaves in offline mode. For business users, this combines privacy, zero monthly cost, and a practical alternative to $20/month desktop AI assistants that run in the cloud. It ships with 40 free AI brains (Groq, Cerebras, NVIDIA, DeepSeek, Gemini, Mistral, GitHub Models, and others) that auto-rotate when one hits rate limits.

  • What to watch

    Installation is one paste (curl or PowerShell command) on macOS/Linux/Windows, or a direct download; it opens on http://localhost:8787 and works free out of the box with no API key required. The app includes a global hotkey (Alt+Space / ⌥Space) to summon SAM from anywhere, an iOS Companion to drop voice/text notes from iPhone, scheduled background tasks (hourly/daily/weekly cron-like routines), and offline mode via Ollama. Code is MIT-licensed and open-source on GitHub (richhabits/sam).

In Depth

SAM is an open-source, free desktop application for macOS, Windows, and Linux that implements an AI agent framework running entirely on your machine. The core premise is that most "AI assistants" are chatbots—they talk but do not act. SAM acts: it can browse the web, manage files, run terminal commands, send emails, read and push to GitHub, access your calendar and camera, and execute background routines on a cron-like schedule (hourly, daily, weekly). It remembers everything across sessions via semantic memory and learns your preferences as you use it.

The latest version, v1.4 (called "Game Changer"), introduced three major features. The first is Cascade brain, a classifier that routes each request to the cheapest brain that can answer it. Requests go to your local model first (if Ollama is installed), then cycle through free-tier APIs from Groq, Cerebras, NVIDIA, DeepSeek, Gemini, Mistral, GitHub Models, SambaNova, Together, Fireworks, and 20 others. Only if a cheap answer fails does SAM escalate to a costlier option. This reduces token waste by ~35% and keeps replies free-first. The second is a semantic cache: if you ask the same thing twice, SAM answers from memory in ~2ms using zero tokens. The third is "The life index," which lets you point SAM at folders on your machine; SAM indexes them locally, keeps them fresh, and cites the file in its answers—a parallel to code indexing in Cursor, but for your entire desktop.

Installation is designed for minimal friction. On macOS and Linux, one paste installs and launches: `curl -fsSL https://richhabits.github.io/sam/install.sh | bash`. On Windows, it is a PowerShell equivalent (`irm https://richhabits.github.io/sam/install.ps1 | iex`). Alternatively, you can download the app directly as a .dmg (macOS), .exe (Windows), or clone the source from GitHub and run `npm start`. The app opens on http://localhost:8787 and works free out of the box—no API key, no signup, no cost. If you want to add a free key (Groq, Cerebras, NVIDIA, Gemini, Mistral, GitHub Models), you paste it in Settings; SAM will then rotate across all of them automatically.

For offline use, you install Ollama and point SAM at it; everything runs locally with no cloud call. For iOS, you can drop voice or text notes via iCloud folder, or use Tailscale to reach SAM from any network over an encrypted mesh without opening ports. The desktop app includes a global hotkey (Alt+Space on Windows/Linux, ⌥Space on Mac) to summon SAM from any application, highlight text, and rewrite, summarize, translate, or fix it in place.

The tool ecosystem spans 178 integrations: web (via Playwright or browser control), file system (read, write, search), terminal (run commands with ask-first approval), email, iMessage, phone calls, calendar, music, camera (with face recognition by name), screenshots, GitHub (read files, commit, push, create pull requests), and scheduled tasks. When SAM lacks a tool for a job, it writes one—the "Forge" feature—and saves it disabled for you to review and enable. For riskier actions (sending, deleting, pushing, running commands), SAM asks for explicit approval first, or you can grant a standing "always allow."

SAM is positioned as a free alternative to ChatGPT Desktop ($20/month), which runs in the cloud. SAM's comparison table shows it offers zero cost, runs on your own machine (with full offline capability via Ollama), takes real actions via 178 tools (ChatGPT Desktop is limited), assembles teams of agents in parallel, keeps your data local (ChatGPT Desktop is cloud-hosted), and rotates across ~40 free brains without telemetry. Uninstalling is simple: delete the app folder and the local data folder (~Library/Application Support/SAM on macOS, %APPDATA%\SAM on Windows, ~/.config/SAM on Linux)—nothing is scattered or left behind.

The code is open-source under the MIT license, built in TypeScript with Express and React/Vite, and hosted on GitHub (richhabits/sam). SAM auto-checks for updates on launch and can fast-forward via git pull or an in-app button. Feedback and bug reports are tracked in GitHub Issues and Discussions. All personal data (your name, brands, projects, memory, API keys, voice settings) is stored in gitignored local files, so you can fork and share the code freely without exposing your private world.

Context & Analysis

SAM positions itself as a counter to subscription-based cloud AI assistants by eliminating recurring costs and keeping user data on-device. The core innovation is its "Cascade brain" classifier, which routes each task to the cheapest suitable provider—local model first (via Ollama), then free-tier APIs, escalating only if a cheap answer fails. This approach removes the friction of choosing an API key upfront; instead, SAM tries free options first and rotates across 40 free providers (Groq, Cerebras, NVIDIA, DeepSeek, Gemini, Mistral, GitHub Models, SambaNova, Together, Fireworks, and 20 others). The semantic cache—answering the same question twice in ~2ms with zero tokens—directly addresses a use case most chat interfaces miss: repeated queries on the same topic (e.g., "what did my meeting notes say?").

The comparison to ChatGPT Desktop and typical open-source chat UIs highlights SAM's practical angle: it is not a chatbot alternative, but an autonomous agent that takes real action. Its 178 tools span desktop automation (terminal, files), communication (email, iMessage, calls, GitHub), and sensing (camera with person recognition, voice via Whisper). The team-of-agents feature—assembling specialist workers (research, code, writing, strategy, growth, deals) in parallel—appeals to users with complex tasks that would normally require manual coordination or multiple tool hops. For business users, the combination of privacy (no cloud account, no telemetry, no request to an external API in offline mode), cost ($0/month vs. $20/month for ChatGPT Desktop), and autonomous work capacity positions SAM as both a productivity and compliance win, especially in regulated sectors.

FAQ

Do I need an API key or subscription to use SAM?
No. SAM works free out of the box with no API key, no cost, and no subscription. It ships with access to 40 free AI brains (Groq, Cerebras, NVIDIA, DeepSeek, Gemini, Mistral, GitHub Models, and others) that auto-rotate when one hits a limit, or you can run it fully offline using Ollama.
How does SAM keep my data private?
SAM is local-first: your keys, memory, vault, and documents stay on your machine only. Only the prompt you send goes to the AI brain you choose (and nothing at all in offline/Ollama mode). SAM sends no telemetry and never phones home.
What can SAM actually do on my computer?
SAM integrates 178 real tools: web browsing, file management, terminal commands, email, iMessage, calls, calendar, music, camera and vision, screenshots, GitHub (read, commit, push, pull requests), and background scheduled tasks (hourly, daily, weekly routines). It can also assemble teams of specialist agents to work in parallel on larger jobs.
How much faster and cheaper is v1.4 compared to v1.3?
v1.4 is ~86% cheaper and ~46% faster per task than v1.3, with improved routing that uses ~35% fewer tokens by routing requests to the cheapest brain that fits before escalating to costlier options.

Get the latest Large Language Models news every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →