AIToday
Large Language ModelsAI Coding AssistantsOpen-Source AIHacker NewsPublished: Jul 31, 2026, 06:00 JST

Collie: local AI coding agent that controls your browser, desktop, and code

Collie: local AI coding agent that controls your browser, desktop, and code

3 Key Points

  1. What happened

    Collie, a coding agent that runs on your machine rather than in the cloud, was released. It can drive your logged-in browser, manage your desktop, record your screen, and edit code — all while keeping data local with no account or telemetry required.

  2. Why it matters

    Unlike cloud-based coding agents that only access files you hand them, Collie works with your real environment (browser session, desktop, files) and verifies its work by running it: it writes a test that must fail on broken code, makes the smallest edit to fix it, and re-runs the test to confirm. This end-to-end verification means wrong edits fail loudly instead of shipping silently.

  3. What to watch

    Collie is available now via Windows installer (one-click download) or macOS/Linux via pip; it supports multiple AI providers (DeepSeek, Claude, OpenAI, Ollama, and others); and includes a built-in benchmark lab so you can measure it against other agents on the same task — no asserted numbers, you run it yourself.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

Collie represents a shift in how AI coding agents approach the problem of fixing code. Traditional cloud-based agents read repositories and edit files, but operate in isolation from the actual runtime context. Collie's core differentiator is that it runs on your machine, which means it can access your logged-in browser session, interact with live websites, observe your desktop in real time, and run tests immediately to verify its work. The verification gate is the technical spine: when Collie fixes a bug, it doesn't just claim success — it writes a test that must fail on the broken code, makes the edit, and re-runs the assertion. This assert-verify loop ensures that a wrong edit triggers another repair attempt rather than shipping silently as "done."

The breadth of capabilities (desktop control, browser automation, screen recording, phone remote, editor integration) exists because Collie's agent built them all, according to the documentation. This is significant: the features are not bolted-on conveniences but demonstrate the harness's strength. A desktop app and iOS companion built by the same reasoning engine that fixes code suggests the underlying system is robust enough to handle real-world tasks end-to-end.

Collie also addresses privacy and control: all data stays on your machine unless you explicitly send it elsewhere. There is no account, no telemetry, and the default is local models or cheap API keys rather than locked-in subscription services. The architecture is intentionally simple — a small, honest harness with clear seams (ModelProvider, ToolRegistry, EmbeddingProvider, SqliteMemory) so each part can be swapped without redesigning the whole system. A built-in benchmark lab lets users measure Collie against other agents on the same tasks, and the documentation is transparent about what does and does not work.

FAQ
How does Collie verify that a fix actually works?
Collie writes a reproduction test with an assert that must fail on broken code, makes the smallest edit to fix it, and re-runs the test. A run is not marked done until the test passes; a plausible-but-wrong edit fails loudly and triggers another repair attempt.
What do I need to install Collie?
On Windows, download and double-click Collie-Setup.exe from the latest release. On macOS or Linux, use pip (pip install -e ".[local,dev]" from a clone; PyPI publish is planned) and run collie setup to pick a provider.
Can Collie work without paying for an API key?
Yes. The core has zero third-party dependencies, and you can run mock (free deterministic testing), Ollama (local, no key), or other local models. Cheap API keys (DeepSeek, Qwen, OpenRouter, etc.) are the default if you choose a commercial provider.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleNew AI Security Leaderboard Ranks Model Robustness Against Jailbreaks