AIToday
Large Language ModelsAI Coding AssistantsHacker NewsPublished: Jul 30, 2026, 01:00 JST

Sitrep: AI Copilot for Incident Response, Wired Into Grafana

Sitrep: AI Copilot for Incident Response, Wired Into Grafana

3 Key Points

  1. What happened

    A developer has built Sitrep, a menu-bar app that screenshots your screen every ~15 seconds during an incident, distills each frame into structured observations using Claude vision, and lets you ask an AI copilot questions like "what was that trace ID I saw five minutes ago?" — then pulls the actual trace from Grafana Tempo to show where the time went.

  2. Why it matters

    During incidents, engineers see hundreds of ephemeral facts across windows (trace IDs, error panels, metric spikes, Slack messages) and lose most when switching context. Sitrep captures and indexes them automatically, letting you search your screen history and correlate observations with backend traces — all without screen permissions or an API key, runnable in mock mode locally.

  3. What to watch

    The app is open-source on Hacker News. It runs on macOS with Node ≥20, integrates via Grafana's datasource proxy (TraceQL for Tempo, PromQL for metrics), and is instrumented with OpenTelemetry GenAI conventions — the copilot's own LLM calls are observable in the same Grafana instance it helps you debug.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

Sitrep addresses a real pain point in incident response: the cognitive load of tracking dozens of fast-moving facts across multiple windows and tools. By automating screen capture and vision extraction, it creates a searchable, timestamped record of what happened on the engineer's screen — indexed locally with no API key required for the search itself. The architecture is deliberately lightweight: the model decides strategy (which tool to call next) but the harness enforces guardrails (validating arguments, scoping Tempo queries to the incident window to avoid silent misses, capping rounds and cost). This separation lets the agent adapt when results are boring without risking hallucinated traces or runaway loops.

The self-instrumentation design is noteworthy: every LLM call the app makes (frame extraction, timeline search, trace fetching, reasoning) is wrapped in OpenTelemetry GenAI spans and sent to the same Grafana instance the app helps you query. This means the copilot's own latency, token usage, and errors are debuggable in the dashboard — turning the tool into an observable system itself rather than a black box. The three deliberate deltas from the GenAI spec (routing app-level operations into sitrep.operation rather than corrupting gen_ai.operation.name, coining sitrep.gen_ai.cost for dollars, and emitting the deprecated gen_ai.system for backward compatibility) reflect pragmatic choices to stay compatible with existing Grafana dashboards while extending the spec.

FAQ
How often does Sitrep capture my screen?
By default every ~15 seconds, but it is configurable from 5 seconds to 5 minutes. You can tap Blackout to stop capture entirely when opening a password manager or other sensitive screen.
Do I need an Anthropic API key to run Sitrep?
You can run it in mock mode with no API key — the UI is the real thing, and the agent loop actually executes against staged data. To connect to a real Grafana stack and ask questions about live incidents, you add an ANTHROPIC_API_KEY to the .env file.
What backends does Sitrep integrate with?
Grafana Tempo (for distributed traces via TraceQL), Prometheus (for metrics via PromQL), and Slack (for incident context). It accesses them through Grafana's datasource proxy using a single URL and credential.
How much does it cost to run Sitrep?
The app shows projected cost per hour in the UI based on your scan cadence and vision model choice — you can switch between Claude Opus 4.8 (sharpest extraction) and Haiku 4.5 (roughly 5× cheaper) live. The timeline search is free and local; only inspect_frame (re-reading a screenshot) spends tokens beyond the model's reasoning turns.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleAlignment researcher proposes 'pre-aligned' AI to reverse safety-capability trade-off