AIToday
Large Language ModelsAI Coding AssistantsZenn AI/MLPublished: Oct 23, 2026, 01:00 JST

graphify measured at 37.7x token savings, short of 71.5x

Send on LINE
graphify measured at 37.7x token savings, short of 71.5x

3 Key Points

  1. What happened

    The author ran graphify on a 90-file repo with --code-only; the full graph built in under 2 seconds with no LLM calls, and the official benchmark reported 37.7x fewer tokens per query.

  2. Why it matters

    Against a realistic grep-and-read workflow the advantage shrank to about 7x, and the natural-language query command failed on Japanese input—so benchmark figures appear to depend heavily on what they are compared with.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The test ran graphify against the author's own ai-100days repository, which held 22 days of experiment code across 90 code files. Building the graph with --code-only produced 914 nodes, 1,657 edges and 56 communities, and skipping 242 non-code files kept the process entirely offline. That confirms the tool's core promise of deterministic, local parsing without paid API keys or a GPU.

The gap between the benchmark and everyday use comes down to the baseline. The official benchmark compares against reading a 45,700-word corpus naively at roughly 60,933 tokens, yielding the 37.7x figure. When the author instead measured a specific question—where KronosPredictor is defined and used—the realistic approach of grepping and reading only the relevant lines cost about 1,799 tokens, versus about 242 for graphify explain, a roughly 7x difference. The author notes the case was relatively simple and that more tangled cross-references could widen the gap, but no measurement approached 71.5x.

Two caveats emerged during testing. The query command, marketed as natural-language search, returned irrelevant nodes for Japanese and failed to trace callers in English. The author also observed node counts shifting nondeterministically after running graphify update, recorded in the repository logs, and advises against treating exact node counts as a strict metric.

FAQ
Does graphify need an API key or GPU?
No. With the --code-only option, code parsing runs locally via tree-sitter, and the test built a graph of 90 code files in under 2 seconds with no LLM API calls and no external transmission.
What is the correct package name to install?
The PyPI package is graphifyy, with a double y. The README notes that other graphify* packages are unrelated, so name collisions are a risk.
Did the natural-language query feature work?
Not reliably. A Japanese query was ignored and returned 12 unrelated nodes from a different experiment, and an English query returned only the seed node; the author found graphify explain with a direct node name more dependable.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleAnthropic launches Claude Duet agent app for Pro and Max users