AI agents that search the web today waste tokens fetching and cleaning raw HTML because traditional search APIs return only links and snippets.
A detailed token audit shows that looping through multiple search results costs roughly 4× more than querying a pre-indexed service that returns full documents ready to reason with.
For production agent systems, switching from snippet-based retrieval to complete structured documents cuts the retrieval cost per query and lets agents answer complex questions that require joining data across multiple sources.
What happened
A analysis of how AI agents search the web shows that traditional search APIs returning only snippets and links force agents to fetch and clean raw HTML on every query. Running the same question through three retrieval methods—plain search results, neural search, and a pre-indexed web service—revealed that looping through snippets costs roughly 4× more tokens than accessing full pre-processed documents. For a research task requiring multiple searches, agents repeatedly repay a "retrieval tax" on content they've already seen.
Why it matters
As coding agents and LLM-powered systems move to production, validation shifts from offline tests to live telemetry—meaning agents must handle real-world queries they were never trained on. Web search is how agents stay current with markets, news, and organizational changes, but today's search APIs waste tokens on overhead instead of reasoning. For teams building agent loops (research pipelines, GTM briefings, market monitoring), the choice of search tool directly controls cost and speed—not the model or prompt.
What to watch
Seltz, a purpose-built web index for agents, returns complete structured documents (people profiles, full article text, Wikipedia entries) in a single call rather than forcing agents to reconstruct content from snippets. It works best for deep-dive lookups after discovery is done; chaining discovery queries (open web search) with deep-dive queries (indexed full documents) lets each loop iteration use the right retrieval method for what it's actually trying to do.
Ask the AI about this article →
The article frames a structural mismatch in how AI agents interact with the web. Coding agents have collapsed the cost of software generation, but validation capacity—the ability to catch failures before production—has not kept pace. AI-generated code fails on unknown-unknowns because no human formed a mental model while writing it, forcing validation to happen live on real traffic. The same challenge applies to prompt changes and retrieval-augmented generation (RAG): offline tests cannot predict production breakdowns. This shift to production-first validation demands raw, high-cardinality telemetry that can be sliced after the fact by any attribute the operator needs.
Within that frame, web search emerges as a critical bottleneck for agents dealing with present-day data—market changes, new hires, published news, price updates. The article quantifies a hidden cost: every search call that returns snippets instead of full documents forces the agent to fetch, parse, and clean HTML, repaying this cost on every loop iteration. The token audit (28,700 tokens for three hops through snippets vs. 6,900 for a single query of an indexed document) makes visible the compounding tax on context-window size. The article argues the fix is not a smarter model or prompt, but a change to the search interface itself—returning finished, structured documents so agents reason rather than preprocess.
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
Visko raised $10 million in pre-seed funding from Llama Ventures and opened public access to its first foundat…
U.S. markets ended August higher, with the S&P 500 up 2.6% and the Nasdaq up 3.9%
AI company Runway has unveiled Solaris, the first model in a new category it calls "Interface World Models." I…
Google's AI search gave advice to call emergency services for users alone with an African, Indian, or Pakistan…
John Deere introduced JD, a conversational AI tool that lets farmers ask open-ended questions about their hist…
Nvidia CEO Jensen Huang said on Fox Business that AI is creating 'hundreds of thousands' of jobs, including in…
