
What happened
A developer built an inquiry-desk bot for a fictional tax accountant's office on Next.js 16 and the Anthropic API, embedding all 15 FAQs straight into the Claude Haiku 4.5 system prompt with no vector search or database.
Why it matters
The developer judged that embedding all 15 FAQs in the prompt each time kept both accuracy and cost sufficient, making the added setup of a retrieval setup unnecessary at this scale.
What to watch
The approach hinges on the developer's stated boundary of roughly dozens to about a hundred FAQs before token costs make the current design impractical. Watch whether the planned move to a database and embedding-based retrieval follows once that threshold is crossed.
WHO IT HITSThis is most relevant to developers and small professional-services firms weighing whether to build retrieval infrastructure for a limited FAQ set; the author's experience suggests that below a few dozen FAQs, a direct prompt-embedding approach may be adequate, with a switch to a more complex setup deferred until volume grows.
Summaries like this, in your inbox every morning.
The project was intended as a small, working proof of concept for selling generative-AI adoption support to professional-services firms, a field the developer says is hard to win trust in without real examples. The tax-accounting domain was picked because almost every office has a front-line inquiry desk, and the constraint of never giving a wrong answer is easy to grasp. The system prompt steers the model to rephrase only what is in the FAQs; anything outside them, such as individual tax calculations or specific numerical simulations, is treated as a case for a human, with the bot directing the user to a contact form. The developer deliberately kept the scope narrow to two choices — answer from the FAQ or hand off — and reports no significant stumbling blocks, attributing that to the simple architecture and limited scope rather than to any inherent ease. The stated plan is to decouple FAQs from code into a database, add an admin interface for office staff, and move toward embedding-based retrieval as volume grows, with the trigger being whether all FAQs can still be passed in every time without practical trouble.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
ElevenLabs completed a $300 million employee tender at a $22 billion valuation, and co-founder Mati Staniszews…

On October 15, OpenAI announced the Rosalind Academic Plan, giving approved US university labs free access to…

A Qiita article compared automated red-teaming methods for LLM apps — GCG, PAIR, and TAP — using mock implemen…

Liquid AI released d1-ultra on October 15, 2026, an upgraded open-weights decision model that averaged 76.7 ac…

Circlia started a proof-of-concept for TASTE SIGNAL: visitors to Holland Village Cafe FUKUOKA taste cookies an…

In a webinar hosted by French Mathematical Society president Isabelle Gallagher, Fields Medal winner Hugo Dumi…
