
What happened
In a 20-case dummy-restaurant test built by one writer, TypeSafe AI's Jev picked the right cause for 18 stores versus 15 for Ollama's llama3:8b, and gave the same answer on all three tries for 20 of 20 cases.
Why it matters
Jev's confidence could be used directly — high-confidence calls held up and low-confidence ones did not — so a business could auto-accept the confident verdicts and send only the doubtful ones to an LLM or a person.
Summaries like this, in your inbox every morning.
Jev is a different kind of model from a chatbot: TypeSafe AI's "System One" model, released on September 15, 2026, does not generate text at all. You hand it an app's state (text or JSON) and a typed question, and it returns an answer drawn only from a predefined set of choices, plus probabilities and a confidence value. The question types are Choice, Score, and Noul. Because the answer must come from the defined options, it cannot invent a nonexistent answer — though it can still pick a wrong one.
The author's step-by-step experiment shows why input design moved the result more than the model did. When a prior-month rainy-day count was missing, Jev leaned toward weather at 0.65 and menu at 0.29; adding that one line pushed weather to 0.99 — but it also crushed the menu cause to 0.01. Because Choice asks for a single main cause, a second cause gets starved of probability. Asking about each cause separately with Noul brought the menu cause back up to 0.41. In a later round, the menu score fell again until the author added a menu_changed_this_month flag; the phrase "a major factor" versus "one of the factors" barely moved the number. The underlying problem was that the data recorded a drop in spend per customer but never stated that the menu had changed — the model could not infer a cause its input did not support. One acknowledged limitation: the change-rate inputs and the rewritten question were altered in the same round, so their individual effects are not separated.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
DeepSeek released DeepSeek-V4.1-Flash-1017, a “minor update” that reduces task execution time and output lengt…
NEC's Kei Noguchi described how employee engagement fell to 19%, with 8 in 10 staff saying they wanted to leav…

Anthropic's internal report says entry-level workers fell from 21% to 14% of technical staff, and entry-level…

Simon Willison shipped llm-echo 0.5, a debug plugin whose "echo" model involves no LLM at all and just repeats…

On October 13 (US time), Apple announced HomeView, a $299 smart home display running Siri AI and HomeKit but w…

The author detailed a Python script that uploads MP3 audio to Google Cloud Storage (GCS), transcribes it with…
