AIToday
Large Language ModelsAI Coding AssistantsZenn AI/MLPublished: Oct 6, 2026, 22:00 JST

Developer tests Jev on 300 emails: clear mail sorts, borderline misfires

Developer tests Jev on 300 emails: clear mail sorts, borderline misfires

3 Key Points

  1. What happened

    A developer wired Jev, TypeSafe AI's September 2026 decision-only model, into an iCloud mailbox and sorted roughly 300 emails from the past two months; advertising and bank notices filed correctly, but borderline messages landed in the "needs reply" folder.

  2. Why it matters

    The results suggest Jev can handle clearly-defined categories reliably but struggles with ambiguous judgment calls, so the developer concluded the definition of "needs reply" itself needs clearer rules.

  3. What to watch

    The developer also noted that sorting email could be done with per-address folders, and running a local LLM would avoid privacy concerns, so the value of using Jev here hinges on whether ambiguous categories can be defined well enough.

WHO IT HITSDevelopers and IT staff evaluating AI models for personal or small-scale email triage will see that clearly-defined categories work well, while ambiguous ones need better rules before automation is reliable.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The developer built this tool after seeing a video comparing Claude Sonnet, GPT-Luna, Gemini-Flash, and Jev for email classification. Motivated by wanting to separate newsletters and payment records from mail that actually needs attention, they used IMAP to read iCloud mail read-only and sent each message's sender, subject, and first 3000 characters of body to Jev.

The implementation had two versions: classify.py for judgment only, and sort_applemail.py which added actual folder moves. New mailboxes were created for credit card notices, bank notices, postal notices, advertising, and two "other" categories. The tool opened a browser page where the user could pick a period (7 days, 14 days, or 2 months), start classification, then execute the sorting.

Notably, the developer concluded that little was enabled specifically by Jev, and that simply registering folders by email address, or running a local LLM for privacy, might work just as well. The borderline categories — especially "needs reply" — showed the most room for improvement, suggesting that for now, the value of AI-based email sorting hinges on whether those ambiguous rules can be defined clearly enough.

FAQ
What is Jev?
Jev is an AI model announced by US-based TypeSafe AI in September 2026 that does not generate text or code, but specializes in outputting decisions. It takes states and questions and returns typed probabilistic decisions.
How does Jev's output work?
Jev outputs one of three types: Choice (picking an option), Score (a continuous value), or Noul (Yes/No judgment). For example, given a weather state it returned a JSON with choice "train" at 0.74 probability and confidence 0.82.
How many emails were classified and how did it go?
About 300 emails from the past two months were classified. Advertising and bank notices were sorted correctly into their folders, but the two "other" folders were less reliable, with messages that didn't need replies sometimes landing in the "needs reply" folder.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleSwarmchasers: 400+ track AI agents' online traces