XInfer.AI builds independent LLM judge to catch AI fluency masking falsehood

The core insight of XInfer.AI's approach is that fluency and truth are orthogonal. A language model optimizes for sounding helpful and coherent, not for factual accuracy—especially when the claim is plausible and contains true sub-components (like a real diamond clarity grade, SI1, paired with a false consequence). No set of advance rules can catch every such sentence, because the falsehood lives in the relationship between the text and the evidence, not in the text alone. This is why content filters fail: they catch obvious violations (banned words, hallucinated numbers) but miss the dangerous class—claims that are internally coherent and sound authoritative while being unsupported. The company's response was to separate the writing task from the judging task and to assign the judge a different, independent model. The judge's workflow also embeds a key discipline: verdicts must be auditable. Instead of returning a score (which demands trust), the judge lists every claim it evaluated, names the category and evidence path, and shows the false positives it found—turning a black-box opinion into a transparent audit trail. This design choice extends to the boundaries between the three gates. Words like 'flawless' and 'guaranteed' were deliberately not blocked by regex, even though they appear in a banned-word list, because in diamond grading they have literal meanings. The regex gate would have caught the most honest uses ('It is not flawless' as a factual statement about an SI1 stone). The judge, by contrast, can read context and distinguish a marketing claim from an accurate statement. Finally, the discovery that Claude Sonnet 5 outperformed Claude Haiku 4.5 by a factor of twelve on honesty—without sacrificing specificity—is an example of how measurement settles arguments that normally devolve into vendor preference or seniority. The same stones, the same prompts, the same judge: the comparison is repeatable and auditable.