
What happened
After AI candidate selection surfaced off-topic goods such as OS-1, disaster supplies and toilet paper, J-WORKS found seasonal keywords were overriding search terms, and its jworks_fit_score measured demand, reliability and profitability instead of brand fit. Re-scoring under new relevance logic gave all 14 old Rakuten offers a score of 0 and rejected 24 pending content items.
Why it matters
High scores therefore didn't mean brand relevance, and a brand-fit filter now sits before AI comparison so off-topic candidates are excluded earlier rather than being judged later. Existing Rakuten offers and pending content items had to be re-evaluated separately, since new conditions don't automatically clean up stored data.
What to watch
The test is whether the front-end relevance filter keeps candidates on-theme without the later approval stage carrying brand-fit judgment, since even a strong score or prompt review is not a guarantee of relevance. J-WORKS also disabled the related periodic candidate-judgment runs, so the older path is not still operating.
WHO IT HITSTeams that pipe AI-generated candidates through a scoring layer should check what the score actually measures and what enters the candidate pool. The article shows a single filter or a scores-based approval step alone does not guarantee brand relevance.
Summaries like this, in your inbox every morning.
The article walks through the candidate-selection pipeline in order, from search to score to approval, and reports that the skew was not a failure of AI judgment alone. In the search stage, seasonal keywords forcibly overrode the choice of search keywords, so the candidate pool itself leaned toward seasonal general consumer goods. That matters because even a later approval step judging brand relevance would have received mostly off-theme inputs.
At the scoring stage, the name jworks_fit_score suggested a fit score, but the score actually evaluated demand, reliability and profitability. A high score therefore did not mean the candidate fit J-WORKS's themes. The approval prompt also lacked criteria for judging brand fit, so J-WORKS changed the design to insert a mechanical relevance filter before the AI compares candidates, rather than leaving the relevance call to the approval stage.
J-WORKS also re-evaluated existing data under the new logic and adjusted its operating state, disabling the related periodic candidate-judgment runs so the old path did not keep running. The stakes here hinge on whether the front-end filter can keep candidates on-theme on its own, since the article argues that fixing only one stage leaves the same problem at the others.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
SOMPO Holdings set AI risk governance in March 2025, requiring risk assessment and model output testing for gr…

Exa Enterprise AI began offering "Exabase AI for JA" today, with more than 30 AI agents built for the work of…

Analysts upgraded KLA to a Zacks Rank #2 and raised consensus earnings estimates by roughly 9%, highlighting i…

Dell introduced the XPS 16 Creator Edition and Creator Edition Desktop, both powered by NVIDIA RTX Spark, alon…

Elon Musk said TSMC will not operate the Terafab AI chip complex, per Reuters

Caterpillar and CoreWeave, working with Nvidia, use AI models to annotate and label incoming field data from c…
