AIToday
AI Business & IndustryZenn AI/MLPublished: Oct 7, 2026, 22:00 JST

J-WORKS blames jworks_fit_score mismatch for off-topic AI picks

J-WORKS blames jworks_fit_score mismatch for off-topic AI picks

3 Key Points

  1. What happened

    After AI candidate selection surfaced off-topic goods such as OS-1, disaster supplies and toilet paper, J-WORKS found seasonal keywords were overriding search terms, and its jworks_fit_score measured demand, reliability and profitability instead of brand fit. Re-scoring under new relevance logic gave all 14 old Rakuten offers a score of 0 and rejected 24 pending content items.

  2. Why it matters

    High scores therefore didn't mean brand relevance, and a brand-fit filter now sits before AI comparison so off-topic candidates are excluded earlier rather than being judged later. Existing Rakuten offers and pending content items had to be re-evaluated separately, since new conditions don't automatically clean up stored data.

  3. What to watch

    The test is whether the front-end relevance filter keeps candidates on-theme without the later approval stage carrying brand-fit judgment, since even a strong score or prompt review is not a guarantee of relevance. J-WORKS also disabled the related periodic candidate-judgment runs, so the older path is not still operating.

WHO IT HITSTeams that pipe AI-generated candidates through a scoring layer should check what the score actually measures and what enters the candidate pool. The article shows a single filter or a scores-based approval step alone does not guarantee brand relevance.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The article walks through the candidate-selection pipeline in order, from search to score to approval, and reports that the skew was not a failure of AI judgment alone. In the search stage, seasonal keywords forcibly overrode the choice of search keywords, so the candidate pool itself leaned toward seasonal general consumer goods. That matters because even a later approval step judging brand relevance would have received mostly off-theme inputs.

At the scoring stage, the name jworks_fit_score suggested a fit score, but the score actually evaluated demand, reliability and profitability. A high score therefore did not mean the candidate fit J-WORKS's themes. The approval prompt also lacked criteria for judging brand fit, so J-WORKS changed the design to insert a mechanical relevance filter before the AI compares candidates, rather than leaving the relevance call to the approval stage.

J-WORKS also re-evaluated existing data under the new logic and adjusted its operating state, disabling the related periodic candidate-judgment runs so the old path did not keep running. The stakes here hinge on whether the front-end filter can keep candidates on-theme on its own, since the article argues that fixing only one stage leaves the same problem at the others.

FAQ
What did the candidate-selection AI actually surface?
It surfaced off-topic general consumer goods such as OS-1, disaster supplies, toilet paper and tissue, even though J-WORKS's publishing themes are AI use, operational efficiency and PC work environments.
Why didn't fixing the approval prompt solve the problem?
The prompt contained no J-WORKS brand-fit criteria, and by that stage the candidate pool was already skewed. J-WORKS instead placed a mechanical relevance filter before the AI compares candidates.
What happened to the old data after the new logic was introduced?
Under the new relevance logic, all 14 old Rakuten offers were scored 0 and excluded, and the 24 pending content items were all rejected.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleopenTPU uses AI to design AI chips, runs Qwen3 on FPGA