AIToday
AI Coding AssistantsQiita 機械学習Published: Nov 21, 2026, 10:01 JST

Five Japanese books for moving past scikit-learn and LightGBM

Send on LINE
Five Japanese books for moving past scikit-learn and LightGBM

3 Key Points

  1. What happened

    A practitioner whose offline scores stopped matching click-through rates abandoned scattered blog posts and worked through five books in order — statistics, PRML, Deep Learning, PyTorch実践入門, and Sutton & Barto's Reinforcement Learning.

  2. Why it matters

    For each book he names the concrete gap it closes — cross-validation and bootstrap for flawed evaluation design, the Bayesian framework for reading paper equations, optimization and regularization for diagnosing unstable training.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The starting point is a familiar failure. Comparing scikit-learn and LightGBM scores worked until offline evaluation and click-through rates stopped agreeing, and he could only answer questions with "this setting scored higher." That is what pushed him from blog posts to textbooks, and he notes that reading the first pass in Japanese stuck better, with the original editions consulted on a second pass.

The five books are ordered by stage rather than difficulty: overall map, theory, principles, implementation, then reinforcement learning. He admits getting stuck at the second book and returning to the first, and treats that backtracking as part of why the sequence works. Each entry is pinned to a symptom — equations in papers, unstable training, sample-code tinkering, LLM training methods — so the list doubles as a troubleshooting index rather than a curriculum.

FAQ
Do I need to read all five books?
No. He says pick the one book matching where you are stuck and read only the needed chapters; doing that cut his own rework considerably.
Why is Reinforcement Learning listed last?
It is framed as the step into policy and reward, which he says makes LLM training methods like RLHF and GRPO easier to follow once the basics are in place.
Qiita 機械学習Read Original Article
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleMETR Time Horizon 1.1: frontier models flunk eval design