AIToday
Qiita 機械学習Published: Oct 9, 2026, 10:00 JST

Andriy Burkov to Hastie: 4 Python ML books, in reading order

Andriy Burkov to Hastie: 4 Python ML books, in reading order

3 Key Points

  1. What happened

    Writing on Qiita, a practitioner whose demand model broke in production — cross-validation had leaked future time-series data — named four books to read in order: Andriy Burkov's "Machine Learning 100+ Pages Essence", the third edition of "Python Machine Learning" by Sebastian Raschka and Vahid Mirjalili, the PyTorch & scikit-learn edition by Raschka, Yuxi Liu and Mirjalili, and Hastie, Tibshirani and Friedman's "The Elements of Statistical Learning".

  2. Why it matters

    He argues the order itself matters, and that a thin overview followed by real code beats a thick theory text first, so a reader who can already write scikit-learn code but treats it as a black box is the intended audience.

WHO IT HITSThis lands on working data scientists and analysts who can already run scikit-learn or PyTorch code but cannot explain why a model behaves as it does on live data — the post frames the gap as conceptual, not a coding-skill gap.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The post opens with a specific failure rather than a book list. The author was solely responsible for an internal demand-forecasting model; its score on validation data was fine, but predictions went wrong in production, and re-reading the code turned up no bug. The cause was the way the cross-validation was split: information from the future of the time series had leaked into the training side. He notes that this kind of mistake is hard to find in fragmented online tutorials, which describe the steps but not why those steps are the steps — what he had been missing, he says, was not implementation skill but the thinking underneath it.

That diagnosis shapes the reading order he recommends. Open a thick theory book first and you give up, he writes; read only light introductory books and you cannot explain the subtle problems that show up in practice. So the sequence runs from a short map of terms and methods, to how algorithms and model evaluation actually work, to writing deep-learning training loops yourself, and finally to statistics. For each title he names the audience: the short overview is not for someone new to programming, the Raschka and Mirjalili book is not meant to be read cover to cover at roughly 1,000 pages, and "The Elements of Statistical Learning" is past 1,000 pages and should be picked through chapter by chapter rather than read whole. He also flags that the two Raschka books overlap on the basics, so if you buy both, the PyTorch edition should come first.

FAQ
What order should I read the four books in?
Big picture first ("Machine Learning 100+ Pages Essence"), then algorithms and evaluation (the third-edition "Python Machine Learning"), then hands-on implementation (the PyTorch & scikit-learn edition), and lastly the statistical foundation ("The Elements of Statistical Learning"). The author gives the same order in a summary table.
Do I need to buy all four?
No. He writes that there is no need to own all four, and suggests starting with the single book that matches the one problem you are stuck on. He adds that in his own case, once he could explain his first failure, the motivation to read the rest appeared on its own.
Which book is for someone who thinks of scikit-learn as a black box?
The third-edition "Python Machine Learning" by Sebastian Raschka and Vahid Mirjalili. The author describes it as the book for people who can write scikit-learn code but still treat its internals as a black box.
Qiita 機械学習Read Original Article

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Next articleClaude Code 2.1.295 adds onFailure: "block" stop rule for hooks