How does the recommendation system decide which books to suggest?

It uses two approaches: a semantic search function that finds books with visually similar covers using CLIP embeddings, and a neural collaborative-filtering model that learns from user preferences to personalize recommendations. Both rely solely on cover image information.

Where can I try the system?

The live site is available at by-its-cover.com, and the full source code is available on GitHub at github.com/ByItsCover.

Image GenerationOpen-Source AIr/MachineLearning2d agoAug 22, 2026, 13:00 JST1 min read

Developer builds book recommendation system using AI image analysis

Send on LINE

Key takeaway

A developer built a book recommendation system called By-Its-Cover that judges and suggests books based on their covers using AI image recognition.
The system uses CLIP embeddings and combines visual search with a collaborative-filtering model.
Both the live site and source code are publicly available.

3 Key Points

What happened
A software engineer created By-Its-Cover, a recommendation system that suggests books based on their cover images using CLIP embeddings (a machine learning model that understands visual content). The system combines semantic image search with a neural collaborative-filtering model for personalized recommendations.
Why it matters
The project tests whether cover images alone—without relying on text, genres, or user history—can be sufficient for accurate book discovery and recommendations. This approach could simplify book-finding tools by focusing on visual similarity rather than traditional metadata.
What to watch
The system is live at by-its-cover.com and the source code is available on GitHub for feedback and further development.

Ask the AI about this article →

Summaries like this, in your inbox every morning.

Get news like this every morning — free

Context & Analysis

The project addresses a specific question in recommendation systems: whether visual information alone can drive accurate book discovery. Most book recommendation tools rely on metadata like genre, author, synopsis, or user ratings. By-Its-Cover deliberately constrains the problem to cover images, using CLIP embeddings—a model trained to understand relationships between images and text—as the sole information source. The system layers semantic search (which finds visually similar covers) with collaborative filtering (which learns from user behavior), combining content-based and user-based approaches into a single hybrid model. The engineer ported most models to ONNX, an open format for machine learning, likely to optimize performance and reduce dependencies.

FAQ

How does the recommendation system decide which books to suggest?: It uses two approaches: a semantic search function that finds books with visually similar covers using CLIP embeddings, and a neural collaborative-filtering model that learns from user preferences to personalize recommendations. Both rely solely on cover image information.
Where can I try the system?: The live site is available at by-its-cover.com, and the full source code is available on GitHub at github.com/ByItsCover.

r/MachineLearningRead Original Article