How does the system decide what to rank higher?

It combines two embedding spaces: TextEmb, a text-based multilingual encoder fine-tuned on co-engagement triplets via contrastive learning, and IdEmb, an ID-based collaborative embedding trained on interaction-derived positives. At serving time, user representations built from recent watch history generate text- and ID-based similarity scores, which are fed into an XGBoost ranker.

When does personalization help the most?

On short, ambiguous prefix queries (1–3 characters), where NDCG@10 lifts by +8.63%, compared to only +1.46% on longer, more fully specified queries. Users with longer watch histories also benefit more: NDCG lift reaches +4.37% for those with 51–100 prior items versus +2.13% for those with 1–5 items.

What were the real-world results?

In a three-week online controlled experiment, the system delivered +1.14% tap-through rate, +1.23% conversion rate, and a 2.91% improvement in converted-item rank position.

Video GenerationApple Machine LearningJul 17, 2026Jul 17, 2026, 10:00 JST2 min read

Apple TV search gets smarter with personalized ranking from watch history

Send on LINE

Key takeaway

Apple researchers have built a personalization system for Apple TV search that combines text embeddings and user-interaction embeddings to improve ranking as users type.
In offline testing, the system improved search quality metrics (NDCG@10 by 2.99%, MRR by 3.30%) and in a live three-week experiment boosted tap-through rate by 1.14% and conversion rate by 1.23%.
The gains are largest on short, ambiguous queries (like 1–3 character prefixes, where NDCG lifts 8.63%) and for users with longer watch histories, suggesting the system adds the most value when the default ranker is least certain about what the user wants.

3 Key Points

What happened
Apple researchers built a personalization system for Apple TV search that combines text-based and ID-based embeddings to rank results after each keystroke. The system learns from users' watch history and injects similarity signals into an XGBoost ranker; offline testing showed NDCG@10 improved 2.99% and MRR by 3.30% over the baseline, while a three-week online experiment delivered +1.14% tap-through rate and +1.23% conversion rate.
Why it matters
The system is most valuable during the early stages of typing—on short, ambiguous queries (1–3 character prefixes), NDCG@10 lifts by +8.63%, versus only +1.46% on longer, fully-formed queries. Users with longer watch histories see bigger gains (+4.37% for those with 51–100 prior items versus +2.13% for those with 1–5 items), suggesting personalization helps most when the ranking algorithm struggles to guess intent.
What to watch
The approach demonstrates a hybrid strategy (text plus behavioral signals) for search when user intent is still forming. The system's 2.91% improvement in converted-item rank position shows the ranking gains translate to users finding what they want faster in the crucial early keystroke window.

Ask the AI about this article →

Summaries like this, in your inbox every morning.

Get news like this every morning — free

Context & Analysis

Apple's personalization approach addresses a core challenge in search: when users type only a few characters, intent is genuinely ambiguous, and traditional text matching alone struggles to predict what they want. By combining text embeddings (semantic understanding of what the query might mean) with collaborative embeddings (what this specific user has historically engaged with), the system can hedge its bets—it learns from both the query itself and the user's past behavior.

The offline analysis reveals the true power of this hybrid approach: the largest gains occur where the baseline system performs worst. Users with rich watch histories and short-prefix queries see NDCG lifts of +8.63%, because in those moments the ranker has the least confidence. Conversely, longer queries and users with sparse history benefit less, because the baseline already knows what to rank. This pattern—that personalization yields the highest ROI where default ranking is weakest—is precisely when adding user signals is most defensible and effective.

FAQ

How does the system decide what to rank higher?: It combines two embedding spaces: TextEmb, a text-based multilingual encoder fine-tuned on co-engagement triplets via contrastive learning, and IdEmb, an ID-based collaborative embedding trained on interaction-derived positives. At serving time, user representations built from recent watch history generate text- and ID-based similarity scores, which are fed into an XGBoost ranker.
When does personalization help the most?: On short, ambiguous prefix queries (1–3 characters), where NDCG@10 lifts by +8.63%, compared to only +1.46% on longer, more fully specified queries. Users with longer watch histories also benefit more: NDCG lift reaches +4.37% for those with 51–100 prior items versus +2.13% for those with 1–5 items.
What were the real-world results?: In a three-week online controlled experiment, the system delivered +1.14% tap-through rate, +1.23% conversion rate, and a 2.91% improvement in converted-item rank position.

Apple Machine LearningRead Original Article

Send on LINE