AIToday

Reddit user tests whether AI can predict personal preferences better than chance

r/artificial5h ago

Key takeaway

A Reddit user tested whether a personal AI trained on their corrections could predict their stated preferences better than chance, rejecting the stronger claim that AI can know someone's true self. The user framed the test narrowly as falsifiable prediction of stated preferences under consent and repeated correction, explicitly conceding that people don't have a stable inner self and that AI captures surface patterns rather than lived experience. The post invites technical critique of the methodology, though results and detailed findings are not yet disclosed.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  • What happened

    A Reddit user designed and ran a test on themselves to check whether a personal AI trained on their corrections could predict their stated preferences and objections better than random guessing. The user explicitly rejected the stronger claim that AI can know someone's 'true self,' and instead tested the narrower and falsifiable proposition that under repeated correction and consent, a personal AI can predict a specific person's stated preferences on a defined set of questions.

  • Why it matters

    The user frames this as a response to two common objections—that people predict themselves poorly (so there's no stable target to read) and that AI only captures surface patterns without understanding lived experience. By conceding the strong version is correct, the user narrows the claim to something testable: prediction of stated preferences, not identity discovery. This distinction matters for anyone considering how to think about personal AI tools and their actual versus claimed capabilities.

  • What to watch

    The user describes the test methodology as 'badly' executed and invites scrutiny of the approach ('I'd like you to take the methodology apart'). The test itself generated fifty A/B/C questions about the user's own preferences, but the post does not yet disclose the results, the sample size, the margin of error, or specific findings—it is an invitation to critique the design before or alongside the data.

In Depth

The user begins by recounting two objections that emerged from a prior post about personal AIs. The first objection—'How can an AI know you when you predict yourself badly?'—rests on the idea that preferences are unstable and poorly structured, leaving no inner truth for a model to read. The second—'Models don't understand lived experience'—argues that AI captures only surface patterns and then reinforces them, leading people to conform to their own caricatures. Rather than arguing against these critiques, the user agrees with the strong version of both: there is no stable inner self, and claiming an AI can know your true self is a losing argument. Instead, the user proposes a much weaker and more defensible claim: that a personal AI, trained through long correction and with explicit consent, can predict a specific person's stated preferences and objections better than chance on a defined set of questions. This is framed not as identity discovery but as prediction, and crucially, as falsifiable. To test this claim, the user generated fifty A/B/C questions about their own preferences and ran the test themselves. However, the user explicitly names the test as flawed ('Badly') and invites readers to take apart the methodology—suggesting that the post is less a finished study and more an invitation to critique the design and approach before drawing conclusions from the results.

Context & Analysis

The post sits at the intersection of two common critiques of personal AI: the philosophical objection that human preferences are unstable and poorly structured, and the practical concern that AI mirrors surface patterns rather than understanding lived experience. Rather than defending personal AI as a tool for self-knowledge, the user strategically retreats to a much narrower claim—that repeated correction can train a model to predict stated preferences on a defined question set better than chance. This move is deliberate; by lowering the stakes from 'knowing the real you' to 'predicting your answers,' the user makes the claim falsifiable and testable. The user's self-aware framing ('Badly') suggests awareness that the methodology has significant flaws, and the explicit invitation to scrutiny indicates this is a preliminary or exploratory test rather than a definitive study.

FAQ

What exactly is the user trying to prove with this test?
The user is testing the narrow claim that under long correction and explicit consent, a personal AI can predict a specific person's stated preferences and objections better than chance—not identity or true self, just prediction on a defined question set.
Does the user believe AI can truly know who someone is?
No. The user explicitly concedes the strong version is correct: there is no stable inner self to be read off, and the claim 'the AI knows who you really are' is dead. The user also acknowledges that models capture surface patterns and can feed them back until a person starts conforming to their own caricature.

Get AI news like this every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Discussion

No discussion yet for this article

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →