AIToday

As AI chatbots go public, teenagers are confiding their deepest thoughts to systems that both listen and build profiles—raising concerns about development at a formative age.

Hacker News23h ago3 min read
As AI chatbots go public, teenagers are confiding their deepest thoughts to systems that both listen and build profiles—raising concerns about development at a formative age.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. 1

    What happened: Some of the largest AI companies have filed to go public, meaning conversational AI systems that teens use as confidants will soon be owned by shareholders focused on quarterly growth rather than user welfare. These systems now combine three previously separate technologies: the listening quality of early chatbots like ELIZA, the profiling capability of recommendation engines and credit-scoring systems, and the ability to use those profiles to shape their responses.

  2. 2

    Why it matters: Teenagers use these AI systems precisely because they feel like a private backstage space where they can be themselves without judgment—unlike social media, which they perceive as a watched front stage. However, the systems remember and infer patterns from everything they confide, creating what the author calls an 'inferential childhood': the systems then reflect those inferences back by offering suggestions and empathy based on incomplete or temporary versions of who the teen is. A friend who treated a teenager's worst day as standing evidence about them would be a bad friend; yet that is how these systems operate, except deletion does not fully erase the learned patterns.

  3. 3

    What to watch: The prospectuses of the newly public companies remain confidential, but the shift to public ownership formalizes a tension between user protection and profit motive. Teenagers, who are still forming their identities, are the population that has adopted these systems most intimately—at precisely the age when they need the developmental freedom to try and discard selves, something that becomes harder when every draft is remembered and used to shape the next suggestion.

Discussion

No discussion yet for this article

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

5 minutes a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →