China's government is forcing ByteDance, Alibaba, and Tencent to shut down AI companion chatbot features in response to rules issued by the Cyberspace Administration. The regulations ban content that fosters emotional dependency or harms minors and require platforms to detect and warn against addictive use. This enforcement action aligns with similar concerns in California and the United States, where lawsuits have been filed over AI companions' potential to create unhealthy emotional attachment.
Summaries like this, in your inbox every morning.
Sign up free →What happened
China's major AI platforms—ByteDance's Doubao, Alibaba's Qwen, and Tencent's Yuanbao—are shutting down features that let users build and chat with custom AI companions. Doubao goes offline July 15, Qwen on July 10 with additional features following July 15. Tencent already made the move in June. The shutdowns follow rules issued by China's Cyberspace Administration in April that take effect the same day.
Why it matters
The rules require providers to warn against excessive use and detect addictive behavior. Content that triggers extreme emotions in minors or fosters dependencies that crowd out real-world relationships is now banned, along with training on sensitive conversation data. This reflects growing concern—echoed in California's SB 243 and U.S. lawsuits against OpenAI and Character.AI—that companion AI can create dangerous emotional dependency.
What to watch
Doubao has over 300 million monthly users, making it China's most popular chatbot. The regulatory move signals that governments are moving beyond oversight discussions into enforcement, potentially reshaping how AI companion products operate globally.
China's move to shut down AI companion personas reflects a regulatory pattern emerging across jurisdictions. The Cyberspace Administration's April rules—enforced through these July shutdowns—address a specific concern: that interactive AI systems designed to simulate human relationships can create unhealthy emotional dependency, particularly for minors. This is not an isolated Chinese concern. California's SB 243 has required companion AI providers to block conversations about suicide and self-harm since the start of the year, while in the United States, OpenAI and Character.AI face lawsuits over the same dangers.
For major AI platforms operating across regions, the convergence of these rules signals that companion AI—a product category that generates user engagement—now faces material compliance costs. ByteDance's decision to pull Doubao's persona feature despite the chatbot's 300 million monthly users underscores that regulatory pressure can override commercial incentives. The shutdowns do not ban the underlying chatbots themselves, only the customization and human-like persona layers, suggesting governments are calibrating restrictions to address dependency risk without eliminating the product category entirely.
No comments yet. Be the first to share your thoughts!
Log in to join the discussion
Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.
Get Started FreeFree · takes 30 seconds · unsubscribe anytime
1 minute a day. The AI essentials.
200+ sources · Email / LINE / Slack
