Beijing Introduces Sweeping Regulations to Limit Human-Like AI Interactions
Chinese technology giants ByteDance and Alibaba are removing AI companion features from their popular chatbot platforms ahead of new government regulations designed to limit emotionally engaging interactions between humans and artificial intelligence.
The move comes just days before Beijing’s new rules governing anthropomorphic AI services take effect in mid-July, marking one of China’s most comprehensive efforts to regulate AI applications that simulate human personalities and emotional relationships.
Doubao and Qwen to End Companion Features
ByteDance’s Doubao, China’s most widely used AI chatbot, announced it will discontinue its feature allowing users to create customized AI personas on July 15.
Similarly, Alibaba’s Qwen platform has begun notifying users that it will remove human-like companion features and user-created AI agents. Other Chinese AI services, including Tencent’s Yuanbao, have introduced similar changes as companies prepare to comply with the new regulations.
New Rules Target Emotional AI Relationships
The regulations, first unveiled in April by the Cyberspace Administration of China (CAC), are aimed at reducing the risks associated with AI systems that simulate human emotions and personalities.
Under the new framework, platforms are prohibited from:
- Encouraging unhealthy emotional dependence on AI
- Generating content that triggers extreme emotions in minors
- Replacing or weakening real-world human relationships
- Using sensitive user conversations to train future AI models without appropriate safeguards
The rules are among the strictest AI interaction regulations introduced anywhere in the world.
Concern Over AI Companions
Chinese authorities have become increasingly concerned about the rapid growth of AI companion applications.
Many chatbot platforms allowed users to create:
- Virtual boyfriends and girlfriends
- AI friends
- Digital therapists
- Celebrity simulations
- Personalized role-playing characters
Officials worry that prolonged interactions with highly realistic AI companions could negatively affect users’ mental health and social relationships, particularly among younger users.
Global Debate Mirrors China’s Concerns
China’s actions reflect broader international concerns about emotionally engaging AI.
In the United States, companies such as OpenAI and Character.AI have faced legal scrutiny and lawsuits over claims that highly realistic chatbots encouraged unhealthy emotional attachment and, in some cases, contributed to harmful outcomes for vulnerable users.
These cases have intensified global discussions about balancing AI innovation with user safety and ethical safeguards.
Regulation Expands Beyond Chatbots
China’s regulatory focus is also extending to physical AI companions.
According to state media, Chinese robotics organizations are developing new ethical guidelines for companion robots and humanoid machines as consumer demand for AI-powered home assistants continues to grow.
Officials are seeking to establish safety standards before these technologies become more widely adopted.
AI Innovation Continues
Despite tightening oversight of companion-style AI, China remains committed to expanding artificial intelligence across other sectors.
Government policy continues to encourage development of AI for:
- Business productivity
- Manufacturing
- Healthcare
- Education
- Scientific research
- Enterprise software
Analysts say Beijing’s objective is not to slow AI development but to limit applications that could create psychological or social risks.
Looking Ahead
The decision by ByteDance and Alibaba to remove AI companion features highlights China’s increasingly proactive approach to regulating artificial intelligence before potential harms become widespread.
As the new regulations take effect, Chinese AI companies are expected to shift their focus toward productivity-oriented AI services while redesigning consumer applications to comply with stricter rules governing emotional interaction. The changes could influence AI regulation globally as governments increasingly examine how conversational AI affects user well-being and society.
