China to crack down on AI firms to protect kids

13 hours agoShareSaveOsmond ChiaBusiness reporterShareSaveGetty Images

China has proposed strict new rules for artificial intelligence (AI) to provide safeguards for children and prevent chatbots from offering advice that could lead to self-harm or violence.

Under the planned regulations, developers will also need to ensure their AI models do not generate content that promotes gambling.

The announcement comes after a surge in the number of chatbots being launched in China and around the world.

Once finalised, the rules will apply to AI products and services in China, marking a major move to regulate the fast-growing technology, which has come under intense scrutiny over safety concerns this year.

The draft rules, which were published at the weekend by the Cyberspace Administration of China (CAC), include measures to protect children. They include requiring AI firms to offer personalised settings, have time limits on usage and getting consent from guardians before providing emotional companionship services.

See more IT services here.

Chatbot operators must have a human take over any conversation related to suicide or self-harm and immediately notify the user's guardian or an emergency contact, the administration said.

AI providers must ensure that their services do not generate or share "content that endangers national security, damages national honour and interests [or] undermines national unity", the statement said.

The CAC said it encourages the adoption of AI, such as to promote local culture and create tools for companionship for the elderly, provided that the technology is safe and reliable. It also called for feedback from the public.

Chinese AI firm DeepSeek made headlines worldwide this year after it topped app

Original aticle here: BBC