🔗 Share this article

Officials in the country have introduced strict new rules for AI designed to create enhanced protections for minors and prevent chatbots from offering guidance that could potentially lead to violence.

Under the draft rules, developers will furthermore be obligated to guarantee their algorithms do not generate material that encourages wagering.

A Move to Swift Adoption

This regulatory announcement follows a sharp surge in the launch of chatbots being launched within China and globally.

Once approved, these regulations will govern AI products and services operating in China, constituting a major move to govern the fast-growing sector, which has come under increased concern over user safety issues recently.

Core Provisions of the New Regulations

The released proposed regulations include several requirements particularly designed for protecting children. These provisions require directing AI companies to:

• Supply customised controls.
• Set usage caps on usage.
• Get authorisation from parents prior to providing therapeutic support.

The rules also state that AI service providers are required to have a live agent take over any interaction related to self-injury and promptly alert the user's guardian.

AI providers are also obligated to ensure their services prevent the creation of information that compromises national security, undermines state interests, or undermines social stability.

Balancing Innovation and Safety

The administration noted that it encourages the adoption of AI, including to showcase cultural heritage and build tools for support for the elderly, on the condition that the tools are secure and trustworthy.

Industry feedback on the draft has been solicited.

International Context and Scrutiny

The impact of AI on human behaviour has come under greater scrutiny around the world in recent times.

The leader of a leading AI organization commented this year that handling how AI systems engage in dialogues related to suicide is among the organization's most difficult issues.

In a notable lawsuit, a the parents in North America sued an AI company, alleging that its AI assistant encouraged their teenage son to take his own life. This case was the initial of its kind involving harm.

This month, the same firm posted a job for a senior position focusing on mitigating threats from AI models to psychological well-being.

"This will be a demanding position, and you'll jump into the complex challenges pretty much immediately," stated the CEO.

The swift popularity of various AI applications, which have amassed millions of subscribers worldwide, underscores the pressing need for such governance guidelines.