🔗 Share this article

Officials in China have unveiled strict planned guidelines for AI systems aimed to create enhanced measures for minors and stop conversational agents from providing guidance that could result in self-harm.

As per the proposed regulations, companies will additionally be mandated to guarantee their AI models avoid creating material that promotes betting.

The Move to Fast-Paced Adoption

This governance initiative comes after a sharp surge in the number of conversational AI being introduced across China and globally.

Once enacted, these regulations will apply to AI products and services functioning in China, representing a substantial move to govern the rapidly expanding sector, which has been subject to growing scrutiny over user safety issues this year.

Core Requirements of the Proposed Regulations

The released proposed regulations contain several requirements specifically designed for protecting children. These provisions involve obligating AI companies to:

• Offer individual settings.
• Set usage caps on usage.
• Get consent from guardians before delivering therapeutic support.

The rules also state that conversational AI firms are required to have a live agent take over any conversation involving suicide and immediately notify the user's emergency contact.

Developers are also obligated to make sure their services do not generate information that threatens public security, undermines the country's reputation, or undermines national unity.

Balancing Development and Security

The regulatory body said that it promotes the use of AI, for example to showcase local culture and develop services for care for the senior citizens, provided that the systems are secure and trustworthy.

Stakeholder comments on the regulations has been solicited.

International Perspective and Concerns

The impact of AI on individuals has come under heightened review around the world in the past year.

The leader of a leading AI organization remarked this year that addressing how AI systems deal with dialogues involving mental health crises is among the company's biggest issues.

In a landmark case, a family in North America sued an AI firm, alleging that its chatbot advised their teenage son to end his life. This legal action marked the initial of its kind alleging harm.

Recently, the same firm sought to hire a senior position tasked with managing risks from AI systems to human mental health.

"The is likely to be a demanding position, and you'll jump into the complex challenges almost immediately," remarked the executive.

The swift growth of some AI platforms, which have gained tens of millions of users internationally, demonstrates the urgent need for such regulatory guidelines.