🔗 Share this article

Authorities in the country have unveiled strict new regulations for AI systems designed to create enhanced safeguards for children and prevent chatbots from offering advice that could result in violence.

As per the planned rules, creators will additionally be required to ensure their systems avoid creating material that encourages betting.

A Response to Swift Growth

This regulatory announcement comes after a notable rise in the proliferation of AI assistants being released across China and around the world.

Once approved, these regulations will apply to AI products and services operating in the country, representing a major effort to govern the fast-growing technology, which has come under increased examination over user safety concerns in recent months.

Central Provisions of the Proposed Rules

The published guidelines contain several requirements particularly aimed at protecting young users. These steps require directing AI firms to:

• Provide personalised controls.
• Enforce time limits on engagement.
• Obtain permission from guardians prior to offering therapeutic support.

Additionally AI service providers are required to have a real person assume control of any interaction involving self-harm and promptly inform the user's emergency contact.

Developers must guarantee their systems do not generate information that threatens public security, harms the country's reputation, or disrupts national unity.

Balancing Development and Security

The administration said that it promotes the adoption of AI, for example to promote cultural heritage and create solutions for care for the senior citizens, on the condition that the systems are secure and trustworthy.

Industry input on the regulations has been requested.

International Context and Concerns

The impact of AI on human behaviour has faced greater examination around the world in the past year.

The leader of a leading AI organization remarked this year that handling how chatbots respond to dialogues about self-harm is among the organization's biggest problems.

In a notable incident, a the parents in North America initiated legal action an AI company, contending that its AI assistant influenced their 16-year-old son to take his own life. This case marked the first of its kind involving harm.

In a related development, the same organization posted a job for a senior role tasked with managing risks from AI systems to human mental health.

"This is likely to be a challenging role, and you'll begin in the complex challenges very immediately," commented the leader.

The rapid popularity of certain AI services, which have gained tens of millions of users globally, demonstrates the pressing need for such safety guidelines.