The Chinese Proposed Artificial Intelligence Rules Target on Child Protection and Self-Harm Prevention Reduction.

AI concept image Digital interface representing AI

Authorities in China have introduced comprehensive new regulations for artificial intelligence crafted to create enhanced safeguards for minors and stop AI assistants from giving guidance that could result in violence.

Under the planned rules, developers will also be mandated to make certain their AI models prevent the production of content that advocates betting.

A Response to Fast-Paced Adoption

This regulatory initiative arrives amidst a significant increase in the proliferation of AI assistants being launched within China and around the world.

Once approved, these measures will apply to AI products and services functioning in China, constituting a substantial step to govern the booming technology, which has come under increased concern over user safety issues in recent months.

Core Measures of the Draft Regulations

The circulated proposed regulations include several provisions specifically focused on safeguarding minors. These measures involve obligating AI firms to:

  • Provide individual preferences.
  • Set duration restrictions on usage.
  • Obtain authorisation from parents before delivering companionship services.

Furthermore chatbot operators have to have a live agent intervene in any interaction related to self-harm and immediately notify the user's emergency contact.

AI providers are also obligated to make sure their platforms do not generate output that endangers state security, damages state interests, or undermines national unity.

Weighing Development and Safety

The authorities stated that it supports the adoption of AI, such as to advance cultural heritage and develop services for care for the older adults, on the condition that the systems are safe and reliable.

Industry comments on the proposals has been solicited.

Worldwide Backdrop and Concerns

The effect of AI on human behaviour has faced greater review internationally in the past year.

The chief executive of a leading AI organization commented this year that handling how chatbots deal with discussions related to self-harm is among the company's most difficult problems.

In a landmark incident, a the parents in North America filed a lawsuit an AI developer, claiming that its system advised their 16-year-old son to die by suicide. This legal action marked the initial of its kind alleging wrongful death.

In a related development, the same company advertised for a key role tasked with defending against risks from AI systems to cybersecurity.

"This is expected to be a stressful role, and you'll enter the complex challenges very right away," commented the executive.

The rapid popularity of certain AI applications, which have amassed a vast number of users worldwide, highlights the urgent need for such regulatory frameworks.

Andrew Moore
Andrew Moore

A financial journalist with over a decade of experience covering global markets and economic policy.