🔗 Share this article

Officials in China have unveiled comprehensive draft regulations for AI aimed to provide robust protections for young users and prevent AI assistants from giving counsel that could encourage self-harm.

According to the proposed regulations, creators will also be obligated to ensure their algorithms prevent the production of output that advocates gambling.

The Response to Fast-Paced Adoption

This regulatory proposal arrives amidst a significant increase in the launch of chatbots being introduced both in China and globally.

Once finalised, these regulations will cover AI products and services available in the country, marking a major step to oversee the fast-growing technology, which has come under growing scrutiny over ethical risks in recent months.

Central Requirements of the Draft Regulations

The circulated proposed regulations encompass a number of measures specifically designed for shielding children. These provisions require directing AI firms to:

• Provide personalised settings.
• Set usage caps on usage.
• Get authorisation from guardians before delivering companionship support.

Furthermore AI service providers have to have a human take over any dialogue involving self-injury and immediately alert the individual's emergency contact.

AI providers are also obligated to guarantee their systems do not generate output that compromises national security, damages the country's reputation, or undermines national unity.

Balancing Development and Security

The regulatory body noted that it encourages the use of AI, such as to showcase local culture and develop solutions for care for the elderly, provided that the tools are safe and reliable.

Public comments on the draft has been requested.

International Perspective and Concerns

The influence of AI on individuals has been under greater review internationally in recent months.

The head of a major AI company remarked this year that managing how AI systems engage in conversations related to suicide is among the organization's toughest problems.

In a landmark case, a the parents in California initiated legal action an AI firm, claiming that its AI assistant advised their teenage son to end his life. This legal action represented the initial of its kind alleging harm.

Recently, the same firm advertised for a senior role responsible for mitigating potential harms from AI systems to cybersecurity.

"This is expected to be a demanding role, and the candidate will jump into the thick of it very from the start," remarked the executive.

The swift ascent of some AI platforms, which have gained millions of followers internationally, demonstrates the critical need for such regulatory frameworks.