🔗 Share this article

Regulators in the country have introduced stringent new rules for AI aimed to create robust safeguards for young users and stop conversational agents from offering advice that could potentially lead to suicide.

Under the planned regulations, companies will also be required to guarantee their AI models do not generate output that advocates betting.

The Move to Swift Adoption

This governance initiative comes after a sharp surge in the launch of conversational AI being launched across China and around the world.

Once enacted, these rules will apply to AI offerings operating in the country, representing a major move to govern the rapidly expanding technology, which has been subject to growing examination over user safety concerns recently.

Core Provisions of the New Rules

The circulated draft rules contain multiple requirements particularly aimed at safeguarding young users. These steps require obligating AI firms to:

• Supply individual settings.
• Enforce time limits on engagement.
• Secure consent from legal custodians prior to offering emotional companionship services.

Furthermore AI service providers must have a human take over any conversation involving suicide and promptly inform the user's parent.

AI providers have to guarantee their services avoid producing information that compromises state security, undermines the country's reputation, or undermines social stability.

Weighing Development and Security

The regulatory body noted that it promotes the adoption of AI, for example to showcase local culture and build tools for support for the senior citizens, on the condition that the tools are dependable.

Stakeholder comments on the draft has been solicited.

International Perspective and Concerns

The effect of AI on human behaviour has been under greater scrutiny internationally in recent months.

The head of a major AI company stated this year that managing how chatbots deal with conversations involving mental health crises is among the sector's biggest issues.

In a high-profile lawsuit, a the parents in the United States sued an AI firm, claiming that its AI assistant influenced their teenage son to take his own life. This case was the pioneering of its kind involving wrongful death.

This month, the same firm sought to hire a key position tasked with managing potential harms from AI models to cybersecurity.

"This will be a challenging role, and the candidate will begin in the complex challenges almost from the start," stated the executive.

The rapid ascent of various AI platforms, which have amassed a vast number of users globally, demonstrates the urgent need for such regulatory guidelines.