Privacy watchdog warns of using AI chatbot 'Grok' for indecent content

The Office of the Privacy Commissioner for Personal Data (PCPD) on Thursday expressed concern that the AI chatbot “Grok” is being used to generate indecent content, reminding the public to use artificial intelligence tools safely and lawfully.

In a statement issued today, the privacy watchdog noted that such misuse has raised concerns across multiple jurisdictions, and it is proactively contacting the relevant organization to understand the situation.

The PCPD reminded the public that when providing personal data to AI chatbots to generate content, users must comply with the requirements of the Personal Data (Privacy) Ordinance (PDPO) and the relevant Data Protection Principles.

It further warned that improper or malicious use of AI chatbots to create indecent or harmful photos or videos may violate the PDPO and could constitute other criminal offenses. 

“If you need to use others’ personal data to generate AI content, you should first obtain their express and voluntary consent,” the PCPD said. 

The office also issued a clear directive against using AI chatbots to produce illegal content, such as child pornography.

To help the public navigate these risks, the PCPD has previously published two resources, including a leaflet titled “10 TIPS for Users of AI Chatbots” and guidance titled “Abuse of AI Deepfakes: Toolkit for Schools and Parents.”