China arrests man for ‘misusing’ ChatGPT in first case of its kind

Man allegedly generated fake news using ChatGPT and then shared it on Chinese social media

Maroosha Muzaffar
Tuesday 09 May 2023 11:33 BST
Comments
File photo: A man in China ‘misused’ ChatGPT to spread fake news about a train crash
File photo: A man in China ‘misused’ ChatGPT to spread fake news about a train crash (PA Wire)

Your support helps us to tell the story

From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.

At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.

The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.

Your support makes all the difference.

China has made its first-known arrest in a case involving the misuse of ChatGPT by a man to allegedly generate fake news about a train crash.

Police in the northwest Gansu province arrested the man, identified only by his second name Hong, for using the artificial intelligence technology to allegedly create variations of a fake news piece and then sharing it on the country’s social media, where it was shared widely.

Local reports said the fake news item about the crash had elements from various trending news pieces.

The fake news said the crash killed nine people in Gansu on 25 April.

The piece gained more than 15,000 clicks on Chinese social media by the time police came to know of its inauthenticity.

Local cyber security officers caught the circulation of the fake news and launched an investigation that led to the arrest of Mr Hong.

Earlier this year in January, China’s first regulations regarding deep fake technology applications officially went into effect. The regulations aim to help boost the development of the artificial intelligence industry and prevent its misuse.

The regulations, released by the Cyberspace Administration of China, the industry and information technology ministry and the public security ministry, state that the videos and photos made using AI must be “clearly labelled” to avoid confusion.

“The specialised regulation issued by China for deep synthesis services has and will continue to have a far-reaching impact on the healthy development of internet information services,” Meng Dan, director of the Institute of Information Engineering at the Chinese Academy of Sciences said at the time.

Police in Gansu said their investigation revealed a total of 21 accounts on Baijiahao – a blog-style platform of Chinese tech company Baidu – that posted different versions of the news piece simultaneously, with different accident locations.

Police said they tracked all 21 accounts on Baijiahao that had shared the AI-generated fake news to a marketing company in Shenzhen.

Mr Hong, the representative of the company, was later arrested and charged with “picking quarrels and provoking trouble” by police.

Join our commenting forum

Join thought-provoking conversations, follow other Independent readers and see their replies

Comments

Thank you for registering

Please refresh the page or navigate to another page on the site to be automatically logged inPlease refresh your browser to be logged in