{"id":274611,"date":"2023-05-11T18:32:29","date_gmt":"2023-05-11T22:32:29","guid":{"rendered":"http:\/\/thechinaproject.com\/?p=274611"},"modified":"2023-05-12T13:55:12","modified_gmt":"2023-05-12T17:55:12","slug":"china-makes-first-chatgpt-related-arrest-for-fake-news","status":"publish","type":"post","link":"https:\/\/thechinaproject.com\/2023\/05\/11\/china-makes-first-chatgpt-related-arrest-for-fake-news\/","title":{"rendered":"China makes first ChatGPT-related arrest for fake news"},"content":{"rendered":"

China has made its first-known arrest related to the use of ChatGPT, the wildly popular generative artificial intelligence chatbot that has been making headlines around the world. The arrest comes less than a month after the Cyberspace Administration of China released draft rules for ChatGPT-type platforms<\/a> that specify that generative AI must not produce content that subverts the state.<\/p>\n

According to a statement<\/a> released on Sunday by police in the northwest province of Gansu, the alleged suspect \u2014 identified only by his surname, H\u00f3ng \u6d2a \u2014 was accused of using the AI-driven text generator to create news articles described as \u201cfalse information\u201d by the authorities.<\/p>\n

The particular story that caused trouble for Hong described a fatal train crash that killed nine people in Gansu. The matter first caught the attention of the cyber division of a county police bureau when articles about the supposed accident began appearing online in April. When investigating the case, the police found that various versions of the same story but said to have happened in different accident locations were posted through more than 20 accounts on Baijiahao, a blog-style platform run by Chinese tech giant Baidu. The posts garnered a total of 15,000 views before being removed.<\/p>\n

Investigators managed to locate Hong’s social media company based in the southern city of Dongguan in Guangdong Province and made the arrest on May 5. Under police questioning, the suspect confessed that the train crash story was generated by ChatGPT after he provided prompts about trending news stories in China from the past few years, and that different versions of the article were made to bypass Baijiahao\u2019s duplication check function.<\/p>\n

\u201cHong used modern technology to fabricate false information, spreading it on the internet, which was widely disseminated,\u201d the Gansu police said in the statement, adding that the investigation was still ongoing.<\/p>\n

\"\"
The scene of the crime: The apartment of Hong, who was arrested by police in Gansu Province<\/a> this week for creating fake news using ChatGPT. Photo from Gansu Police\u2019s official WeChat public account.<\/figcaption><\/figure>\n

What exactly landed Hong in trouble? <\/strong><\/p>\n

Hong was held under the suspicion of \u201cpicking quarrels and provoking trouble\u201d (\u5bfb\u8845\u6ecb\u4e8b x\u00fan x\u00ecn z\u012b sh\u00ec). This is a catch-all charge that is traditionally used against political dissidents and carries a maximum prison sentence of 10 years. While the popular understanding of the term is that it can be applied to any behavior welcomed by the Chinese government, Donald Clarke, a professor of law specializing in modern China at the George Washington University Law School in Washington, told The China Project that \u201cit\u2019s not as vague as everybody says.\u201d<\/p>\n

\u201cThe crime is only made out if one of four conditions is met, and one of them is about creating a disturbance in a public place,\u201d he said, adding that there are precedent instances of the charge being applied to suspects accused of creating or spreading misinformation online, as \u201cthe Chinese government has very often now interpreted cyberspace as public space.\u201d<\/p>\n

\u201cThe government has used it many times to prosecute people who did something they didn\u2019t like in cyberspace. And it\u2019s not just fake news. It could be true news. It could be a critical opinion about the leaders. There\u2019s lots of cases where people have been prosecuted for dissemination of unwelcome information online and Chinese officials’ favorite way to attack is by calling it \u2018picking quarrels and provoking trouble,\u2019\u201d Clarke added.<\/p>\n

Known for its ability to generate human-like text and content in response to complex questions, simple prompts, and other human input, ChatGPT has been a worldwide sensation since its launch last November. However, despite being a popular subject of fascination in China, the tool \u2014 like many other major foreign websites and internet applications \u2014 is blocked <\/a>by the sophisticated censorship system colloquially known as the Great Firewall.<\/p>\n

Individuals determined to access the blocked service can get around the restrictions using \u201cvirtual private network\u201d (VPN) software, a practice that is also punishable by Chinese security and legal authorities<\/a>. There has been no official word on how Hong managed to use ChatGPT, but according to Jeremy Daum, a senior fellow of the Yale Law School\u2019s Paul Tsai China Center and the founder of China Law Translate<\/a>, OpenAI\u2019s powerful chatbot was not the main factor leading to Hong\u2019s arrest.<\/p>\n

\u201cHad he made up the story the old-fashioned way, the results would be the same. The tech aspect may make the story more interesting, or even useful as a way of drawing attention to the emerging rules, but isn\u2019t really key here,\u201d Daum told The China Project. \u201cAI generation reduces the effort and cost of creating such content, but the content has always been illegal.\u201d<\/p>\n

For the Chinese government, cracking down on online content is a measure routinely used to censor information it doesn\u2019t like.<\/p>\n

Information control is particularly intense when it comes to major disasters: When a deadly fire broke out<\/a> at a Beijing hospital last month, social media posts about the incident were quickly censored and it took hours for the news to reach state-approved news outlets. Making up stories about train accidents appears to be a dangerous act, especially after the fatal Wenzhou train collision in 2011<\/a>, which prompted a public furor over a lack of transparency in how the news was communicated.<\/p>\n

According to Clarke, the arrival of ChatGPT has made it harder for Chinese censors to remove unwelcome stories and curb their circulation. \u201cHong could have rewritten the story 100 times himself, but it takes a lot of time. He could have hired 100 people to do it for him, but that takes money,\u201d he said. \u201cThe thing that ChatGPT allows you to do is to bypass the censoring mechanism by rewriting the same unwelcome story in many different ways.\u201d<\/p>\n

Making sense of China’s AI regulations<\/strong><\/p>\n

In the police statement, it\u2019s acknowledged that the arrest of Hong was the first instance of a Chinese citizen being detained since China’s new regulations on “deepfake” technology took effect in January. Formally known as \u201cProvisions on the Administration of Deep Synthesis Internet Information Services<\/a>\u201d and drafted by the Cyberspace Administration of China (CAC), the legislation is China\u2019s first attempt to govern deepfakes, which is defined by Chinese lawmakers as technologies that use \u201cdeep learning, virtual reality, and other synthetic algorithms to produce text, images, audio, video, virtual scenes, and other network information.\u201d<\/p>\n

While the rapidly evolving deep synthesis technology could \u201cserve user needs and improve user experience, it has also been used by some unscrupulous people to produce, copy, publish, and disseminate illegal and harmful information, to slander and belittle others\u2019 reputation and honor, and to counterfeit others\u2019 identities,\u201d the CAC explained in its introduction to the new measures.<\/p>\n

Although officials promoted the rules in the name of protecting individual internet users\u2019 interest, and maintaining social stability, some analysts were quick to point out that they imposed tighter censorship of online information. For example, one article demands that deepfake makers and distributors must adhere to \u201cthe correct political direction\u201d and \u201cvalues trends\u201d in the country, which automatically puts any content deemed offensive by the government in tricky territory.<\/p>\n

Building on the deep synthesis legislation, the CAC unveiled a new set of draft guidelines on generative AI services like ChatGPT in April, closing public consultation for them on Wednesday this week. \u201cInappropriate\u201d content \u2014 once again \u2014 is an issue highlighted in the proposed law, which requires AI developers to ensure generated content embodies \u201cthe core values of socialism\u201d and must not \u201cincite subversion of state power\u201d or undermine national unity.<\/p>\n

The draft rules also \u201cbaldly state that the content created by generative AI must be truthful and accurate,\u201d Daum pointed out in his overview of the document<\/a>. But truth and accuracy, Daum said, \u201cisn\u2019t always a relevant standard for content no matter how it is generated.\u201d<\/p>\n

\u201cIs the Mona Lisa true and accurate? How about Mondrian’s \u2018Composition with Red, Blue, and Yellow?\u2019 Sometimes an image, sound, or other media is about aesthetics, and trying to measure or mandate its truth just doesn\u2019t make sense,\u201d he added. \u201cWhat they are hoping to do in new rules on AI-generated content is limit the deception and confusion of the public. This has to do more with how the content is presented or used than with the content itself.”<\/p>\n

Elsewhere in the proposed legislation, there is a section dedicated to addressing algorithmic bias, which contains an article ordering Chinese companies to ensure that training data for AI models will not discriminate against people based on their ethnicity, race, or gender. References to intellectual property rights and fair competition can also be found in the document.<\/p>\n

In an effort to catch up to ChatGPT, Chinese tech companies have been barreling into the field of generative AI in the past few months, releasing rival products to mixed reviews. In March, search engine giant Baidu unveiled<\/a> its much-awaited AI-powered chatbot known as Ernie Bot, but the use of pre-recorded demonstration videos at the showcase disappointed viewers and investors, sending Baidu\u2019s Hong Kong\u2013traded stock price plunging. Last month, Chinese tech behemoth Alibaba announced plans<\/a> to roll out its own ChatGPT-style service called Tongyi Qianwen. The company said that it would integrate the chatbot across its businesses in the \u201cnear future,\u201d but did not give details on its timeline.<\/p>\n

China is not the only country concerned with the development of generative AI. In March, Italy became the first country to ban ChatGPT<\/a> over privacy concerns, although it has since walked the prohibition back. The European Union has proposed<\/a> a comprehensive legislative package to bring AI under control, while talks about accountability measures for the technology are also underway within the U.S. government<\/a>.<\/p>\n

But there\u2019s a unique emphasis on content control and censorship in the Chinese government\u2019s push to rein in AI.<\/p>\n

\u201cChina already has ample rules for censoring or punishing speech it doesn\u2019t like, regardless of how it was generated, and the deep synthesis rules have already incorporated existing content law into the content-generation context,\u201d Daum said. \u201cThe big change in the draft AI rules is that they are aiming to go after the providers of generative AI services as well as the user who spreads the information.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"

A man from Gansu has been arrested after allegedly using ChatGPT to generate and spread a fake news story about a fatal train crash. The incident comes just weeks after Chinese lawmakers proposed a new legislation on generative AI with a focus on content regulation. <\/p>\n","protected":false},"author":20030,"featured_media":274655,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"episode_type":"","audio_file":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","date_recorded":"","explicit":"","block":"","filesize_raw":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[15959],"tags":[14995,15161,13406,21013],"column":[],"class":[],"coauthors":[18963],"acf":[],"la_post_categories":{"business-and-technology":"Business & Technology"},"la_post_tags":{"artificial-intelligence":"artificial intelligence","artificial-intelligence-ai":"artificial intelligence (AI)","censorship":"censorship","chatgpt":"ChatGPT"},"content_writeup":{"rendered":"

A man from Gansu <\/strong>has been arrested after allegedly using ChatGPT to generate and spread a fake news story about a fatal train crash.<\/p>\n