Some "AI drawings" involve underage soft pornographyIn 2019, the Regulations on the Protection of Children's Personal Network Information issued by the Cyberspace Administration of China was implemented on October 1 of the same year, which made detailed provisions on the protection of children's personal network information. Among them, the worst impact of children's personal information is the possession and dissemination of child pornography

Some "AI drawings" involve underage soft pornography

In 2019, the Regulations on the Protection of Children's Personal Network Information issued by the Cyberspace Administration of China was implemented on October 1 of the same year, which made detailed provisions on the protection of children's personal network information. Among them, the worst impact of children's personal information is the possession and dissemination of child pornography.

Nandu reporter noticed that some netizens have recently reported that AI graphic content suspected of child pornography has appeared on some domestic video websites, claiming that some bloggers train AI to place girls' faces on various provocative actions, causing young children to lift skirts and wear "missing clothes" to the camera, with accompanying images and text. On Weibo, a hot post strongly criticizing AI drawing for generating "anime Girls' Pregnancy Photos" won tens of thousands of praise from netizens.

Southern reporters further investigated and found that some video websites are providing channels for the dissemination of underage soft pornographic images and videos generated by such AI. In the actual search, reporters can easily search out many AI generated female images with exposed clothing and Sexual suggestiveness posture. If the keywords are more detailed, there are also soft pornographic generated images of underage girls. People who have posted videos even leave image links in the comment section to gain audience approval and attention; Some also leave their QQ number and contact information for "receiving orders", claiming that if there are specific requirements, detailed descriptive words can be set up in the drawing model to generate.

During the undercover investigation, the reporter also found that on e-commerce platforms, a large number of store owners can be searched for using flags such as "AI drawing" and "AI face changing" to generate beauty videos. Foolish operation, easy for Xiaobai to get started, and free to use a large number of keyword descriptions, "said a shop owner with the above slogan, stating that they only need to input a series of keywords to intelligently generate the images they want.

After trying to make a purchase, customer service will send a cloud link and extraction code, which includes SD model packages, painting quick fixes, monetization methods, and installation instructions. Many of the image materials and descriptive vocabulary sent by the other party involve vulgar pornographic content, and can easily generate soft pornographic images of underage girls. In addition, the comments section has also posted many student images generated by AI, showing these girls with childish faces and poses with the suspicion of underage soft pornography.

Multiple merchants have claimed on their pages that they support one-step facial transformation.

AI Stripping Technology Targeting Student Groups

In March of this year, the news of a woman's subway photo being stripped by AI with just one click hit Weibo hot search. The woman in the photo is a blogger who posted a set of photos of her attire taken on the subway on social media, but was intentionally spread online by someone using AI software to "strip with one click". In response, the blogger stated that they will take corresponding measures to protect their rights and hopes to raise people's attention to privacy and personal image protection.

In fact, the harm of "AI undressing" even affects minors. The reporter learned from the merchant that some AI drawing software also supports one click undressing. One seller claimed that he had "a lot of resources", not only selling drawing software, but also a large number of picture materials. On the website, he divided the atlas into many categories, such as "anime", "national style", "animation", and "machine armour". In the picture materials introduced by the other party, there were many words, such as "girl" and "girl". Some businesses have expressed that they specialize in selling "AI Painting School Uniform Portrait" image materials, which depict female students wearing school uniforms but with revealing clothing and provocative expressions.

There are businesses selling "AI Painting School Uniform Photos" image materials, featuring female students wearing school uniforms.

Some merchants who provide "AI undressing" related technologies or services may evade supervision by hiding their addresses and entering verification codes before viewing them; Others need to pay attention to a official account first, and then send a secret signal to get a verification code; Alternatively, through customer service consultation, the other party can provide a webpage link during the conversation and download the latest version of the app through the link. The reporter found through actual measurement that for downloading these software, minors do not need to perform identity recognition, and can easily operate by entering keywords to find channels.

Generating a face changing speech video only costs a few tens of yuan

In addition to generating vulgar pornographic images and videos, these new technologies are also prone to posing risks and hidden dangers in other channels.

With the increasingly widespread spread of "AI face changing", many netizens have warned that traffickers have the ability to steal facial and voice information from parents, use video phone AI face changing to impersonate parents when minors act alone, guide minors to escape the crowd, and implement abduction. When a reporter searches on a short video platform, a large number of related short video advertisements will pop up, with links to AI facelift software attached below. After a link in a software called "AI Follow", various short videos of celebrities and ordinary people appear on the homepage. You only need to watch a 25 second advertisement to create a free video of over ten seconds using this app. Usually, these short videos are accompanied by download links below, with considerable advertising traffic. Many videos have over a thousand comments and over ten thousand reposts.

In addition, the reporter found multiple merchant pages on e-commerce platforms that support face conversion in one step, with monthly sales reaching hundreds or even thousands. A customer service representative told reporters that they are selling a software that supports one click face changing in both images and videos, with a selling price of only a few tens of yuan.

Experts:

Main responsibility of compaction platform

Exploring the Consumer Class action System

In this regard, Hu Gang, Deputy Secretary General of the Law Working Committee of the Internet Society of China, believes that AI, especially the generative AI represented by ChatGPT, has triggered a new round of disruptive technological revolution, and has brought great opportunities and strong challenges to all mankind. In recent years, China has successively issued the "Interim Measures for the Management of Generative Artificial Intelligence Services," "Regulations on the Recommendation and Management of Internet Information Service Algorithms," and "Regulations on the Deep Synthesis and Management of Internet Information Services," which have refined and improved the legal system of artificial intelligence.

Liu Xiaochun, executive director of the Internet Rule of Law Research Center of the University of Chinese Academy of Social Sciences, believes that the traditional governance of bad information such as soft porn is more based on the control of the communication end, such as prohibiting or restricting the communication. There are special content producers, and users only need to obtain further communication. The challenge now is precisely that AI technology can make content production very simple, without the need for professional personnel and institutions. Everyone can become a generator, so the control over the dissemination process in the past was a bit ineffective

Liu Xiaochun stated that what needs to be done now is not only to continue the traditional control of harmful information dissemination ports, but also to transform into intervention and control of the technical tools themselves, including the development process of the technical tools. For example, in some high-risk scenarios, it is required that these AI tools provide identification, indicating synthetic and non real information in the generated images and videos, or inserting implicit identification in AI tools to trace specific tools and users. The focus of governance is to intervene in key links, such as e-commerce platforms, APP application markets, and live streaming rooms that can access these negative information, Strictly control and impose corresponding penalties on it, and the main responsibility for compacting the platform.

One of the seven key focuses of this special action by the Central Cyberspace Administration is the risk issue of new technologies and applications, including the use of technologies such as "AI face changing", "AI drawing", and "AI one click undressing" to generate vulgar pornographic images and videos involving minors. The problem has become prominent and has attracted the attention of relevant departments, making it a key target of attack. Liu Xiaochun said, hoping that relevant departments can have some more innovative governance measures and take targeted measures. "I believe that the overall situation is still controllable

Regarding domestic AI governance and rights protection, Hu Gang said that it is necessary to deepen the consumer public interest litigation mechanism of consumer protection organizations and procuratorial organs, explore the establishment of a consumer Class action system, further improve the administrative supervision, civil public interest litigation, civil private interest litigation, and comprehensive mediation coordination mechanism, and build a timely, efficient, integrated, and networked consumer dispute resolution mechanism.

Produced by: Nandu Reporter Gang

Interviewer: Southern Capital Reporter Zhang Siqi Intern Yao Chuqiao

Disclaimer: The content of this article is sourced from the internet. The copyright of the text, images, and other materials belongs to the original author. The platform reprints the materials for the purpose of conveying more information. The content of the article is for reference and learning only, and should not be used for commercial purposes. If it infringes on your legitimate rights and interests, please contact us promptly and we will handle it as soon as possible! We respect copyright and are committed to protecting it. Thank you for sharing.(Email:[email protected])