Generative AI may lead to the savage growth of false information

Today's PerspectiveReporter Liu Xia from our newspaperGenerative artificial intelligence (AI) has emerged and may have a huge impact on humanity. Earlier this year, Goldman Sachs Group warned that over 300 million full-time jobs could be affected

Today's Perspective

Reporter Liu Xia from our newspaper

Generative artificial intelligence (AI) has emerged and may have a huge impact on humanity. Earlier this year, Goldman Sachs Group warned that over 300 million full-time jobs could be affected. A report released by the Congressional Research Service in May pointed out that the latest innovation in AI also raises new copyright issues, such as how to define whether content created or used by AI is infringing or fair use.

In a report on June 9th, the Forbes website in the United States pointed out that another worrying issue has emerged: generative AI can be used for false information activities on social media. False information activities refer to the deliberate production and dissemination of politically motivated lies, which is different from a person making mistakes or lying. False information activities can use various strategies, as well as various new technologies, new media and Old media to expand differences and incite unrest.

John Hill, a professor of network security at the University of Tulsa in the United States, said that as we all know, Facebook, Twitter, TikTok and other platforms are now the front lines of Information warfare. The "finger" of generative AI not only creates new dangers, but also amplifies the existing dangers.

'Deep fraud': When faking the truth, it's both true and false

In 2017, when a user named "Deepfake" first released a composite video on the Internet, it may not have occurred to him that he had opened the "Pandora's Box". With the savage growth of "deep counterfeiting" technology in a state of lack of regulation, it has gradually endangered economic and social stability.

The so-called "deep forgery" technology is a technique that uses AI to replace characters from existing images, audio, or videos with others. Some manipulated images, videos, and audio and other "deep counterfeiting" content used to require professionals to complete, but with the support of generative AI, many people are now able to create it more easily.

Hill pointed out that 'deep counterfeiting' allows individuals with ulterior motives to steal or steal others' voices, embed them in images or videos, or manipulate or modify digital content in an undetectable manner. All of this has just begun, and with the continuous progress of technology, the gap between the content produced by "deep counterfeiting" technology and the real thing will become smaller and smaller. Moreover, as it becomes easier to produce "deep fraud" content, social media will spread such content to the Mass communication at any time.

Hill emphasized that as these "deeply fabricated" content spreads unrestricted and unregulated on social media platforms, it will lead to a false information movement to influence, persuade, and mislead others or specific audiences. With the continuous development of related technologies, what may happen in the future is very worrying.

Erosion of trust in political elections

Forbes magazine pointed out that generative AI combined with "deep fraud" may bring real and terrible consequences to the United States presidential election in 2024.

In a May report, the US Public Broadcasting Service website pointed out that generative AI can not only quickly generate targeted campaign emails, text, or videos, but may also be used to mislead voters, impersonate candidates, and disrupt elections on an unprecedented scale and speed, defame candidates, and even incite violence.

Dr. Timothy Serno, professor and associate dean of the Graduate School of the University of Central Florida, said that the "deep fraud" content produced by AI looks very real, even for experts, it is a challenge to determine their authenticity.

At the same time, voters are overwhelmed by AI fabricated videos, and if social media platforms intentionally or wrongly allow AI modified or generated information to linger and spread freely on their networks, voters' trust in them may further decrease. The US Cyber Security Company predicts that groups trying to intervene in Elections in the United States will use AI and synthetic media as a way to erode trust.

Content authentication standards are still being developed

The Forbes website pointed out in a report that the generative AI related industry is developing "content authentication" standards to enable users to verify the source of digital content, but the development and adoption of these standards will take some time.

Hill pointed out that this is a necessary stage in the development of digital media, however, users must be more cautious when browsing or using content on social media platforms. In addition, social media websites should actively regulate posts manipulated by AI.

AI provides a powerful ability for disruptive progress, but this ability must also be used with caution in order to maximize the power of technology for good.


Disclaimer: The content of this article is sourced from the internet. The copyright of the text, images, and other materials belongs to the original author. The platform reprints the materials for the purpose of conveying more information. The content of the article is for reference and learning only, and should not be used for commercial purposes. If it infringes on your legitimate rights and interests, please contact us promptly and we will handle it as soon as possible! We respect copyright and are committed to protecting it. Thank you for sharing.(Email:[email protected])