Facebook on Friday removed what it called a global network of more than 900 accounts, pages, and groups from its platform and Instagram that allegedly used deceptive practices to push pro-Trump narratives to about 55 million users. The network used fake accounts, artificial amplification, and, notably, profile photos of fake faces generated using artificial intelligence to spread polarizing, predominantly right-wing content around the web, including on Twitter and YouTube.
It represents an alarming new development in the information wars, as it appears to be the first large-scale deployment of AI-generated images in a social network. In a report on the influence operation, researchers from disinformation groups Graphika and DFRLab noted that this was the first time they had seen the technology used to support an inauthentic social media campaign.
Profile pictures for Facebook accounts “Mary Keen” and “Jacobs Guillermo,” admins on groups associated with The BL highlighted by Graphika.
Courtesy of GraphikaThe images were used to enhance the authenticity of some of the 610 Facebook accounts, 156 groups, 89 pages, and 72 Instagram accounts associated with “The BL,” a digital news outlet that described itself as a “pure mountain spring, moistening the heart of every reader” on Facebook before it was removed. Facebook’s investigation connected The BL to The Epoch Times, a conservative media organization with ties to Chinese spiritual group Falun Gong and a history of aggressive support for Donald Trump.
Keep Reading
Ostensibly a US-based media organization, The BL network’s pages were operated by users in Vietnam and the US, who Facebook says made widespread use of fake accounts to evade detection and funnel traffic to its own websites. A report by Graphika and DFRLab researchers, found that the majority of The BL network’s fake accounts were used to maintain a cluster of over 80 groups and pages promoting President Trump. The accounts acting as administrators for these pages—which boasted names such as “America Needs President Trump,” “Trump for America’s President,” and “WE STAND WITH TRUMP & PENCE!”—were predominantly fake and created in Vietnam.
“Fake accounts served as the administrators of Facebook groups, increased the membership numbers of those groups, liked posts on the Pages, and posted large quantities of content from TheBL-related assets,” the report notes. “This structure constituted a large-scale artificial amplification factory whose only observable function was to boost content from TheBL and, to a lesser extent, from the Epoch Times.”
On the left, admins for “Patriots for President Trump,” nine out of 15 of which used AI-generated faces, researchers said. On the right, admins for “President Trump KAG 2020,” eight out of 16 of which are fake faces, according to a report.
Courtesy of Graphika
