Facebook Removes Accounts With AI-Generated Profile Photos

Facebook on Friday removed what it called a global network of more than 900 accounts, pages, and groups from its platform and Instagram that allegedly used deceptive practices to push pro-Trump narratives to about 55 million users. The network used fake accounts, artificial amplification, and, notably, profile photos of fake faces generated using artificial intelligence to spread polarizing, predominantly right-wing content around the web, including on Twitter and YouTube.

It represents an alarming new development in the information wars, as it appears to be the first large-scale deployment of AI-generated images in a social network. In a report on the influence operation, researchers from disinformation groups Graphika and DFRLab noted that this was the first time they had seen the technology used to support an inauthentic social media campaign.
two profile photos with analysis boxes pointing out disrepencies
Profile pictures for Facebook accounts “Mary Keen” and “Jacobs Guillermo,” admins on groups associated with The BL highlighted by Graphika. COURTESY OF GRAPHIKA

The images were used to enhance the authenticity of some of the 610 Facebook accounts, 156 groups, 89 pages, and 72 Instagram accounts associated with “The BL,” a digital news outlet that described itself as a “pure mountain spring, moistening the heart of every reader” on Facebook before it was removed. Facebook’s investigation connected The BL to The Epoch Times, a conservative media organization with ties to Chinese spiritual group Falun Gong and a history of aggressive support for Donald Trump.

Ostensibly a US-based media organization, The BL network’s pages were operated by users in Vietnam and the US, who Facebook says made widespread use of fake accounts to evade detection and funnel traffic to its own websites. A reportby Graphika and DFRLab researchers, found that the majority of The BL network’s fake accounts were used to maintain a cluster of over 80 groups and pages promoting President Trump. The accounts acting as administrators for these pages—which boasted names such as “America Needs President Trump,” “Trump for America’s President,” and “WE STAND WITH TRUMP & PENCE!”—were predominantly fake and created in Vietnam.

“Fake accounts served as the administrators of Facebook groups, increased the membership numbers of those groups, liked posts on the Pages, and posted large quantities of content from TheBL-related assets,” the report notes. “This structure constituted a large-scale artificial amplification factory whose only observable function was to boost content from TheBL and, to a lesser extent, from the Epoch Times.”

two Facebook pages with profiles images
On the left, admins for “Patriots for President Trump,” nine out of 15 of which used AI-generated faces, researchers said. On the right, admins for “President Trump KAG 2020," eight out of 16 of which are fake faces, according to a report.
 COURTESY OF GRAPHIKA

Many of these accounts used profile pictures that researchers said appeared to be created using neural networks trained on images of real human faces to create photos of people that did not actually exist. Researchers from Graphika and DFRLab found 18 images of faces in profile photos used by The BL network that they said had likely been generated using generative adversarial networks.

While the technology is capable of creating passable fake faces, it has a few obvious tells that tipped the researchers off. It works largely by mimicking visual patterns, but doesn’t understand human anatomy, and struggles with backgrounds and symmetrical features, like glasses or earrings.

3 photos of a man analyzing discrepencies within the image.
A profile photo for the account “Alfonzo Macias” with AI-generated inconsistencies around his glasses that Graphika said suggested the work of artificial intelligence.
 COURTESY OF GRAPHIKA

The above image, from the Graphika report, was taken from the profile photo for “Alfonzo Macias,” an admin for one of the groups in The BL network. “Note the asymmetry in the glasses and also the poorly defined background,” the report says. “The authors checked this image with experts at the University Federico II of Naples, who assessed that this image was GAN-generated with 99.9 percent certainty.”

The entire story is already here, but do click and give Wired some ad dollars please.

https://www.wired.com/story/facebook-removes-accounts-ai-generated-photos/?fbclid=IwAR1_GG_edLUMQUbxCNcI3KvjsQAmb2LIa-pgARZJLZbVrv7c7W1WRvs011s

Comments

Post a Comment

Popular posts from this blog

That Uplifting Tweet You Just Shared? A Russian Troll Sent It

Image
Here’s what Russia’s 2020 disinformation operations look like, according to two experts on social media and propaganda. By   DARREN LINVILL   &   PATRICK WARREN Internet trolls don’t troll. Not the professionals at least. Professional trolls don’t go on social media to antagonize liberals or belittle conservatives. They are not narrow minded, drunk or angry. They don’t lack basic English language skills. They certainly aren’t  “somebody sitting on their bed that weighs 400 pounds,”  as the president once put it. Your stereotypical trolls do exist on social media, but the amateurs aren’t a threat to Western democracy. Professional trolls, on the other hand, are the tip of the spear in the new digital, ideological battleground. To combat the threat they pose, we must first understand them — and take them seriously. MORE: https://www.rollingstone.com/politics/politics-features/russia-troll-2020-election-interference-twitter-916482/ P...
Read more

The Nightmare Scenario That Keeps Election Lawyers Up At Night -- And Could Hand Trump A Second Term

Image
The Nightmare Scenario That Keeps Election Lawyers Up At Night -- And Could Hand Trump A Second Term   (Photo: Photos: Getty Images) Americans will almost certainly go to bed on Nov. 3 without knowing who won the presidential election. Since millions of people will vote by mail, constraints on time and resources will slow ballot counting into potentially a weeks-long process. Voting patterns suggest it’s likely that President  Donald Trump  could end Election Day in the lead in certain key states, only to be overtaken by Democratic opponent  Joe Biden  when more votes are tallied.  This could create a nightmare scenario during the three months stretching from Election Day to the Jan. 20 inauguration: a battle on the state and congressional level over who is the legitimate winner. This could include Congress reconvening on Jan. 6, presided over by Vice President  Mike Pence , with no consensus over its potential role in choosing the next president. This...
Read more

When Life Hands You Lemons

Image
 It's like this folks: sometimes your mind goes blank. Happens more than usual with me of course. Take this forum for instance. I wanted to post something today and couldn't think of a topic. At least not a non-sexual one and we know sexual ones lately have been frowned upon.  Then along comes one of our regulars and complains about something. Well, they might not say it was a complaint, just an observation, but it was a complaint. A minor one. It has something to do about being able to make something out of nothing. Sort of like me this morning, how to make a thread out of an empty head? But they (notice I am using the correct pronoun, not saying he or she), by what they said got me thinking. What I thought was: Not sure if that is the actual saying, if I remember correctly, I remember the saying going something like this: Umm, no, I don't think the saying I am thinking of goes that way either, maybe ONE of you good folks can remind me how the saying goes. Either way, when...
Read more