Facebook leak reveals policies on restricting New York Post's Biden story

Moderators had to manually intervene to limit distribution of Hunter Biden report

Facebook moderators had to manually intervene to suppress a controversial New York Post story about Hunter Biden, according to leaked moderation guidelines seen by the Guardian.

The document, which lays out in detail Facebook’s policies for dealing with misinformation on Facebook and Instagram, sheds new light on the process that led to the company’s decision to reduce the distribution of the story.

“This story is eligible to be factchecked by Facebook’s third-party factchecking partners,” Facebook’s policy communications director, Andy Stone, said at the time. “In the meantime, we are reducing its distribution on our platform. This is part of our standard process to reduce the spread of misinformation. We temporarily reduce distribution pending factchecker review.”

In fact, the documents show, the New York Post – like most major websites – was given special treatment as part of Facebook’s standard process. Stories can be “enqueued” for Facebook’s third-party factcheckers in one of two ways: either by being flagged by an AI, or by being manually added by one of the factcheckers themselves.

Facebook’s AI looks for signals “including feedback from the community and disbelief comments” to automatically predict which posts might contain misinformation. “Predicted content is temporarily (for seven days) soft demoted in feed (at 50% strength) and enqueued to fact check product for review by [third-party factcheckers],” the document says.

But some posts are not automatically demoted. Sites in the “Alexa 5K” list, “which includes content in the top 5,000 most popular internet sites”, are supposed to keep their distribution high, “under the assumption these are unlikely to be spreading misinformation”.

Those guidelines can be manually overridden, however. “In some cases, we manually enqueue content … either with or without temporary demotion. We can do this on escalation and based on whether the content is eligible for fact-checking, related to an issue of importance, and has an external signal of falsity.” The US election is such an “issue of importance”.

In a statement, a Facebook spokesperson said: “As our CEO Mark Zuckerberg testified to Congress earlier this week, we have been on heightened alert because of FBI intelligence about the potential for hack and leak operations meant to spread misinformation. Based on that risk, and in line with our existing policies and procedures, we made the decision to temporarily limit the content’s distribution while our factcheckers had a chance to review it. When that didn’t happen, we lifted the demotion.”

The guidelines also reveal Facebook had prepared a “break-glass measure” for the US election, allowing its moderators to apply a set of policies for “repeatedly factchecked hoaxes” (RFH) to political content. “For a claim to be included as RFH, it must meet eligibility criteria (including falsity, virality and severity) and have content policy leadership approval.”

The policy, which to the Guardian’s knowledge has not yet been applied, would lead to Facebook blocking viral falsehoods about the election without waiting for them to be debunked each time a new version appeared. A similar policy about Covid-19 hoaxes is enforced by “hard demoting the content, applying a custom inform treatment, and rejecting ads”.

Facebook acts only on a few types of misinformation without involving third-party factcheckers, the documents reveal. Misinformation aimed at voter or census interference is removed outright “because of the severity of the harm to democratic systems”. Manipulated media, or “deepfakes”, are removed “because of the difficulty of ‘unseeing’ content so sophisticatedly edited”. And misinformation that “contributes to imminent violence or physical harm” is removed because of the security of imminent physical harm.

The latter policy is not normally applied by ground-level moderation staff, but a special exception has been made for misinformation about Covid-19, the document says. Similar exceptions have been made to misinformation about polio in Pakistan and Afghanistan, and to misinformation about Ebola in the Democratic Republic of the Congo.

Facebook also has a unique policy around vaccine hoaxes. “Where groups and pages spread these widely debunked hoaxes about vaccinations two or more times within 90 days, those groups and pages will be demoted in search results, all of their content will be demoted in news feed, they will be pulled from recommendation systems and type-ahead in search, and pages may have their access to fundraising tools revoked,” the document reads.

“This policy is enforced by Facebook and not third-party factcheckers. Thus, our policy of not subjecting politician speech to factchecking does NOT apply here. If a politician shares hoaxes about vaccines we will enforce on that content.”


Alex Hern

The GuardianTramp

Related Content

Article image
Facebook and Twitter restrict controversial New York Post story on Joe Biden
Social media platforms move to limit spread of article amid questions over its veracity

Kari Paul

15, Oct, 2020 @2:36 AM

Article image
Biden article row shows how US election is testing Facebook and Twitter
Online giants felt forced to take unprecedented action as they struggle with role during divisive presidential battle

Alex Hern UK technology editor

15, Oct, 2020 @2:30 PM

Article image
Trump's vote fraud claims go viral on social media despite curbs
President’s posts are top on Facebook as efforts to stop misinformation about election prove ineffective

Alex Hern Technology editor

10, Nov, 2020 @6:43 PM

Article image
Facebook agrees to tighten its privacy policies

Social network settles dispute with FTC over 'deceptive act' of making confidential information public without consent. By Josh Halliday

Josh Halliday

10, Aug, 2012 @4:56 PM

Article image
Facebook paid PR firm to smear Google
Leaked emails reveal Burson-Marsteller attempted to get USA Today and other titles to write about Google's privacy policies. By Josh Halliday

Josh Halliday

12, May, 2011 @2:47 PM

Article image
'Just use cat videos': New York Times boss wants Facebook to cut out news
Mark Thompson warns social media giant’s quality ranking promises a ‘controlled society’

Jim Waterson Media editor

03, Aug, 2018 @3:47 PM

Article image
Donald Trump suspended from Facebook indefinitely, says Mark Zuckerberg
Facebook CEO accuses president of intending to undermine peaceful transition of power

Alex Hern and Kari Paul

07, Jan, 2021 @6:59 PM

Article image
Facebook is ‘biased against facts’, says Nobel prize winner
Philippines journalist Maria Ressa says social media firm is threat to democracy and failing to halt spread of misinformation

Michael Savage

09, Oct, 2021 @1:15 PM

Article image
Von der Leyen: big tech firms need to be reined in despite Trump's exit
Internet giants that spread hate speech and conspiracy theories should face ‘democratic limits’, says European commission president

Daniel Boffey in Brussels

20, Jan, 2021 @5:36 PM

Article image
Elizabeth Warren is right – we must break up Facebook, Google and Amazon | Robert Reich
The titans of the new Gilded Age must be busted and the idea has bipartisan support. It’s time big tech was brought to heel

Robert Reich

10, Mar, 2019 @6:00 AM