Microsoft's robot editor confuses mixed-race Little Mix singers

Firm’s plan to replace editors with AI backfires after wrong image of musician is published

Microsoft’s decision to replace human journalists with robots has backfired, after the tech company’s artificial intelligence software illustrated a news story about racism with a photo of the wrong mixed-race member of the band Little Mix.

A week after the Guardian revealed plans to fire the human editors who run MSN.com and replace them with Microsoft’s artificial intelligence code, an early rollout of the software resulted in a story about the singer Jade Thirlwall’s personal reflections on racism being illustrated with a picture of her fellow band member Leigh-Anne Pinnock.

Thirlwall, who attended a recent Black Lives Matter protest in London, criticised MSN on Friday, saying she was sick of “ignorant” media making such mistakes. She posted on Instagram: “@MSN If you’re going to copy and paste articles from other accurate media outlets, you might want to make sure you’re using an image of the correct mixed race member of the group.”

“This shit happens to @leighannepinnock and I ALL THE TIME that it’s become a running joke,” she said. “It offends me that you couldn’t differentiate the two women of colour out of four members of a group … DO BETTER!”

What Thirlwall could not have known, according to sources at the company, is that the image was selected by Microsoft’s artificial intelligence software, which is already responsible for editing parts of the news site, which attracts hundreds of millions of readers worldwide.

Microsoft does not carry out original reporting but employs human editors to select, edit and repurpose articles from news outlets, including the Guardian. Articles are then hosted on Microsoft’s website and the tech company shares advertising revenue with the original publishers. At the end of last month, Microsoft decided to fire hundreds of journalists in the middle of a pandemic and fully replace them with the artificial intelligence software.

Asked why Microsoft was deploying software that cannot tell mixed-race individuals apart, whether apparent racist bias could seep into deployments of the company’s artificial intelligence software by leading corporations, and whether the company would reconsider plans to replace the human editors with robots, a spokesman for the tech company said: “As soon as we became aware of this issue, we immediately took action to resolve it and have replaced the incorrect image.”

In advance of the publication of this article, staff at MSN were told to expect a negative article in the Guardian about alleged racist bias in the artificial intelligence software that will soon take their jobs.

Because they are unable to stop the new robot editor selecting stories from external news sites such as the Guardian, the remaining human staff have been told to stay alert and delete a version of this article if the robot decides it is of interest and automatically publishes it on MSN.com. They have also been warned that even if they delete it, the robot editor may overrule them and attempt to publish it again.

Staff have already had to delete coverage criticising MSN for running the story about Little Mix with the wrong image after the AI software decided stories about the incident would interest MSN readers.

One staff member said Microsoft was deeply concerned about reputational damage to its AI product: “With all the anti-racism protests at the moment, now is not the time to be making mistakes.”

Contributor

Jim Waterson Media editor

The GuardianTramp

Related Content

Article image
John Legend and Sia among singers to trial AI versions of voices with YouTube
Google-owned video platform opens up Dream Track experiment to produce 30-second soundtracks

Dan Milmo Global technology editor

16, Nov, 2023 @1:40 PM

Article image
AI watch: from deepfakes to a rock star humanoid
This week in artificial intelligence

Dan Milmo and Hannah Devlin

07, Jul, 2023 @12:41 PM

Article image
Ex-Little Mix star Jesy Nelson defends video in ‘blackfishing’ row
Singer says she did not intend to cause offence after critics said she was trying to appear black or mixed race

Nadia Khomami Arts and culture correspondent

12, Oct, 2021 @2:26 PM

Article image
Microsoft's $8bn Skype deal shocks analysts

Business experts question whether internet phone service Skype could be worth price after recording losses last year

Charles Arthur, technology editor

10, May, 2011 @6:38 AM

Article image
Microsoft sacks journalists to replace them with robots
Users of the homepages of the MSN website and Edge browser will now see news stories generated by AI

Jim Waterson Media editor

30, May, 2020 @6:00 AM

Article image
US aims to tackle risk of uncontrolled race to develop AI
White House says it will invest $140m in AI advances that are ‘ethical, trustworthy, responsible and serve the public good’

Dan Milmo Global technology editor

04, May, 2023 @9:35 PM

Article image
Microsoft accused of damaging Guardian’s reputation with AI-generated poll
Publisher says poll speculating on cause of woman’s death that appeared next to Guardian article caused ‘significant reputational damage’

Dan Milmo Global technology editor

31, Oct, 2023 @9:17 PM

Article image
Google v Microsoft: who will win the AI chatbot race?
Bard’s misfire on launch cost owner $160bn but experts believe ChatGPT is also prone to errors

Dan Milmo Global technology editor

10, Feb, 2023 @3:42 PM

Article image
Microsoft's Steve Ballmer: Traditional media will not bounce back
Global advertising economy has been permanently 'reset' at a lower level, says Microsoft chief executive. By Mark Sweney

Mark Sweney

24, Jun, 2009 @5:53 PM

Article image
Everything you wanted to know about AI – but were afraid to ask
From chatbots to deepfakes, here is the lowdown on the current state of artificial intelligence

Alex Hern and Dan Milmo

24, Feb, 2023 @1:41 PM