Can’t decide which books to ban? Leave it to ChatGPT! | Arwa Mahdawi

Ordered to remove unsuitable books from their libraries, school administrators in Iowa outsourced the job to AI. So long, The Color Purple, Beloved, The Handmaid’s Tale …

What do you get when you combine artificial intelligence with human stupidity? There are, unfortunately, numerous responses to that question. But in this particular case the answer can be found in Iowa’s Mason City Community School District, where school administrators are using ChatGPT to help them ban books.

Ahead of the new school year, school staff have been busy trying to comply with a new state law, Senate File 496, the Parental Rights and Transparency Act, requiring every book in Iowa public school libraries to be “age appropriate” and devoid of “descriptions or visual depictions of a sex act”. Of course, nobody wants hardcore porn in school libraries, but this sweeping bill, which also restricts education about gender identity and sexual orientation, isn’t trying to prevent that nonexistent problem: it’s about indoctrination. Republicans don’t want kids learning anything that goes against their narrow worldview so, over the past couple of years, they’ve gone on a censorship orgy, trying to ban everything from gender studies to psychology to African American studies.

A hallmark of Republican legislation is its ambiguity. The party can’t explicitly decree “we want to ban everything we don’t like”, because that would be blatantly unconstitutional. So instead, it couches its laws in vague language like that contained in this book-banning law. There is very little guidance in the legislation as to what constitutes a description of a sex act. (Would “the two elephants mated” count, for example?) The only real pointer given is that sex in religious texts like the Bible is absolutely fine and exempt from the law. That ambiguity gives them plausible deniability: we’re not banning books, we’re protecting children! It also tends to make people over-comply for fear of violating the law. One state senator told the Iowa Capital Dispatch that she knew a teacher who had removed every book from her classroom to make sure she was in compliance with the new law. Others have resorted to using AI to help them navigate the legislation.

“It is simply not feasible to read every book and filter for these new requirements,” Bridgette Exman, the assistant superintendent of Mason City School District, said in a statement quoted by Iowa newspaper the Gazette. “Therefore, we are using what we believe is a defensible process to identify books that should be removed from collections.”

How many books are we talking about? Hundreds, thousands, tens of thousands? Nope. The answer to this question is the same as the answer to life, the universe, and everything: 42. The district had compiled a list of 42 titles from banned book lists across the US which needed review. Nobody, let alone an educator, could possibly read 42 books! Hence the need for technology.

So how does ChatGPT, a generative AI tool that is incapable of critical thought and whose processes, training method and underlying training datasets are worryingly opaque, figure out which books are too lewd for the eyes of young Iowans? Nobody knows. It’s not clear, for example, if ChatGPT has actually “read” the books it has been asked about. All we know is that an administrator typed “does [x] book contain ‘a description or depiction of a sex act’?” into ChatGPT, then waited for a reply. ChatGPT, which doesn’t have a moral compass, did its job diligently and without protest: it identified 19 books as being too scandalous and they were pulled from the shelves. The banned books included The Color Purple by Alice Walker, Beloved by Toni Morrison and The Handmaid’s Tale by Margaret Atwood.

While dystopian, Exman’s tactics are smart in their own way. It is, as she put it, a “defensible process”. If the powers-that-be later find a contraband book in the library, school administrators can simply blame ChatGPT. What, one wonders, do the people behind ChatGPT make of all this? They keep going on about how AI is going to advance humanity. And yet, as cases like this demonstrate, AI is far more likely to be harnessed to advance the views and agenda of powerful people. Welcome to a future where the computer constantly says no.

• Arwa Mahdawi is a Guardian columnist


Arwa Mahdawi

The GuardianTramp

Related Content

Article image
Why are Tesla fanatics putting their children in the path of moving cars?
Some superfans are so determined to prove that Elon Musk’s ‘autonomous’ driving technology works that they are willing to put their kids in harm’s way, writes Arwa Mahdawi

Arwa Mahdawi

23, Aug, 2022 @12:33 PM

Article image
My week with ChatGPT: can it make me a healthier, happier, more productive person?
I’ve never had an assistant, a life coach or a personal trainer – perhaps AI is just what I’m looking for. I tried it on everything from cocktail-making to holiday-planning to health advice

Alex Hern

06, Apr, 2023 @5:00 AM

Article image
‘What should the limits be?’ The father of ChatGPT on whether AI will save humanity – or destroy it
Sam Altman is among the most vocal supporters of artificial intelligence, but is also leading calls to regulate it. He outlines his vision of a very uncertain future

Alex Hern

07, Jun, 2023 @5:00 AM

Article image
Will AI free us from drudgery – or leave us jobless and hungry? | Arwa Mahdawi
Artificial intelligence promises more leisure and creativity for workers. But at the same time, corporations are clamping down on unions and making plans to replace their expensive human employees, writes Arwa Mahdawi

Arwa Mahdawi

30, May, 2023 @1:57 PM

Article image
Book bans are sweeping US schools. A surprising new victim? The Bible | Arwa Mahdawi
When Utah’s Republican lawmakers decided to clamp down on ‘pornographic or indecent’ texts, they won’t have had the Old Testament in mind, writes Arwa Mahdawi

Arwa Mahdawi

07, Jun, 2023 @6:00 AM

Article image
Tech guru Jaron Lanier: ‘The danger isn’t that AI destroys us. It’s that it drives us insane’
The godfather of virtual reality has worked beside the web’s visionaries and power-brokers – but likes nothing more than to show the flaws of technology. He discusses how we can make AI work for us, how the internet takes away choice – and why he would ban TikTok

Simon Hattenstone

23, Mar, 2023 @10:00 AM

Article image
Tamagotchi kids: could the future of parenthood be having virtual children in the metaverse?
According to an expert on artificial intelligence, would-be parents will soon be able to opt for cheap and cuddle-able digital offspring

31, May, 2022 @12:48 PM

Article image
Incoherent, creepy and deceptively gorgeous: six leading British artists making art with AI
Artificial intelligence is creating increasingly sophisticated images. But what does it mean for the artworld? Gilbert and George, Gillian Wearing, Mat Collishaw, Elizabeth Price, Polly Morgan and Lindsey Mendick found out

Jonathan Jones

01, Dec, 2022 @6:00 AM

Article image
‘There was all sorts of toxic behaviour’: Timnit Gebru on her sacking by Google, AI’s dangers and big tech’s biases
The Ethiopian-born computer scientist lost her job after pointing out the inequalities built into AI. But after decades working with technology companies, she knows all too much about discrimination

John Harris

22, May, 2023 @5:00 AM

Article image
Five ways AI could improve the world: ‘We can cure all diseases, stabilise our climate, halt poverty’
It is not yet clear how the power and possibilities of AI will play out. Here are the best-case scenarios for how it might help us develop new drugs, give up dull jobs and live long, healthy lives

Interviews by Steve Rose

06, Jul, 2023 @4:00 AM