Rebooting Conventional Wisdom: How AI Impacts Antisemitism

AI chatbots trained on debunking antisemitic beliefs can reduce them in users, researchers found in a recently released study. (Getty Images via JTA)

By Philissa Cramer

Every day seems to bring a fresh headline about how AI chatbots are spreading hateful ideas. But researchers tasked with understanding antisemitism say they have found evidence that AI chatbots can actually fight hate.

Researchers affiliated with the Anti-Defamation League’s Center for Antisemitism Research trained a large-language model, or LLM, on countering antisemitic conspiracy theories, and invited people who subscribed to at least one of those theories to interact with it.

The result, according to a recent study, is that the users soon believed in the antisemitic theories less, while at the same time feeling more favorable about Jews as a group. And the effects were still strong a month later, even without further engagement with the LLM.

The researchers are hailing the finding as a breakthrough in the quest for identifying actionable strategies in the fight against Jew-hatred.

“What’s remarkable about these findings is that factual debunking works even for conspiracy theories with deep historical roots and strong connections to identity and prejudice,” David Rand, a Cornell University professor who was the study’s senior author, said in a statement. 

Matt Williams, who has headed the Center for Antisemitism Research since its founding three years ago, said the study builds on a growing body of research that views contemporary antisemitism as primarily a misinformation problem.

“We need to think about antisemitism less like feelings about Jews, and more like feelings about Bigfoot,” he said. “And what I mean by that is, it’s not ‘Jews’ that are the problem. It is ‘the Jew’ as a function of conspiracy theory that is the problem. And the relationship between ‘Jews’ and ‘the Jew’ in that context is far more tenuous than we might want to think.”

Calling conspiracy theories “malfunctions in the ways that we make truth out of the world,” Williams said the study showed something remarkable. “People can correct those malfunctions,” he said.

The study emerges from the ADL’s relatively new effort to come up with evidence-based ways to reduce antisemitism, working with dozens of researchers across a slew of institutions to design and carry out experiments aimed at turning a robust advocacy space into less of a guessing game.

Advertisement


The new experiment, conducted last year, involved more than 1,200 people who said on a previous ADL survey they believed at least one of six prominent antisemitic conspiracy theories, such as that Jews control the media or the “Great Replacement” theory about Jewish involvement in immigration. 

The people then were randomly assigned three different scenarios: A third chatted with an LLM programmed by the researchers to debunk such theories, built within Microsoft’s Claude AI model; another third chatted with Claude about an unrelated topic; and the final third were simply told their belief represented a “dangerous” conspiracy theory. Then, they were all tested again about their beliefs.

Members of the group that chatted with what the researchers are calling DebunkBot were far more likely than members of the other groups to have their beliefs weakened, the researchers found.

DebunkBot was hardly a panacea for antisemitism: The study found those who believed in more antisemitic conspiracy theories experienced less change. And Williams noted the study found only that belief in antisemitic conspiracies was reduced, not rooted out entirely.

But he said any strategy that can cut against what researchers believe has been a widespread explosion of belief in conspiracy theories is a good thing.

The study comes as AI models vault into widespread use among Americans, raising concerns about their implications for Jews. When Elon Musk launched a model of his own earlier this year called Grok, it immediately drew criticism for amplifying antisemitism, kicking off a pattern that has played out repeatedly. Soon, the company apologized and said it would train its model to avoid the same behavior in the future.

Chatbot training is seen as essential for delivering high-quality AI results. DebunkBot can be found online on its own website now, but Williams said efforts were underway within the ADL to convince the companies operating major AI platforms to incorporate its expertise. 

“There’s far more receptivity than not, by any stretch of the imagination,” he said, while noting that the work was early and he could not share many details.

Whatever happens with that effort, Williams said, the new research demonstrates that combatting what’s sometimes called the world’s oldest hatred is possible.

“AI and LLMs — those are tools, right? And we can use tools for good and for evil,” Williams said. “But the fact that we can subject conspiracy theories to rational conversation and arguments and actually lead to favorable outcomes is itself, I think, relatively innovative, surprising and extraordinarily useful.” 

Philissa Cramer is editor-in-chief of the JTA global Jewish news source.

You May Also Like
MoCo School District Urged to Adopt ‘Zero-Tolerance Policy’ on Antisemitism
Greenwood Elementary School

Schools in Montgomery County have recently experienced a wave of antisemitic incidents.

Community Block Party to be Held at Owings Mills JCC on May 31st
JCC Community Block Party

This year’s Community Block Party at the JCC of Greater Baltimore will feature classic cars, giant inflatables, games, a rock-climbing wall and roller skating rink, and strolling entertainers.

Marc My Word with AI Consultant Michael Bresler
Marc My Word with AI Consultant Michael Bresler

Marc Terrill talks with Michael Bresler, CEO and President of Broadheights, an AI consulting group, about the opportunities and challenges of artificial intelligence.

Educator’s Massive Judaica Collection Finds New Home
Deborah Brodie and Jay Brill's residence

For 35 years, the late Deborah Brodie, aka Bubbie Cookie, amassed a collection of over 200 Jewish ritual objects, which she used to teach her Hebrew school students with special needs.