Connect with us

The Online Technology

Google’s algorithm for detecting hate speech looks racially biased

Explore Technology

Google’s algorithm for detecting hate speech looks racially biased


AI systems meant to spot abusive online content are far more likely to label tweets “offensive” if they were posted by people who identify as African American.

The news: Researchers built two AI systems and tested them on a pair of datasets of more than 100,000 tweets that had been annotated by humans with labels like “offensive,” “none” or “hate speech.” One of the algorithms incorrectly flagged 46% of inoffensive tweets by African American authors as offensive. Tests on bigger datasets, including one comprised of 5.4 million tweets, found that posts by African American authors were 1.5 times more likely to be labelled as offensive. When the researchers then tested Google’s Perspective, an AI tool that the company lets anyone use to moderate online discussions, they found similar racial biases.

A hard balance to strike: Mass shootings perpetrated by white supremacists in the US and New Zealand have led to growing calls from politicians for social media platforms to do more to weed out hate speech. These studies underline just how complicated a task that is. Whether language is offensive can depend on who’s saying it, and who’s hearing it. For example, a black person using the “n word” is very different to a white person using it. But AI systems do not, and currently cannot, understand that nuance.

Real Life. Real News. Real Voices

Help us tell more of the stories that matter

Become a founding member

The risk: By rushing to use software to automatically weed out offensive language, we risk silencing minority voices. Moderating online content is a traumatizing, difficult job, so tech companies are keen to rely on AI systems instead of human beings (they’re also much cheaper.) This study shows the huge risks inherent in that approach.

Sign up here for our daily newsletter The Download to get your dose of the latest must-read news from the world of emerging tech.


Source link

Subscribe to the newsletter news

We hate SPAM and promise to keep your email address safe

Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

To Top