Back to AI Intersections Database

Google's open source tool — meant to solve hate speech — ended up amplifying racist stereotypes.


AI Impact(s)

Violence/Hate Speech

Even as racial minorities suffer from racism, stereotyping, and hate speech leveled against them in their daily lives, AI's dependence on biased data looks to make matters worse. Jigsaw's (a company of Alphabet) Perspective API (used by news sites such as the New York Times), meant to solve toxic online conversations. Instead, it labeled conversations in African-American Vernacular English as offensive hate speech. In short: rather than protect victims of racism from hate speech, Jigsaw's service accused them of it.

Share Page

Want to suggest an update to the AI Intersections Database?

Help us make this database a robust resource for movement building! We welcome additions, corrections, and updates to actors, issues, AI impacts, justice areas, contact info, and more.

Contribute to the database

Sign Up for News and Updates

Join our Insights email list to stay up-to-date in the fight for a better internet for all.

AI Intersections Database

This website supports Web Monetization

Read more about our implementation

Mozilla is a global non-profit dedicated to putting you in control of your online experience and shaping the future of the web for the public good. Visit us at Most content available under a Creative Commons license.