Google's open source tool — meant to solve hate speech — ended up amplifying racist stereotypes.

Even as racial minorities suffer from racism, stereotyping, and hate speech leveled against them in their daily lives, AI's dependence on biased data looks to make matters worse. Jigsaw's (a company of Alphabet) Perspective API (used by news sites such as the New York Times), meant to solve toxic online conversations. Instead, it labeled conversations in African-American Vernacular English as offensive hate speech. In short: rather than protect victims of racism from hate speech, Jigsaw's service accused them of it.