Back to AI Intersections Database

Biased or incomplete training datasets can result in racial discrimination manifesting via search engine results that perpetuate stereotypes and marginalization.

Issue

AI Impact(s)

Bias and discrimination

Safiya Umoja Noble has written about how searches for the term "professional hairstyles" in Google returned images of white, blonde women, whereas "unprofessional hairstyles" returned images of Black women. AlgorithmWatch has written about machine learning systems at Google and Instagram that consistently assigned negative and harmful labels to images of people with dark skin. For example, the system correctly labels a handheld thermometer when it's held by a light-skinned hand. When a dark-skinned hand holds the same thermometer, the system "sees" a gun.

Share Page

Want to suggest an update to the AI Intersections Database?

Help us make this database a robust resource for movement building! We welcome additions, corrections, and updates to actors, issues, AI impacts, justice areas, contact info, and more.

Contribute to the database

Sign Up for News and Updates

Join our Insights email list to stay up-to-date in the fight for a better internet for all.

AI Intersections Database

This website supports Web Monetization

Read more about our implementation

Mozilla is a global non-profit dedicated to putting you in control of your online experience and shaping the future of the web for the public good. Visit us at foundation.mozilla.org. Most content available under a Creative Commons license.