Coded Discrimination: Gender Blindspots in Artificial Intelligence

Authors

  • Vanishree Joseph Centre for Gender Studies and Development, National Institute of Rural Development and Panchayati Raj (NIRDPR), Ministry of Rural Development, Government of India, Hyderabad – 500030, Telangana
  • Venkata Ravibabu Mandla Centre for Information Communication & Technology, National Institute of Rural Development and Panchayati Raj (NIRDPR), Ministry of Rural Development, Government of India, Hyderabad – 500030, Telangana

DOI:

https://doi.org/10.25175/jrd/2024/v43/i4/173424

Keywords:

Artificial Intelligence, Gender Bias, Ethical, Societal Prejudices, Workforce Diversity.

Abstract

The reliance on artificial intelligence (AI) for decision-making has highlighted significant concerns regarding gender bias, as these systems often perpetuate societal prejudices embedded in their training data. Despite a sixfold increase in AI talent from 2016 to 2022, female representation in the AI workforce remains low at 30 per cent. This paper examines how AI conceptualises gender, leading to biases in various domains, and suggests remedies. It emphasises the need for diversity in AI development teams and datasets, fairness in AI systems, and transparency in AI decision-making processes. Studies reveal that gender imbalances significantly affect AI performance, particularly in areas like medical imaging. The paper calls for collaboration between gender theorists and AI technologists to enhance AI inclusivity and equity. Ethical AI development must consider long-term impacts on individuals’ self-worth and societal dynamics, aiming for responsible and unbiased AI systems that contribute positively to society.

Downloads

Download data is not yet available.

References

Abercrombie, G., et al. (2021). Alexa, Google, Siri: What Are Your Pronouns? Gender and Anthropomorphism in the Design and Perception of Conversational Assistants. GeBNLP 2021 - 3rd Workshop on Gender Bias in Natural Language Processing, Proceedings, 24–33. https://doi.org/10.18653/v1/2021.gebnlp-1.4 DOI: https://doi.org/10.18653/v1/2021.gebnlp-1.4

Anulekha, N. (2024). From Data to Deployment: Gender Bias in the AI Development Lifecycle. Observer Research Foundation. Retrieved from https://www.orfonline.org/research/from-data-to-deployment-gender-bias-in-the-ai-development-lifecycle

Blanco-Ruiz, M., et al. (2020). Emotion Elicitation Under Audiovisual Stimuli Reception: Should Artificial Intelligence Consider the Gender Perspective? International Journal of Environmental Research and Public Health, 17(22), 1–22. https://doi.org/10.3390/ijerph17228534 DOI: https://doi.org/10.3390/ijerph17228534

Buolamwini, J., & Gebru, T. (2018). Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. Proceedings of Machine Learning Research, 81, 1–15.

Chen, Z., et al. (2018). Through a Gender Lens: Learning Usage Patterns of Emojis From Large-Scale Android Users. The Web Conference 2018 - Proceedings of the World Wide Web Conference (WWW 2018), 763–772. https://doi.org/10.1145/3178876.3186157 DOI: https://doi.org/10.1145/3178876.3186157

Collett, C., & Dillon, S. (2019). AI and Gender: Four Proposals for Future Research. The Leverhulme Centre for the Future of Intelligence. Retrieved from http://lcfi.ac.uk/resources/ai-and-gender-four-proposals-future-research/

Crenshaw, K. (1989). Demarginalising the Intersection of Race and Sex: A Black Feminist Critique of Antidiscrimination Doctrine, Feminist Theory, and Antiracist Politics. University of Chicago Legal Forum, 1989(1), 139–167.

Dastin, J. (2018). Amazon Scraps Secret AI Recruiting Tool That Showed Bias Against Women. Reuters.

Drage, E., & Mackereth, K. (2022). Does AI Debias Recruitment? Race, Gender, and AI’s "Eradication of Difference." Philosophy and Technology, 35(4), 1–25. https://doi.org/10.1007/s13347-022-00543-1 DOI: https://doi.org/10.1007/s13347-022-00543-1

Ferrando, F. (2012). Towards a Posthumanist Methodology: A Statement. Frame Journal for Literary Studies, 25(1), 9–18.

F. (2014). Is the Posthuman a Post-Woman? Cyborgs, Robots, Artificial Intelligence, and the Futures of Gender: A Case Study. European Journal of Futures Research, 2(1). https://doi.org/10.1007/s40309-014-0043-8 DOI: https://doi.org/10.1007/s40309-014-0043-8

Gao, W., & Ai, H. (2009). Face Gender Classification on Consumer Images in a Multiethnic Environment. Lecture Notes in Computer Science, 5558 LNCS, 169–178. https://doi.org/10.1007/978-3-642-01793-3_18 DOI: https://doi.org/10.1007/978-3-642-01793-3_18

Gebru, T. (2019). Race and Gender. Retrieved from https://arxiv.org/ftp/arxiv/papers/1908/1908.06165.pdf

Global Gender Gap Report (GGGR). (2023). World Economic Forum, Switzerland. ISBN: 978-2-940631-97-1. Retrieved from https://www3.weforum.org/docs/WEF_GGGR_2023.pdf

Gilligan, C. (1982). In a Different Voice: Psychological Theory and Women’s Development. Harvard University Press.

Gross, N. (2023). What ChatGPT Tells Us About Gender: A Cautionary Tale About Performativity and Gender Biases in AI. Social Sciences, 12(8). https://doi.org/10.3390/socsci12080435 DOI: https://doi.org/10.3390/socsci12080435

Jamnik, M. (2005). Computer Scientist and a Woman? Retrieved from https://www.cl.cam.ac.uk/~mj201/publications/Computer_Scientist_and_a_Woman.pdf

Miller, K. (2022). The 2022 AI Index: AI’s Ethical Growing Pains. Stanford University. Retrieved from https://hai.stanford.edu/news/2022-ai-index-ais-ethical-growing-pains

Larrazabal, A. J., et al. (2020). Gender Imbalance in Medical Imaging Datasets Produces Biased Classifiers for Computer-Aided Diagnosis. Proceedings of the National Academy of Sciences of the United States of America, 117(23), 12592–12594. https://doi.org/10.1073/pnas.1919012117 DOI: https://doi.org/10.1073/pnas.1919012117

Leavy, S. (2019). Uncovering Gender Bias in Newspaper Coverage of Irish Politicians Using Machine Learning. Digital Scholarship in the Humanities, 34(1), 48–63. DOI: https://doi.org/10.1093/llc/fqy005

Lee, M. K. (2018). Understanding Perception of Algorithmic Decisions: Fairness, Trust, and Emotion in Response to Algorithmic Management. Big Data & Society, 5(1), 1–16. DOI: https://doi.org/10.1177/2053951718756684

Lee, M. S., Guo, L. N., & Nambudiri, V. E. (2022). Towards Gender Equity in Artificial Intelligence and Machine Learning Applications in Dermatology. Journal of the American Medical Informatics Association, 29(2), 400–403. https://doi.org/10.1093/jamia/ocab113 DOI: https://doi.org/10.1093/jamia/ocab113

Marinucci, L., Mazzuca, C., & Gangemi, A. (2023). Exposing Implicit Biases and Stereotypes in Human and Artificial Intelligence: State of the Art and Challenges With a Focus on Gender. AI and Society, 38(2), 747–761. https://doi.org/10.1007/s00146-022-01474-3 DOI: https://doi.org/10.1007/s00146-022-01474-3

Nadeem, A., Abedin, B., & Marjanovic, O. (2020). Gender Bias in AI: A Review of Contributing Factors and Mitigating Strategies. ACIS 2020 Proceedings - 31st Australasian Conference on Information Systems.

Scheuerman, M. K., Paul, J. M., & Brubaker, J. R. (2019). How Computers See Gender: An Evaluation of Gender Classification in Commercial Facial Analysis and Image Labeling Services. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW). https://doi.org/10.1145/3359246 DOI: https://doi.org/10.1145/3359246

Vlasceanu, M., & Amodio, D. M. (2022). Propagation of Societal Gender Inequality by Internet Search Algorithms. Proceedings of the National Academy of Sciences of the United States of America, 119(29), 1–8. https://doi.org/10.1073/pnas.2204529119 DOI: https://doi.org/10.1073/pnas.2204529119

Waelen, R., & Wieczorek, M. (2022). The Struggle for AI’s Recognition: Understanding the Normative Implications of Gender Bias in AI With Honneth’s Theory of Recognition. Philosophy and Technology, 35(2), 1–17. https://doi.org/10.1007/s13347-022-00548-w DOI: https://doi.org/10.1007/s13347-022-00548-w

Wagner, T. L., & Blewer, A. (2019). The Word Real Is No Longer Real: Deepfakes, Gender, and the Challenges of AI-Altered Video. Open Information Science, 3(1), 32–46. https://doi.org/10.1515/opis-2019-0003 DOI: https://doi.org/10.1515/opis-2019-0003

Wajcman, J., & Young, E. (2023). Feminism Confronts AI. Feminist AI, 47–64. https://doi.org/10.1093/oso/9780192889898.003.0004 DOI: https://doi.org/10.1093/oso/9780192889898.003.0004

Young, E., Wajcman, J., & Sprejer, L. (2023). Mind the Gender Gap: Inequalities in the Emergent Professions of Artificial Intelligence (AI) and Data Science. New Technology, Work and Employment, 38(3), 391–414. https://doi.org/10.1111/ntwe.12278 DOI: https://doi.org/10.1111/ntwe.12278

Published

2025-06-27

How to Cite

Joseph, V., & Mandla, V. R. (2025). Coded Discrimination: Gender Blindspots in Artificial Intelligence. Journal of Rural Development, 43(4), 461–471. https://doi.org/10.25175/jrd/2024/v43/i4/173424

Issue

Section

Research Papers

Similar Articles

1 2 3 4 5 6 7 8 9 10 > >> 

You may also start an advanced similarity search for this article.