School of Information Sciences

New study examines gender bias in LLMs

Madelyn Sanfilippo
Madelyn Rose Sanfilippo, Assistant Professor

A new study by PhD student Kyrie Zhixuan Zhou and Assistant Professor Madelyn Rose Sanfilippo has uncovered the existence of gender bias in Large Language Models (LLMs) in the U.S. and China. The researchers examined public discussion about this topic on the social media platforms Twitter (now X) and Weibo, finding reports of gender bias in the LLMs ChatGPT and Ernie, China's ChatGPT-equivalent.

Zhou and Sanfilippo were invited to summarize their findings in the Montreal AI Ethics Institute (MAIEI) article, "Public Perceptions of Gender Bias in Large Language Models: Cases of ChatGPT and Ernie." MAIEI is an international nonprofit research institute with a mission to democratize AI ethics literacy. The summary will also be featured in AI Ethics Brief, the institute's weekly newsletter for technical leaders and policymakers around the world.

According to Zhou, finding public discussion on gender bias in ChatGPT on Twitter was straightforward, with over 350 posts on the subject. However, posts about gender bias in Ernie were more difficult to uncover on Weibo, due to China's strict censorship on online discussions about feminism. Zhou and Sanfilippo found that "cultural factors impact biases in LLMs since they were trained on data that reflect those cultural contexts." They observed implicit gender bias in discussion about ChatGPT, e.g., associating different genders with different professional titles, but explicit gender bias in discussion about Ernie, e.g., devaluing women by their age.

"Gender bias is always a severe and under-investigated issue in information technology," said Zhou. "By understanding and proposing ways to solve gender bias in AI, we aim to create a more inclusive and fair tech infrastructure in the LLM era."

To rectify the situation, the researchers propose governance recommendations to regulate gender bias in LLMs as well as the development of educational tutorials to equip AI creators with awareness and knowledge of AI gender bias.

Zhou's research interests are in tech ethics and accessibility. He aims to understand, design, and govern ICT/AI experience for vulnerable populations such as older adults, people with disabilities, women in conservative cultures, and people in authoritarian regimes. Zhou earned his BEng in computer science from Wuhan University.

Sanfilippo uses mixed methods to address research questions about participation in and the legitimacy of sociotechnical governance; social justice issues associated with sociotechnical governance; privacy in sociotechnical systems; and differences between policies or regulations and sociotechnical practice. Her work practically supports decision-making in, management of, and participation in a diverse public sphere. She earned her MS and PhD in information science from Indiana University.

Updated on
Backto the news archive

Related News

iSchool researchers to present at ASSETS 2025

iSchool faculty and students will present their research at the 27th International Association for Computing Machinery (ACM) Special Interest Group (SIG) ACCESS Conference on Computers and Accessibility (ASSETS 2025), which will be held in Denver, Colorado, October 26–29, 2025. This conference allows researchers to present their scholarship on design, evaluation, use, and education related to computing for people with disabilities and older adults.

Chan to give an invited talk on "Predatory Data"

Professor Anita Say Chan will give an invited lecture at the American University of Beirut (AUB) on October 23. The talk, part of the "Confronted with America" series hosted by the Center for American Studies and Research, will be moderated by Jihad Touma, founding director of AUB's School of Computing and Data Sciences.

Anita Say Chan

iSchool researchers present at ILA 2025

School faculty, staff, and students will present their research at the 2025 Illinois Library Association (ILA) Annual Conference, which will be held on October 14–16 in Rosemont. The theme of this year's conference is "You Belong Here."

Craig named Illinois Library Luminary

Anne Craig, iSchool adjunct lecturer and senior director of the Consortium of Academic and Research Libraries in Illinois (CARLI), has been inducted as an Illinois Library Luminary. The Illinois Library Luminary program, an initiative of the Illinois Library Association (ILA), recognizes those who have made a significant contribution to Illinois libraries.

Anne Craig

Library Trends examines genre classifications in latest issue

The iSchool at Illinois is pleased to announce the publication of Library Trends 74 (1), titled “Genres and Their Uses in Cultural Documentation: Exploring Generic Access to Creative Worlds.” Pushing back against the notion of genres as “inferior” classifications due to their ambiguity, this issue instead explores how genre classifications facilitate access to creative works in libraries and beyond.

Cover of Library Trends 74 (1)

School of Information Sciences

501 E. Daniel St.

MC-493

Champaign, IL

61820-6211

Voice: (217) 333-3280

Fax: (217) 244-3302

Email: ischool@illinois.edu

Back to top