New study examines gender bias in LLMs

Zhixuan Zhou
Kyrie Zhixuan Zhou
Madelyn Sanfilippo
Madelyn Rose Sanfilippo, Assistant Professor

A new study by PhD student Kyrie Zhixuan Zhou and Assistant Professor Madelyn Rose Sanfilippo has uncovered the existence of gender bias in Large Language Models (LLMs) in the U.S. and China. The researchers examined public discussion about this topic on the social media platforms Twitter (now X) and Weibo, finding reports of gender bias in the LLMs ChatGPT and Ernie, China's ChatGPT-equivalent.

Zhou and Sanfilippo were invited to summarize their findings in the Montreal AI Ethics Institute (MAIEI) article, "Public Perceptions of Gender Bias in Large Language Models: Cases of ChatGPT and Ernie." MAIEI is an international nonprofit research institute with a mission to democratize AI ethics literacy. The summary will also be featured in AI Ethics Brief, the institute's weekly newsletter for technical leaders and policymakers around the world.

According to Zhou, finding public discussion on gender bias in ChatGPT on Twitter was straightforward, with over 350 posts on the subject. However, posts about gender bias in Ernie were more difficult to uncover on Weibo, due to China's strict censorship on online discussions about feminism. Zhou and Sanfilippo found that "cultural factors impact biases in LLMs since they were trained on data that reflect those cultural contexts." They observed implicit gender bias in discussion about ChatGPT, e.g., associating different genders with different professional titles, but explicit gender bias in discussion about Ernie, e.g., devaluing women by their age.

"Gender bias is always a severe and under-investigated issue in information technology," said Zhou. "By understanding and proposing ways to solve gender bias in AI, we aim to create a more inclusive and fair tech infrastructure in the LLM era."

To rectify the situation, the researchers propose governance recommendations to regulate gender bias in LLMs as well as the development of educational tutorials to equip AI creators with awareness and knowledge of AI gender bias.

Zhou's research interests are in tech ethics and accessibility. He aims to understand, design, and govern ICT/AI experience for vulnerable populations such as older adults, people with disabilities, women in conservative cultures, and people in authoritarian regimes. Zhou earned his BEng in computer science from Wuhan University.

Sanfilippo uses mixed methods to address research questions about participation in and the legitimacy of sociotechnical governance; social justice issues associated with sociotechnical governance; privacy in sociotechnical systems; and differences between policies or regulations and sociotechnical practice. Her work practically supports decision-making in, management of, and participation in a diverse public sphere. She earned her MS and PhD in information science from Indiana University.

Updated on
Backto the news archive

Related News

iSchool researchers to present at IDCC24

iSchool faculty, staff, and students will present their research in transparent data curation and cleaning, provenance management, certified transparency, and data ethics at the 18th International Digital Curation Conference (IDCC24), which will be held from February 19-21 in Edinburgh, Scotland. The theme of this year's conference, which brings together individuals, organizations, and institutions across all disciplines and domains involved in curating data, is "Trust Through Transparency."

Adler and Naiman selected for 2024 NIH Grant Writing Series program

Associate Professor Rachel Adler and Teaching Assistant Professor Jill Naiman have been selected for the 2024 National Institutes of Health (NIH) Grant Writing Series program in the Interdisciplinary Health Sciences Institute (IHSI). Led by faculty who have demonstrated a history of success with NIH proposals, the biennial NIH Grant Writing Series is designed to prepare Illinois faculty to submit their first R01 or other individual investigator proposals to the NIH.

Kato joins recruitment and admission team

Todd Kato joined the iSchool on January 29 as a senior admissions and records manager. In this position, he will develop and implement innovative programs and processes for admission and records management across all the School's degree programs.

Todd Kato

Sun selected as 2024 PTC Emerging Scholar

Assistant Professor Meicen Sun was selected as a 2024 Pacific Telecommunications Council (PTC) Emerging Scholar and presented her research at the PTC Annual Conference, which was held from January 21-24 in Honolulu, Hawaii. PTC is a global, nonprofit organization promoting the advancement of information and communication technologies (ICT) in the Pacific Rim. 

Meicen Sun

Hoiem authors new book on education of things

Assistant Professor Elizabeth Hoiem has authored a new book on how children learned about the material world at the close of the eighteenth century. The Education of Things, Mechanical Literacy in British Children's Literature, 1762-1860, funded in part by a fellowship from the National Endowment for the Humanities, was recently published by the University of Massachusetts Press.

Elizabeth Hoiem