iSchool researchers receive best paper award at TrustNLP

Sullam Jeoung
Sullam Jeoung
Jana Diesner
Jana Diesner, Affiliate Associate Professor
Halil Kilicoglu
Halil Kilicoglu, Associate Professor

A paper coauthored by PhD student Sullam Jeoung, Associate Professor Jana Diesner, and Associate Professor Halil Kilicoglu was named Best Long Paper at TrustNLP: Third Workshop on Trustworthy Natural Language Processing, which was held in conjunction with the Annual Conference of the Association for Computational Linguistics (ACL 2023). In their paper, "Examining the Causal Impact of First Names on Language Models: The Case of Social Commonsense Reasoning," the researchers discuss how the use of first names in language models can impact their trustworthiness.

"Language models are increasingly used and deployed across various applications and domains that engage with users, ranging from some recent popular models such as ChatGPT and Bard to applications such as AI counseling," explained Jeoung. "As language models are used in circumstances where social intelligence and commonsense reasoning are becoming important, it is imperative to ensure the trustworthiness of language models."

Through a controlled experiment to measure the causal effect of first names on reasoning, the researchers were able to distinguish between model predictions due to chance and those caused by factors of interest. Their results indicate that the frequency of first names in a model has a direct effect on its prediction.

"Our findings suggest that to ensure model robustness, it is essential to augment datasets with more diverse first names during the configuration stage," said Jeoung.

Updated on
Backto the news archive

Related News

Get to Know Fi Keane, MSLIS Student

MSLIS student Fi Keane found their way to the iSchool after working in the children’s section of a bookstore. For the past academic year, they have served as the graduate assistant for Research on Diversity in Youth Literature, a peer-reviewed, open access, academic journal hosted by the iSchool’s Center for Children’s Books.

Fi Keane

Kaushik defends dissertation

Doctoral candidate Smirity Kaushik successfully defended her dissertation, "Digital Trust, Safety, and Privacy in the Age of Emerging Technologies," on June 16. 

Smirity Kaushik

New book explores how AI is reshaping cultural heritage

Glen Layne-Worthey, associate director for research support services for the HathiTrust Research Center (HTRC), and J. Stephen Downie, professor and HTRC co-director, have edited a new book, Navigating Artificial Intelligence for Cultural Heritage Organisations, which was recently released by UCL Press.