iSchool researchers receive best paper award at TrustNLP

Sullam Jeoung
Sullam Jeoung
Jana Diesner
Jana Diesner, Affiliate Associate Professor
Halil Kilicoglu
Halil Kilicoglu, Associate Professor

A paper coauthored by PhD student Sullam Jeoung, Associate Professor Jana Diesner, and Associate Professor Halil Kilicoglu was named Best Long Paper at TrustNLP: Third Workshop on Trustworthy Natural Language Processing, which was held in conjunction with the Annual Conference of the Association for Computational Linguistics (ACL 2023). In their paper, "Examining the Causal Impact of First Names on Language Models: The Case of Social Commonsense Reasoning," the researchers discuss how the use of first names in language models can impact their trustworthiness.

"Language models are increasingly used and deployed across various applications and domains that engage with users, ranging from some recent popular models such as ChatGPT and Bard to applications such as AI counseling," explained Jeoung. "As language models are used in circumstances where social intelligence and commonsense reasoning are becoming important, it is imperative to ensure the trustworthiness of language models."

Through a controlled experiment to measure the causal effect of first names on reasoning, the researchers were able to distinguish between model predictions due to chance and those caused by factors of interest. Their results indicate that the frequency of first names in a model has a direct effect on its prediction.

"Our findings suggest that to ensure model robustness, it is essential to augment datasets with more diverse first names during the configuration stage," said Jeoung.

Updated on
Backto the news archive

Related News

New book explores video standards in film and archives

A new book co-authored by iSchool Adjunct Lecturer Jimi Jones and Marek Jancovic, assistant professor of media studies at Vrije Universiteit Amsterdam, examines video file standards and the tensions that have emerged between the film industry and the archiving community that is tasked with preserving cultural cinematic productions. 

Jimi Jones

Chin receives NSF CAREER award

Assistant Professor Jessie Chin has received a National Science Foundation (NSF) CAREER award to support lifelong learning and foster information literacy. This prestigious award is given in support of early-career faculty who have the potential to serve as academic role models in research and education and to lead advances in the mission of their department or organization. Chin’s project, “Search as a Mechanism for Learning,” will be supported by a five-year, $629,451 grant from the NSF.

Jessie Chin

What are the effects of trade restrictions on digital technologies?

President Donald Trump has threatened to levy higher tariffs on more than two dozen countries and on various products in the past few months. China in particular has been a target of the administration’s trade wars, aimed at preventing its dominance in areas such as artificial intelligence, although the U.S. government announced recently that it would sell advanced semiconductors used in AI to China. Assistant Professor Meicen Sun spoke with News Bureau arts and humanities editor Jodi Heckel about the effects of trade restrictions.

Meicen Sun

Hassan selected for IAPP Westin Scholar Award

PhD student Muhammad Hassan has been selected as an IAPP Westin Scholar Award honoree. The annual awards were created by the International Association of Privacy Professionals (IAPP) to support students who are identified as future leaders in the field of privacy and data protection. 

Muhammad Hassan

Bak defends dissertation

PhD candidate Michelle Bak successfully defended her dissertation, "Promoting a Healthy and Comprehensive Diet through Theory-Driven Large Language Models-based Agents," on July 14.

Chaewon Bak