iSchool researchers receive best paper award at TrustNLP

Sullam Jeoung
Sullam Jeoung
Jana Diesner
Jana Diesner, Associate Professor and BSIS Program Director
Halil Kilicoglu
Halil Kilicoglu, Associate Professor

A paper coauthored by PhD student Sullam Jeoung, Associate Professor Jana Diesner, and Associate Professor Halil Kilicoglu was named Best Long Paper at TrustNLP: Third Workshop on Trustworthy Natural Language Processing, which was held in conjunction with the Annual Conference of the Association for Computational Linguistics (ACL 2023). In their paper, "Examining the Causal Impact of First Names on Language Models: The Case of Social Commonsense Reasoning," the researchers discuss how the use of first names in language models can impact their trustworthiness.

"Language models are increasingly used and deployed across various applications and domains that engage with users, ranging from some recent popular models such as ChatGPT and Bard to applications such as AI counseling," explained Jeoung. "As language models are used in circumstances where social intelligence and commonsense reasoning are becoming important, it is imperative to ensure the trustworthiness of language models."

Through a controlled experiment to measure the causal effect of first names on reasoning, the researchers were able to distinguish between model predictions due to chance and those caused by factors of interest. Their results indicate that the frequency of first names in a model has a direct effect on its prediction.

"Our findings suggest that to ensure model robustness, it is essential to augment datasets with more diverse first names during the configuration stage," said Jeoung.

Updated on
Backto the news archive

Related News

Petrella defends dissertation

Doctoral candidate Julia Burns Petrella successfully defended her dissertation, "Educating Pre-Service School Librarians about Race, Racism, and Whiteness," on December 4.

Julia Burns Petrella

Guo defends dissertation

Doctoral candidate Qiuyan Guo successfully defended her dissertation, "Exploring Chinese Celebrity Fans’ Online Information Behaviors and Understandings of Their Practices," on December 6.

Qiuyan Guo

Tilley featured in comic book

Associate Professor Carol Tilley had an unexpected citation in her favorite medium—comic books! Dav Pilkey, author and illustrator of a number of bestselling and award-winning children’s books, including the popular Captain Underpants series, depicts Tilley's research on psychiatrist Fredric Wertham in his newest comic, Cat Kid Comic Club Influencers.

Dav Pilkey's comic depicting Carol Tilley

BIG projects span the globe

This fall, students in the Business Intelligence Group (BIG), the student consultancy group associated with Associate Professor Yoo-Seong Song's Applied Business Research class (IS 514), worked on projects related to supply chain management, digital health, biotechnology, and higher education for companies located at the University of Illinois Research Park and overseas in East Asia and Africa. 

Internship Spotlight: State Farm

BSIS student Evan Chen discusses his summer internship at State Farm, where he developed an interest in computer vision.

Evan Chen