Chen defends dissertation

Doctoral candidate Si Chen successfully defended her dissertation, "Designing Ethical Emotion AI-based Learning Experience among Ability-Diverse Users," on July 30.

Her committee included Associate Professor Yun Huang (chair); Professor Yang Wang; Assistant Professor Nigel Bosch; and Raja Kushalnagar, professor in the Department of Science, Technology, Accessibility, Mathematics, and Public Health at Gallaudet University.

Abstract: Emotion AI, also known as affective computing, encompasses the recognition, interpretation, simulation, and response to human emotions and cues. Despite its potential, there has been limited systematic exploration of its ethical and inclusive design, particularly in the realm of online learning. This thesis examines the ethical considerations surrounding emotion AI for inclusive online education. Specifically, the research makes novel contributions for two learner groups: the hearing community and the d/Deaf or hard of hearing (DHH) community. For hearing learners, recognition of emotions from facial movements can be applied to enhance their self-awareness and improve knowledge sharing in video-based learning. Combining facial expression recognition with self-reported emojis enables these learners to express and reflect on their emotions more comprehensively than by using emojis alone. For DHH learners, emotion AI is more effective when they have access to video comments in American Sign Language (ASL) rather than just English captions in video-based online learning. Additionally, ASL video comments featuring cartoon-like filters displaying human-like emotions are more entertaining and engaging for DHH learners, fostering a stronger sense of connection with their peers. To promote inclusive learning between hearing and DHH learners, a design fiction approach is further employed, which proposes customizable overlay solutions for seamless interactions among these diverse learners, enhancing inclusivity while preserving emotional authenticity. While this thesis centers on designing inclusive emotion AI for video-based learning, the insights offer both theoretical and practical implications in broader application domains.

Updated on
Backto the news archive

Related News

Get to know Cadence Cordell, MSLIS student

Cadence Cordell was inspired by her undergraduate work experience to pursue a degree in library and information science. She followed in her mother’s footsteps by selecting the iSchool for her MSLIS. After completing a recent research poster presentation, she combined her scholarly pursuit with her hobby by sewing her fabric poster into a squirrel plushie.

Cadence Cordell

Recent graduate committed to making libraries accessible and inclusive

Joshua Short knows firsthand the barriers to public library access that patrons living on modest wages experience. Having grown up in a self-professed "low-income environment," Short has made it his mission to reduce these barriers, such as library fines, inadequate transportation, and limited computer literacy.

Joshua Short

Spectrum Scholar Spotlight: Leslie Lopez

Twelve iSchool master's students were named 2024–2025 Spectrum Scholars by the American Library Association (ALA) Office for Diversity, Literacy, and Outreach Services. This “Spectrum Scholar Spotlight” series highlights the School’s scholars. MSLIS student Leslie Lopez graduated from the University of North Texas with a BA in psychology.

Leslie Lopez headshot

SafeRBot to assist community, police in crime reporting

Across the nation, 911 dispatch centers are facing a worker shortage. Unfortunately, this understaffing, plus the nature of the job itself, leads to dispatchers who are often overworked and stressed. Meanwhile, when community members need to report a crime, their options are to contact 911 for an emergency or, in a non-emergency situation, call a non-emergency number or fill out an online form. A new chatbot, SafeRBot, designed and developed by Associate Professor Yun Huang, Informatics PhD student Yiren Liu, and BSIS student Tony An seeks to improve the reporting process for non-emergency situations for both community members and dispatch centers.

Yun Huang

New digital collection sheds light on queer nightlife in Champaign County

Adam Beaty decided to pursue an MSLIS degree to combine his love of history, the arts, and community-centered spaces. This combination of interests culminated in a 244-item digital collection that showcases digitized materials depicting nearly thirty years of queer nightlife in Champaign County. 

Adam Beaty_headshot