Chen defends dissertation

Doctoral candidate Si Chen successfully defended her dissertation, "Designing Ethical Emotion AI-based Learning Experience among Ability-Diverse Users," on July 30.

Her committee included Associate Professor Yun Huang (chair); Professor Yang Wang; Assistant Professor Nigel Bosch; and Raja Kushalnagar, professor in the Department of Science, Technology, Accessibility, Mathematics, and Public Health at Gallaudet University.

Abstract: Emotion AI, also known as affective computing, encompasses the recognition, interpretation, simulation, and response to human emotions and cues. Despite its potential, there has been limited systematic exploration of its ethical and inclusive design, particularly in the realm of online learning. This thesis examines the ethical considerations surrounding emotion AI for inclusive online education. Specifically, the research makes novel contributions for two learner groups: the hearing community and the d/Deaf or hard of hearing (DHH) community. For hearing learners, recognition of emotions from facial movements can be applied to enhance their self-awareness and improve knowledge sharing in video-based learning. Combining facial expression recognition with self-reported emojis enables these learners to express and reflect on their emotions more comprehensively than by using emojis alone. For DHH learners, emotion AI is more effective when they have access to video comments in American Sign Language (ASL) rather than just English captions in video-based online learning. Additionally, ASL video comments featuring cartoon-like filters displaying human-like emotions are more entertaining and engaging for DHH learners, fostering a stronger sense of connection with their peers. To promote inclusive learning between hearing and DHH learners, a design fiction approach is further employed, which proposes customizable overlay solutions for seamless interactions among these diverse learners, enhancing inclusivity while preserving emotional authenticity. While this thesis centers on designing inclusive emotion AI for video-based learning, the insights offer both theoretical and practical implications in broader application domains.

Updated on
Backto the news archive

Related News

iSchool alumni and student named 2025 Movers & Shakers

Two iSchool alumni and an MSLIS student are included in Library Journal's 2025 class of Movers & Shakers, an annual list that recognizes 50 professionals who are moving the library field forward as a profession. Leah Gregory (MSLIS '04) was honored in the Advocates category, Billy Tringali (MSLIS '19) was honored in the Innovators category, and University Library Assistant Professor and Digital Humanities Librarian Mary Ton (current MSLIS student) was honored in the Educators category.

Spectrum Scholar Spotlight: Dalia Ortiz Pon

Twelve iSchool master's students were named 2024–2025 Spectrum Scholars by the American Library Association (ALA) Office for Diversity, Literacy, and Outreach Services. This "Spectrum Scholar Spotlight" series highlights the School's scholars. MSLIS student Dalia Ortiz Pon earned her bachelor's degree in Latina/Latino studies from San Francisco State University. 

Dalia Ortiz Pon

Debnath datafies "The Bulletin"

MSIM student Tan Debnath, whose interests span data mining, statistical modeling, text mining, and digital humanities, joined the Center for Children's books as a research assistant. He was tasked with building curation processes that would datafy seventy-five years' worth of archival issues of The Bulletin of the Center for Children's Books, one of the nation's leading children's book review journals.

Tan Debnath stands casually with his hands in his pockets and smiles broadly at the camera. It's a sunny day

He receives Amazon Research Award to improve monitoring of Earth’s ecosystem

A new project led by Professor Jingrui He aims to help scientists monitor disruptions to the Earth’s ecosystem, such as climate change. She recently received support for her work through an Amazon Research Award, which includes $60,000 in cash and an additional $40,000 in Amazon Web Services (AWS) credits.

Jingrui He

iSchool undergraduates selected as 2025 Community-Academic Scholars

The Interdisciplinary Health Sciences Institute (IHSI) has selected BSIS student Dhanvi Puttur and BSIS+DS student Lara Terpetschnig as 2025 Community-Academic Scholars. Representing nineteen majors and nine minors in eight colleges and schools at the University of Illinois Urbana-Champaign and two additional universities, the eighteen scholars in this cohort encompass diverse fields of study, from community health to graphic design to statistics. 

BSIS+DS student Lara Terpetschnig and BSIS student Dhanvi Puttur