Chen defends dissertation

Doctoral candidate Si Chen successfully defended her dissertation, "Designing Ethical Emotion AI-based Learning Experience among Ability-Diverse Users," on July 30.

Her committee included Associate Professor Yun Huang (chair); Professor Yang Wang; Assistant Professor Nigel Bosch; and Raja Kushalnagar, professor in the Department of Science, Technology, Accessibility, Mathematics, and Public Health at Gallaudet University.

Abstract: Emotion AI, also known as affective computing, encompasses the recognition, interpretation, simulation, and response to human emotions and cues. Despite its potential, there has been limited systematic exploration of its ethical and inclusive design, particularly in the realm of online learning. This thesis examines the ethical considerations surrounding emotion AI for inclusive online education. Specifically, the research makes novel contributions for two learner groups: the hearing community and the d/Deaf or hard of hearing (DHH) community. For hearing learners, recognition of emotions from facial movements can be applied to enhance their self-awareness and improve knowledge sharing in video-based learning. Combining facial expression recognition with self-reported emojis enables these learners to express and reflect on their emotions more comprehensively than by using emojis alone. For DHH learners, emotion AI is more effective when they have access to video comments in American Sign Language (ASL) rather than just English captions in video-based online learning. Additionally, ASL video comments featuring cartoon-like filters displaying human-like emotions are more entertaining and engaging for DHH learners, fostering a stronger sense of connection with their peers. To promote inclusive learning between hearing and DHH learners, a design fiction approach is further employed, which proposes customizable overlay solutions for seamless interactions among these diverse learners, enhancing inclusivity while preserving emotional authenticity. While this thesis centers on designing inclusive emotion AI for video-based learning, the insights offer both theoretical and practical implications in broader application domains.

Updated on
Backto the news archive

Related News

Get to Know Deekshita Karingula, MSIM Student

After graduation, Deekshita Karingula would like to build data pipelines, automate workflows for greater efficiency, and use data to transform healthcare. She views the MSIM program as the "ideal way" to connect her computer science and technical skills with data management skills, helping her reach her goals.

Deekshita Karingula

Hoiem receives Schiller Prize for “Education of Things”

Associate Professor Elizabeth Hoiem has won the 2025 Justin G. Schiller Prize from The Bibliographical Society of America for her book, The Education of Things: Mechanical Literacy in British Children's Literature, 1762-1860 (University of Massachusetts Press). The prize, which recognizes the best bibliographical work on pre-1951 children's literature, includes a cash award of $3,000 and a year's membership in the Society. 

Elizabeth Hoiem

Chan authors new book connecting eugenics and Big Tech

Associate Professor Anita Say Chan has authored a new book that identifies how the eugenics movement foreshadows the predatory data tactics used in today's tech industry. Her book, Predatory Data: Eugenics in Big Tech and Our Fight for an Independent Future, was released this month by the University of California Press and featured in the news outlets San Francisco Chronicle and Mother Jones.

Anita Say Chan

CCB contributes to new Books to Parks site on Lyddie

The Center for Children's Books (CCB) collaborated with the National Park Service (NPS) to launch a new Books to Parks website on Lyddie, a 1991 novel by Katherine Paterson that highlights the experiences of young women working in textile mills in nineteenth-century Lowell, Massachusetts. 

Lyddie book