Chen defends dissertation

Si Chen
Si Chen

Doctoral candidate Si Chen successfully defended her dissertation, "Designing Ethical Emotion AI-based Learning Experience among Ability-Diverse Users," on July 30.

Her committee included Associate Professor Yun Huang (chair); Professor Yang Wang; Assistant Professor Nigel Bosch; and Raja Kushalnagar, professor in the Department of Science, Technology, Accessibility, Mathematics, and Public Health at Gallaudet University.

Abstract: Emotion AI, also known as affective computing, encompasses the recognition, interpretation, simulation, and response to human emotions and cues. Despite its potential, there has been limited systematic exploration of its ethical and inclusive design, particularly in the realm of online learning. This thesis examines the ethical considerations surrounding emotion AI for inclusive online education. Specifically, the research makes novel contributions for two learner groups: the hearing community and the d/Deaf or hard of hearing (DHH) community. For hearing learners, recognition of emotions from facial movements can be applied to enhance their self-awareness and improve knowledge sharing in video-based learning. Combining facial expression recognition with self-reported emojis enables these learners to express and reflect on their emotions more comprehensively than by using emojis alone. For DHH learners, emotion AI is more effective when they have access to video comments in American Sign Language (ASL) rather than just English captions in video-based online learning. Additionally, ASL video comments featuring cartoon-like filters displaying human-like emotions are more entertaining and engaging for DHH learners, fostering a stronger sense of connection with their peers. To promote inclusive learning between hearing and DHH learners, a design fiction approach is further employed, which proposes customizable overlay solutions for seamless interactions among these diverse learners, enhancing inclusivity while preserving emotional authenticity. While this thesis centers on designing inclusive emotion AI for video-based learning, the insights offer both theoretical and practical implications in broader application domains.

Updated on
Backto the news archive

Related News

Allgood is 'all in' on information science

MSLIS student Evan Allgood's volunteer work showed him that a career in information science would bring all his interests together in one field: accessibility, literature, history, technology, databases, and community building.

Evan Allgood

iSchool researchers to present at ASSETS 2024

iSchool faculty and students will present their research at the 26th International Association for Computing Machinery (ACM) Special Interest Group (SIG) ACCESS Conference on Computers and Accessibility (ASSETS 2024), which will be held on October 28-30 in St. John's, Newfoundland and Labrador, Canada. The conference is the premier forum for presenting research on design, evaluation, use, and education related to computing for people with disabilities and older adults.

MSIM students win Chicago round of NASA hackathon

A team including MSIM students Kritika Singh and Jainam Rajput won the Chicago hackathon of the NASA Space Apps Challenge, which was held in over 450 locations worldwide on October 5-6. The students partnered with computer science master's students Shraddhaa Mohan, Jinang Gandhi, and Sai Krishna Rohith and engineering in autonomy and robotics master's student Jugal Upadhyay to form Team Cuberts.

Members of Team Cuberts:  Jugal Bipinkumar Upadhyay, Jainam Rajput, Sai Krishna Rohith Kattamuri, Shraddhaa Mohan, Kritika Singh, and Jinang Gandhi.

Spectrum Scholar Spotlight: Armaan Singh Kalkat

Twelve iSchool master's students were named 2024-2025 Spectrum Scholars by the American Library Association (ALA) Office for Diversity, Literacy, and Outreach Services. This "Spectrum Scholar Spotlight" series highlights the School's scholars. MSLIS student Armaan Singh Kalkat graduated from the University of Florida with a BA in linguistics and BS in psychology (with an emphasis on neuroscience).

Armaan Singh Kalkat

iSchool well represented at ASIS&T 2024

iSchool faculty, staff, and students will participate in the 87th Annual Meeting of the Association for Information Science and Technology (ASIS&T), which will be held on October 25-29 in Calgary, Canada. The theme of this year's conference is "Putting People First: Responsibility, Reciprocity, and Care in Information Research and Practice." The meeting is the premier international conference dedicated to the study of information, people, and technology in contemporary society.

iSchool Building