New project to make online learning more accessible

Yun Huang
Yun Huang, Associate Professor

While traditional closed captions represent the spoken part of a video, important content may not be expressed, to the detriment of audiences who depend on captions to understand the material being presented. With the increasing reliance on videos in online learning, this becomes even more problematic. A new collaborative project being led by Assistant Professor Yun Huang will focus on explanatory captions, which give insight into a video's visual and audio content as well as the spoken word. Her project, "Advancing STEM Online Learning by Augmenting Accessibility with Explanatory Captions and AI," has received a three-year $526,006 grant (totaling $849,994 with two collaborators at Gallaudet University and University at Notre Dame) from the National Science Foundation (NSF).

"Explanatory captions have the potential to play a new role in STEM learning," said Huang. "This project will work to devise effective Q/A mechanisms and interaction designs, such as chatbots, that enable students and instructors to generate explanatory captions for STEM videos in a collaborative manner."

The proposed technologies will make videos more accessible to the deaf and hard-of-hearing (DHH) community and non-native English speakers. Evaluation sites will include Gallaudet University, the world's only liberal arts university dedicated exclusively to educating DHH learners, and the University of Illinois Urbana-Champaign, which has the largest international student population among U.S. public universities.

Huang's research areas include social computing, human-computer interaction, mobile computing, and crowdsourcing. She received her PhD in information and computer science from the University of California, Irvine.

Updated on
Backto the news archive

Related News

Jang awarded the Jeffrey S. Tanaka Grant for Asian American Studies

PhD student Inyoung Jang has been awarded the Jeffrey S. Tanaka Grant for Asian American Studies for her project, "Semi-Basement Housing as Cold War Infrastructure: State Violence and the Legacies of American and Asian Imperialism and Colonialism in South Korea." The grant provides up to $1,000 for direct research expenses, including travel and material purchases.

Inyoung Jang

Student award recipients announced

The School of Information Sciences recognized student award recipients at the iSchool Convocation on May 18. Awards are based on academic achievements as well as attributes that contribute to professional success. For more information about each award, including past recipients, visit the Student Awards page. Congratulations to this year's honorees!

Award recipients Mahir Thakkar, Delia Kerr-Dennhardt, Katie Skoufes, Audrey Bentch, and Adam Beaty.

Education of Things named a SHARP Book Prize finalist

A book by Associate Professor Elizabeth Hoiem, The Education of Things: Mechanical Literacy in British Children's Literature, 1762-1860, has been named a finalist for the Society for the History of Authorship, Reading and Publishing (SHARP) Book History Book Prize. 

Elizabeth Hoiem

iSchool alumni and student named 2025 Movers & Shakers

Two iSchool alumni and an MSLIS student are included in Library Journal's 2025 class of Movers & Shakers, an annual list that recognizes 50 professionals who are moving the library field forward as a profession. Leah Gregory (MSLIS '04) was honored in the Advocates category, Billy Tringali (MSLIS '19) was honored in the Innovators category, and University Library Assistant Professor and Digital Humanities Librarian Mary Ton (current MSLIS student) was honored in the Educators category.