New project to make online learning more accessible

Yun Huang
Yun Huang, Associate Professor

While traditional closed captions represent the spoken part of a video, important content may not be expressed, to the detriment of audiences who depend on captions to understand the material being presented. With the increasing reliance on videos in online learning, this becomes even more problematic. A new collaborative project being led by Assistant Professor Yun Huang will focus on explanatory captions, which give insight into a video's visual and audio content as well as the spoken word. Her project, "Advancing STEM Online Learning by Augmenting Accessibility with Explanatory Captions and AI," has received a three-year $526,006 grant (totaling $849,994 with two collaborators at Gallaudet University and University at Notre Dame) from the National Science Foundation (NSF).

"Explanatory captions have the potential to play a new role in STEM learning," said Huang. "This project will work to devise effective Q/A mechanisms and interaction designs, such as chatbots, that enable students and instructors to generate explanatory captions for STEM videos in a collaborative manner."

The proposed technologies will make videos more accessible to the deaf and hard-of-hearing (DHH) community and non-native English speakers. Evaluation sites will include Gallaudet University, the world's only liberal arts university dedicated exclusively to educating DHH learners, and the University of Illinois Urbana-Champaign, which has the largest international student population among U.S. public universities.

Huang's research areas include social computing, human-computer interaction, mobile computing, and crowdsourcing. She received her PhD in information and computer science from the University of California, Irvine.

Updated on
Backto the news archive

Related News

Spectrum Scholar Spotlight: Dalia Ortiz Pon

Twelve iSchool master's students were named 2024–2025 Spectrum Scholars by the American Library Association (ALA) Office for Diversity, Literacy, and Outreach Services. This "Spectrum Scholar Spotlight" series highlights the School's scholars. MSLIS student Dalia Ortiz Pon earned her bachelor's degree in Latina/Latino studies from San Francisco State University. 

Dalia Ortiz Pon

Debnath datafies "The Bulletin"

MSIM student Tan Debnath, whose interests span data mining, statistical modeling, text mining, and digital humanities, joined the Center for Children's books as a research assistant. He was tasked with building curation processes that would datafy seventy-five years' worth of archival issues of The Bulletin of the Center for Children's Books, one of the nation's leading children's book review journals.

Tan Debnath stands casually with his hands in his pockets and smiles broadly at the camera. It's a sunny day

He receives Amazon Research Award to improve monitoring of Earth’s ecosystem

A new project led by Professor Jingrui He aims to help scientists monitor disruptions to the Earth’s ecosystem, such as climate change. She recently received support for her work through an Amazon Research Award, which includes $60,000 in cash and an additional $40,000 in Amazon Web Services (AWS) credits.

Jingrui He

iSchool undergraduates selected as 2025 Community-Academic Scholars

The Interdisciplinary Health Sciences Institute (IHSI) has selected BSIS student Dhanvi Puttur and BSIS+DS student Lara Terpetschnig as 2025 Community-Academic Scholars. Representing nineteen majors and nine minors in eight colleges and schools at the University of Illinois Urbana-Champaign and two additional universities, the eighteen scholars in this cohort encompass diverse fields of study, from community health to graphic design to statistics. 

BSIS+DS student Lara Terpetschnig and BSIS student Dhanvi Puttur

Scholarship provides validation, motivation for Martinez

BSIS+DS student Fabian Martinez chose his major because he wanted to learn how to help people understand and interpret data and information. While his immediate plans include finding a job in data analytics, business analytics, consulting, or product management, his ultimate goal is "to create meaningful relationships and help make a meaningful impact in the world" in whatever way he can.

Fabian Martinez graduation