New project to make online learning more accessible

Yun Huang
Yun Huang, Associate Professor

While traditional closed captions represent the spoken part of a video, important content may not be expressed, to the detriment of audiences who depend on captions to understand the material being presented. With the increasing reliance on videos in online learning, this becomes even more problematic. A new collaborative project being led by Assistant Professor Yun Huang will focus on explanatory captions, which give insight into a video's visual and audio content as well as the spoken word. Her project, "Advancing STEM Online Learning by Augmenting Accessibility with Explanatory Captions and AI," has received a three-year $526,006 grant (totaling $849,994 with two collaborators at Gallaudet University and University at Notre Dame) from the National Science Foundation (NSF).

"Explanatory captions have the potential to play a new role in STEM learning," said Huang. "This project will work to devise effective Q/A mechanisms and interaction designs, such as chatbots, that enable students and instructors to generate explanatory captions for STEM videos in a collaborative manner."

The proposed technologies will make videos more accessible to the deaf and hard-of-hearing (DHH) community and non-native English speakers. Evaluation sites will include Gallaudet University, the world's only liberal arts university dedicated exclusively to educating DHH learners, and the University of Illinois Urbana-Champaign, which has the largest international student population among U.S. public universities.

Huang's research areas include social computing, human-computer interaction, mobile computing, and crowdsourcing. She received her PhD in information and computer science from the University of California, Irvine.

Updated on
Backto the news archive

Related News

New book explores video standards in film and archives

A new book co-authored by iSchool Adjunct Lecturer Jimi Jones and Marek Jancovic, assistant professor of media studies at Vrije Universiteit Amsterdam, examines video file standards and the tensions that have emerged between the film industry and the archiving community that is tasked with preserving cultural cinematic productions. 

Jimi Jones

Chin receives NSF CAREER award

Assistant Professor Jessie Chin has received a National Science Foundation (NSF) CAREER award to support lifelong learning and foster information literacy. This prestigious award is given in support of early-career faculty who have the potential to serve as academic role models in research and education and to lead advances in the mission of their department or organization. Chin’s project, “Search as a Mechanism for Learning,” will be supported by a five-year, $629,451 grant from the NSF.

Jessie Chin

What are the effects of trade restrictions on digital technologies?

President Donald Trump has threatened to levy higher tariffs on more than two dozen countries and on various products in the past few months. China in particular has been a target of the administration’s trade wars, aimed at preventing its dominance in areas such as artificial intelligence, although the U.S. government announced recently that it would sell advanced semiconductors used in AI to China. Assistant Professor Meicen Sun spoke with News Bureau arts and humanities editor Jodi Heckel about the effects of trade restrictions.

Meicen Sun

Hassan selected for IAPP Westin Scholar Award

PhD student Muhammad Hassan has been selected as an IAPP Westin Scholar Award honoree. The annual awards were created by the International Association of Privacy Professionals (IAPP) to support students who are identified as future leaders in the field of privacy and data protection. 

Muhammad Hassan

Bak defends dissertation

PhD candidate Michelle Bak successfully defended her dissertation, "Promoting a Healthy and Comprehensive Diet through Theory-Driven Large Language Models-based Agents," on July 14.

Chaewon Bak