New project to make online learning more accessible

Yun Huang
Yun Huang, Associate Professor

While traditional closed captions represent the spoken part of a video, important content may not be expressed, to the detriment of audiences who depend on captions to understand the material being presented. With the increasing reliance on videos in online learning, this becomes even more problematic. A new collaborative project being led by Assistant Professor Yun Huang will focus on explanatory captions, which give insight into a video's visual and audio content as well as the spoken word. Her project, "Advancing STEM Online Learning by Augmenting Accessibility with Explanatory Captions and AI," has received a three-year $526,006 grant (totaling $849,994 with two collaborators at Gallaudet University and University at Notre Dame) from the National Science Foundation (NSF).

"Explanatory captions have the potential to play a new role in STEM learning," said Huang. "This project will work to devise effective Q/A mechanisms and interaction designs, such as chatbots, that enable students and instructors to generate explanatory captions for STEM videos in a collaborative manner."

The proposed technologies will make videos more accessible to the deaf and hard-of-hearing (DHH) community and non-native English speakers. Evaluation sites will include Gallaudet University, the world's only liberal arts university dedicated exclusively to educating DHH learners, and the University of Illinois Urbana-Champaign, which has the largest international student population among U.S. public universities.

Huang's research areas include social computing, human-computer interaction, mobile computing, and crowdsourcing. She received her PhD in information and computer science from the University of California, Irvine.

Updated on
Backto the news archive

Related News

Garnes receives Coretta Scott King-Virginia Hamilton Award for Lifetime Achievement

Carolyn L. Garnes (MSLIS '72) has received the 2025 Coretta Scott King-Virginia Hamilton Award for Lifetime Achievement from the American Library Association (ALA). The annual award, named in honor of award-winning children's book author Virginia Hamilton, is presented in odd years "to a practitioner for substantial contributions through active engagement with youth using award-winning African American literature for children and/or young adults, via implementation of reading and reading-related activities/programs."

Carolyn L. Garnes

Undergraduate Research Symposium features iSchool students and mentors

Several iSchool undergraduate students will participate in the 18th annual Undergraduate Research Symposium. During the event, visitors will learn about undergraduate research projects through oral and poster presentations, creative performances, and art exhibits. All are welcome to attend the symposium, which will be held on April 24 from 9:00 a.m.-5:00 p.m. in the Illini Rooms and South Lounge of the Illini Union. Oral presentations will be held on the second floor of the Illini Union.

Wang wins grand prize at Research Live!

Informatics PhD student Olivia Wang won the Grand Prize at the 2025 Research Live! competition, which was held on April 8 in the Campus Instructional Facility Atrium. At the event, which is hosted by the Graduate College, thirteen finalists presented their graduate research in three minutes or less to a general audience. Wang received $500 as the Grand Prize winner.

Olivia Wang

iSchool at Illinois ranked number one

The iSchool at Illinois has retained its top spot in U.S. News & World Report's 2025 ranking of graduate schools offering a master's degree in library and information studies. The iSchool has held the number one ranking for nearly three decades.

iSchool Building