New project to make online learning more accessible

Yun Huang
Yun Huang, Associate Professor

While traditional closed captions represent the spoken part of a video, important content may not be expressed, to the detriment of audiences who depend on captions to understand the material being presented. With the increasing reliance on videos in online learning, this becomes even more problematic. A new collaborative project being led by Assistant Professor Yun Huang will focus on explanatory captions, which give insight into a video's visual and audio content as well as the spoken word. Her project, "Advancing STEM Online Learning by Augmenting Accessibility with Explanatory Captions and AI," has received a three-year $526,006 grant (totaling $849,994 with two collaborators at Gallaudet University and University at Notre Dame) from the National Science Foundation (NSF).

"Explanatory captions have the potential to play a new role in STEM learning," said Huang. "This project will work to devise effective Q/A mechanisms and interaction designs, such as chatbots, that enable students and instructors to generate explanatory captions for STEM videos in a collaborative manner."

The proposed technologies will make videos more accessible to the deaf and hard-of-hearing (DHH) community and non-native English speakers. Evaluation sites will include Gallaudet University, the world's only liberal arts university dedicated exclusively to educating DHH learners, and the University of Illinois Urbana-Champaign, which has the largest international student population among U.S. public universities.

Huang's research areas include social computing, human-computer interaction, mobile computing, and crowdsourcing. She received her PhD in information and computer science from the University of California, Irvine.

Updated on
Backto the news archive

Related News

McDowell to present keynote on data storytelling

Associate Professor Kate McDowell will present the closing keynote of the Measures of Success Educator Impact Series at Western Michigan University (WMU) on March 21. The virtual series, which is sponsored by the WMUx Office of Faculty Development, focuses on equity and educator impact.

Kate McDowell

Dahlen selected as judge for National Book Awards

Associate Professor Sarah Park Dahlen has been selected by the National Book Foundation to serve as a judge for the 74th National Book Awards. The foundation chose 25 judges for this year's awards, which are given in the categories of fiction, nonfiction, poetry, translated literature, and young people’s literature.

Sarah Park Dahlen

Downie to present keynote at CHIIR 2023

Professor and Associate Dean For Research J. Stephen Downie will be the keynote speaker for the 2023 ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2023), which will be held on March 19-23 in Austin, Texas. In addition to information interaction and retrieval, the multidisciplinary conference explores topics such as human-human information interaction, novel interaction paradigms, new evaluation methods, and related research from various fields.

Stephen Downie

Lawrence Auld, former faculty member, passes away

Lawrence W.S. Auld (PhD '75) passed away on March 2, 2023. He returned to school to earn a PhD in library and information science from the University of Illinois Urbana-Champaign and served on the faculty at UIUC and then at East Carolina University until his retirement in 2003.

Lawrence Auld

Postdoctoral Research Associate Program prepares future faculty

In the 2021-2022 academic year, the iSchool launched its Postdoctoral Research Associate Program. The goal of this program is to prepare candidates for tenure-track assistant professor or other appointments inside and outside of academia. The cohort has grown to five postdocs, and applications are currently being accepted for the 2023-2024 academic year.