Underwood receives NEH grant to investigate consequences of error in digital libraries

Ted Underwood
Ted Underwood, Professor

Professor Ted Underwood has received a $73,122 grant from the National Endowment for the Humanities to investigate the consequences of error in digital libraries. While digital libraries represent an immense storehouse of knowledge, the texts are full of errors because of the imperfect process by which they are transcribed optically.

"It isn't unusual for five percent of the words in volumes to be mistranscribed, with the level of error much higher in some volumes," said Underwood. "Simply measuring the fraction of mistranscribed words is easy. It’s harder to know how much difference those errors make for the methods and questions that actually interest researchers. Some forms of analysis are undisturbed by high levels of error; others may be quite sensitive, especially when errors are distributed unevenly across different historical periods and genres."

Underwood will work with graduate students from the iSchool and English Department to construct parallel collections that pair each "clean" text with a realistically error-ridden version of the same book drawn from a digital library. The team will build collections of Chinese texts as well as English texts ranging from 1700 to the present, because different character sets and printing technologies produce different kinds of error. Then the team will apply a wide range of data-mining methods to both the clean and error-ridden collections and measure the distortion produced by transcription error and other common sources of noise. The project will provide tools that help other researchers estimate the level of uncertainty in their own conclusions.

"No data is perfect. There's always some kind of error. The question is whether the error is of a kind and magnitude likely to matter for a particular question," he said.

Underwood is a professor in the iSchool and also holds an appointment with the Department of English in the College of Liberal Arts and Sciences. He has authored three books about literary history, including Distant Horizons (The University of Chicago Press Books, 2019), Why Literary Periods Mattered: Historical Contrast and the Prestige of English Studies (Stanford University Press, 2013), and The Work of the Sun: Literature, Science and Political Economy 1760-1860 (New York: Palgrave, 2005). His articles have appeared in PMLA, Representations, MLQ, and Cultural Analytics. Underwood earned his PhD in English from Cornell University.

Updated on
Backto the news archive

Related News

Desai defends dissertation

Doctoral candidate Smit Desai successfully defended his dissertation, "Designing Metaphor-fluid Voice User Interfaces," on June 10.

Smit Desai

Student says ‘thank you’ with a helicopter ride

Last month, Michael Ferrer showed his appreciation for one of his MSIM instructors in a unique way—by inviting him for an insider’s look at his work as a reservist in the Illinois Army National Guard. For the ILARNG BOSS Lift, which took place on June 18 at Camp Atterbury, Indiana, Ferrer selected Michael Wonderlich, iSchool adjunct lecturer and senior associate director of business intelligence and enterprise architecture for Administrative Information Technology Services (AITS) at the University of Illinois.

Michael Wonderlich and Michael Ferrer hold a U of I flag in front of a military helicopter

Project helps librarians use data storytelling to advocate for public libraries

A toolkit for public librarians can help them use data to communicate the value of their services and justify their funding needs. The Data Storytelling for Librarians Toolkit helps librarians present data in story form using narrative strategies. It was developed by University of Illinois Urbana-Champaign information sciences professors.

Kate McDowell

Chan to deliver keynote at SIGCIS 2024

Associate Professor Anita Say Chan will deliver the keynote at the 15th annual conference of the SHOT (Society for the History of Technology) Special Interest Group for Computing, Information, and Society (SIGCIS), which will be held on July 14 in Viña del Mar, Chile. SIGCIS is the leading international group for historians with an interest in the history of information technology and its applications. The theme for SIGCIS 2024 is "System Update: Patches, Tactics, Responses."

Anita Say Chan

Mattson receives ISTE Making It Happen Award

Adjunct Lecturer Kristen Mattson has received the 2024 International Society for Technology in Education (ISTE) Making It Happen Award. The award honors educators and leaders who demonstrate outstanding commitment, leadership, courage, and persistence in improving digital learning opportunities for students.

Kristen Mattson