Informatics approach improves precision of outcome detection for systematic reviews

Catherine Blake
Catherine Blake, Professor and Associate Dean for Academic Affairs

A new informatics approach developed by Associate Professor Catherine Blake and Rebecca Kehm, a post-doctoral fellow at Columbia University Mailman School of Public Health, will assist physicians and researchers in their systematic review of medical literature. While previous automated methods to identify outcomes have extracted sentences, Blake and Kehm introduce a more precise method that extracts noun phrases rather than the entire sentence.

A sentence can contain more than one outcome and can include both outcome and non-outcome components, which makes using a noun phrase a better option for literature reviews. The researchers use machine learning to automatically detect new outcomes (endpoints) from the methods section of 88K MEDLINE abstracts, and discovered that 96.7% of the outcomes could be represented as a noun phrase. The results also suggest that structural information about how authors communicate outcomes, in particular by using lists, gave better performance than a machine learning approach.

The resulting paper, "Comparing breast cancer treatments using automatically detected surrogate and clinically relevant outcomes entities from text," was published in the Journal of Biomedical Informatics (vol. 1, March 2019).

"This is an exciting step forward," Blake said. "The increased precision in using noun phrases rather than a sentence enables us to compare different treatment strategies with respect to clinically relevant or surrogate endpoints."

From their review of medical literature related to breast cancer treatments, Blake and Kehm found that the most clinically relevant outcome (overall survival) is not the most frequently reported outcome for all treatments, for example disease-free survival is reported more than overall survival in hormone therapy abstracts.

Blake's research interests include biomedical informatics, natural language processing, evidence-based discovery, learning health systems, socio-technical systems, and data analytics. In addition to her professorial role, she serves the iSchool as associate director of the Center for Informatics Research in Science and Scholarship and as program director of the MS in information management and the MS in bioinformatics. Prior to coming to Illinois, she was a faculty member at the School of Information and Library Science at the University of North Carolina, Chapel Hill, a research scientist, and an applications programmer. Blake holds a PhD and MS in information and computer science from the University of California, Irvine, and an MS and BS in computer science from the University of Wollongong, Australia.

Updated on
Backto the news archive

Related News

iSchool instructors ranked as excellent

Fifty-six iSchool instructors were named in the University's List of Teachers Ranked as Excellent for Fall 2024 and Winter 2024-2025. The rankings are released every semester, and results are based on the ratings from the Instructor and Course Evaluation System (ICES) questionnaire forms maintained by Measurement and Evaluation in the Center for Innovation in Teaching and Learning. 

iSchool Building

Ocepek and Sanfilippo co-edit book on misinformation

Assistant Professor Melissa Ocepek and Assistant Professor Madelyn Rose Sanfilippo have co-edited a new book, Governing Misinformation in Everyday Knowledge Commons, which was recently published by Cambridge University Press. An open access edition of the book is available, thanks to support from the Governing Knowledge Commons Research Coordination Network (NSF 2017495). The new book explores the socio-technical realities of misinformation in a variety of online and offline everyday environments. 

Governing Misinformation in Everyday Knowledge Commons book

Faculty receive support for AI-related projects from new pilot program

Associate Professor Yun Huang, Assistant Professor Jiaqi Ma, and Assistant Professor Haohan Wang have received computing resources from the National Artificial Intelligence Research Resource (NAIRR), a two-year pilot program led by the National Science Foundation in partnership with other federal agencies and nongovernmental partners. The goal of the pilot is to support AI-related research with particular emphasis on societal challenges. Last month, awardees presented their research at the NAIRR Pilot Annual Meeting.

iSchool participation in iConference 2025

The following iSchool faculty and students will participate in iConference 2025, which will be held virtually from March 11-14 and physically from March 18-22 in Bloomington, Indiana. The theme of this year's conference is "Living in an AI-gorithmic world."

Carboni joins the iSchool faculty

The iSchool is pleased to announce that Nicola Carboni has joined the faculty as an assistant professor. He previously served as a postdoctoral researcher and lecturer in digital humanities at the University of Geneva.

Nicola Carboni