New approach improves systematic reviews of scientific literature

Catherine Blake
Catherine Blake, Professor and Associate Dean for Academic Affairs

Risk assessments are conducted to determine if a chemical found in the environment is harmful to public health; for example, answering questions such as "does chemical 'x' promote cancer?" Conducting an impartial analysis of chemicals is thus critical to ensure that public policies reflect the best available scientific evidence. Unfortunately, the process of retrieving, extracting, and analyzing findings reported in scientific literature is time consuming and can delay when policies are updated to reflect new evidence.

Professor Catherine Blake and Jodi A. Flaws, professor of comparative biosciences at the University of Illinois, have developed an automated approach that moves beyond the retrieval of relevant literature to the extraction step of the information synthesis process. In a recent study of cell death and proliferation—two fundamental hallmarks of cancer—they demonstrate how simply counting the number of outcomes shows a very different picture than focusing on how key outcomes have changed.

"Systems currently just focus on the retrieval step, and if you base decisions solely on the number of abstracts retrieved, you would make the wrong decision," said Blake. "You have to look at the directionality of the evidence."

The natural language processing (NLP) system that Blake developed scales to over 400,000 abstracts and identifies the directionality of evidence (refuting, neutral, or supporting) for 27 different chemicals. Their approach automates the extraction step, providing researchers with waffle plots that visually present the distribution of supporting, neutral, and refuting evidence for each chemical. For example, in the waffle plots below, chemical 1 has more refuting evidence whereas chemical 22 has more supporting evidence.

waffle plots of 27 chemicals showing refuting and supporting evidence

This automated approach provides researchers with important detail that is missing in existing automated systems, which is closer to the manual processes used in decision-making, and also maintains the level of transparency needed in a public policy setting. Blake and Flaws' study, "Using semantics to scale up evidence-based chemical risk-assessments," was recently published in the peer-reviewed open access journal PLOS One.

Blake's research seeks to accelerate science and inform policy by automatically extracting and summarizing claims reported in the scientific literature. She holds a PhD and MS in information and computer science from the University of California, Irvine, and an MS and BS in computer science from the University of Wollongong, Australia.

Updated on
Backto the news archive

Related News

Desai defends dissertation

Doctoral candidate Smit Desai successfully defended his dissertation, "Designing Metaphor-fluid Voice User Interfaces," on June 10.

Smit Desai

Student says ‘thank you’ with a helicopter ride

Last month, Michael Ferrer showed his appreciation for one of his MSIM instructors in a unique way—by inviting him for an insider’s look at his work as a reservist in the Illinois Army National Guard. For the ILARNG BOSS Lift, which took place on June 18 at Camp Atterbury, Indiana, Ferrer selected Michael Wonderlich, iSchool adjunct lecturer and senior associate director of business intelligence and enterprise architecture for Administrative Information Technology Services (AITS) at the University of Illinois.

Michael Wonderlich and Michael Ferrer hold a U of I flag in front of a military helicopter

Project helps librarians use data storytelling to advocate for public libraries

A toolkit for public librarians can help them use data to communicate the value of their services and justify their funding needs. The Data Storytelling for Librarians Toolkit helps librarians present data in story form using narrative strategies. It was developed by University of Illinois Urbana-Champaign information sciences professors.

Kate McDowell

Chan to deliver keynote at SIGCIS 2024

Associate Professor Anita Say Chan will deliver the keynote at the 15th annual conference of the SHOT (Society for the History of Technology) Special Interest Group for Computing, Information, and Society (SIGCIS), which will be held on July 14 in Viña del Mar, Chile. SIGCIS is the leading international group for historians with an interest in the history of information technology and its applications. The theme for SIGCIS 2024 is "System Update: Patches, Tactics, Responses."

Anita Say Chan

Mattson receives ISTE Making It Happen Award

Adjunct Lecturer Kristen Mattson has received the 2024 International Society for Technology in Education (ISTE) Making It Happen Award. The award honors educators and leaders who demonstrate outstanding commitment, leadership, courage, and persistence in improving digital learning opportunities for students.

Kristen Mattson