New approach improves systematic reviews of scientific literature

Catherine Blake
Catherine Blake, Professor

Risk assessments are conducted to determine if a chemical found in the environment is harmful to public health; for example, answering questions such as "does chemical 'x' promote cancer?" Conducting an impartial analysis of chemicals is thus critical to ensure that public policies reflect the best available scientific evidence. Unfortunately, the process of retrieving, extracting, and analyzing findings reported in scientific literature is time consuming and can delay when policies are updated to reflect new evidence.

Professor Catherine Blake and Jodi A. Flaws, professor of comparative biosciences at the University of Illinois, have developed an automated approach that moves beyond the retrieval of relevant literature to the extraction step of the information synthesis process. In a recent study of cell death and proliferation—two fundamental hallmarks of cancer—they demonstrate how simply counting the number of outcomes shows a very different picture than focusing on how key outcomes have changed.

"Systems currently just focus on the retrieval step, and if you base decisions solely on the number of abstracts retrieved, you would make the wrong decision," said Blake. "You have to look at the directionality of the evidence."

The natural language processing (NLP) system that Blake developed scales to over 400,000 abstracts and identifies the directionality of evidence (refuting, neutral, or supporting) for 27 different chemicals. Their approach automates the extraction step, providing researchers with waffle plots that visually present the distribution of supporting, neutral, and refuting evidence for each chemical. For example, in the waffle plots below, chemical 1 has more refuting evidence whereas chemical 22 has more supporting evidence.

waffle plots of 27 chemicals showing refuting and supporting evidence

This automated approach provides researchers with important detail that is missing in existing automated systems, which is closer to the manual processes used in decision-making, and also maintains the level of transparency needed in a public policy setting. Blake and Flaws' study, "Using semantics to scale up evidence-based chemical risk-assessments," was recently published in the peer-reviewed open access journal PLOS One.

Blake's research seeks to accelerate science and inform policy by automatically extracting and summarizing claims reported in the scientific literature. She holds a PhD and MS in information and computer science from the University of California, Irvine, and an MS and BS in computer science from the University of Wollongong, Australia.

Updated on
Backto the news archive

Related News

iSchool researchers receive Lee Dirks Award for Best Paper

A paper authored by PhD student Yuerong Hu, HTRC Associate Director for Research Support Services Glen Layne-Worthey, Alaine Martaus (PhD '19), Professor J. Stephen Downie, and Associate Professor Jana Diesner, "Research with User-Generated Book Review Data: Legal and Ethical Pitfalls and Contextualized Mitigations," has received the Lee Dirks Award for Best Paper at iConference 2023.

iSchool instructors ranked as excellent

Fifty-one iSchool instructors were named in the University's List of Teachers Ranked as Excellent for Fall 2022. The rankings are released every semester, and results are based on the Instructor and Course Evaluation System (ICES) questionnaire forms maintained by Measurement and Evaluation in the Center for Innovation in Teaching and Learning. Only those instructors who gave out ICES forms during the semester and who released their data for publication are included in the list.

iSchool Building

Knox receives Oboler Memorial Award for book on intellectual freedom

Associate Professor Emily Knox has received the 2023 Eli M. Oboler Memorial Award from the Intellectual Freedom Round Table of the American Library Association (ALA). She was selected for the award, which recognizes the best published work in the area of intellectual freedom, for her book, Foundations of Intellectual Freedom (ALA Neal-Schuman, 2022).

Emily Knox

McDowell to present keynote on data storytelling

Associate Professor Kate McDowell will present the closing keynote of the Measures of Success Educator Impact Series at Western Michigan University (WMU) on March 21. The virtual series, which is sponsored by the WMUx Office of Faculty Development, focuses on equity and educator impact.

Kate McDowell

Dahlen selected as judge for National Book Awards

Associate Professor Sarah Park Dahlen has been selected by the National Book Foundation to serve as a judge for the 74th National Book Awards. The foundation chose 25 judges for this year's awards, which are given in the categories of fiction, nonfiction, poetry, translated literature, and young people’s literature.

Sarah Park Dahlen