Upcoming Workshop

Evidence Integration Workshop

Workshop
June 3, 2019 - June 4, 2019
See on google maps

Location: National Academy of Sciences Building
2101 Constitution Ave NW Washington DC 20418



The National Academies of Sciences, Engineering, and Medicine will be holding a workshop on June 3-4, 2019, in Washington, DC, on evidence integration, which is a summary step of the systematic review in human health assessments conducted by the US Environmental Protection Agency (EPA). Topic areas include:
-- Lessons Learned from Recent International Workshops on Evidence integration in Risk Assessment,
-- Best Practices in Evidence Integration,
-- Approaches for Using Mechanistic Data to Integrate Evidence from Animal and Human Studies: General Considerations,
-- Systematic Review-Enabled Evidence Integration: Case Studies, and
-- Practical Approaches to Expedited Evidence Integration.

Evidence integration, also referred to as weight-of-evidence evaluation, is a summary step of the systematic review in human health assessments conducted by EPA's National Center for Environmental Assessment. During this step, conclusions are drawn from each line of evidence that is relevant to the predefined PECO criteria. (PECO refers to population, exposure, comparators, and outcomes.) Evidence integration generally involves subjecting the relevant evidence to a causal analysis, which can be conducted using both qualitative and quantitative approaches. This is a structured process by which conclusions are drawn regarding the potential health effects in exposed humans, incorporating judgments about the strength of the human and animal evidence (both within and across lines of evidence) as well as information from mechanistic data necessary to answer key questions.

The overall objective of the workshop is to explore strategies for addressing challenges that arise for EPA during evidence integration in chemical assessments, with a primary focus on the use of mechanistic data. Poster sessions will accompany the workshop to address topics that are relevant to the workshop session topics.

Workshop Committee:
Ivan Rusyn, Texas A&M University (Chair)
Richard Corley, Greek Creek Toxicokinetics Consulting, LLC
Ana Navas-Acien, Columbia University
Andrew Rooney, National Toxicology Program
Holger Schunemann, McMaster University
Peter Thorne, University of Iowa
Katya Tsaioun, Johns Hopkins University
Joyce Tsuji, Exponent, Inc.

View posters and presentations from Workshop 1 here.


Click the presentation title to download a PDF of the presentation slides. Click the "video" link to watch video from the event.

Presentations


Welcome and Overview of the Workshop | Video

Ivan Rusyn, Texas A&M University


SESSION I: Lessons Learned from Recent International Workshops on Evidence Integration in Risk Assessment

 

Combining Apples and Oranges: Lessons Learned and Advances Made through International Collaboration | Video

Katya Tsaioun, Johns Hopkins University

 

Panel Discussion I: 
Kris Thayer, US Environmental Protection Agency | Video
Holger Schünemann, McMaster University | Video
Paul Whaley, Lancaster University | Video
Holger Schünemann, McMaster University | Video
General discussion | Video

 

SESSION II: Best Practices in Evidence Integration

 

Perspectives on Common Elements for Evidence Integration | Video

Weihsueh Chiu, Texas A&M University

 

Emerging Strategies for Evidence Integration | Video

Bette Meek, University of Ottawa

 

Experience with Incorporating GRADE-Based Evidence Integration Frameworks into Environmental Health Evaluations | Video

Kris Thayer, US Environmental Protection Agency

 

Panel Discussion II | Video


SESSION III. Approaches for Using Mechanistic Data to Integrate Evidence from Animal and Human Studies: General Considerations

 

Practical Challenges in Assessing Indirectness and the Implications for Integrating Multiple Streams of Evidence in Systematic Reviews | Video

Paul Whaley, Lancaster University

 

Investigating the Causality of Adverse Effects: Mechanistic Toxicology Meets Epidemiology | Video

Jean-Lou Dorne and Marios Georgiadis, European Food Safety Authority

 

Panel Discussion III | Video

 

Day 2 Welcome and Opening Remarks | Video

 

SESSION IV. Systematic Review-Enabled Evidence Integration: Case Studies

 

Case Study 1: Systematic Review-Enabled Evidence Integration for Predictive Modeling of Endocrine Disruption Pathways  | Video

Nicole Kleinstreuer, National Toxicology Program

 

Panel Discussion IV | Video

 

Case Study 2: Integrating Evidence across Multiple Exposures: Applying the OHAT Framework to Traffic-Related Air Pollution and Hypertensive Disorders of Pregnancy | Video

Brandy Beverly, National Toxicology Program

 

Panel Discussion V | Video

 

Case Study 3: Use of Mechanistic Data for Evidence Integration across PCBs as a Chemical Class | Video

Larry Robertson, University of Iowa

 

Panel Discussion VI | Video

 

 

SESSION V. Practical Approaches to Expedited Evidence Integration

 

A Streamlined, Scientifically Rigorous Approach to Categorize Health Hazards [NASEM 2018: Review of Report and Approach to Evaluating Long-Term Health Effects in Army Test Subjects] | Video

Ivan Rusyn, Texas A&M University

 

Elk River Chemical Spill Assessments | Video

Michael Dourson, Toxicology Excellence for Risk Assessment

 

Clinical Research Applications: Influenza Virus Drugs | Video

Holger Schünemann, McMaster University

 

Panel Discussion VII | Video

 

Closing Remarks | Video

Holger Schünemann, McMaster University

 

 

Posters


#1 - Visualizing the Evidence: Exploring and Explaining Your Data via Interactive Methods

Courtney Skuce, Alessandria Schumacher, George Agyeman-Badu, Pam Hartman, and Kim Osborn

ICF

 

#2 - SyRF: Systematic Review Facility

Jing Liao and Malcolm Macleod

University of Edinburgh

 

#3 - Evaluating the Consistency of Heterogeneous Results: Important Determinants of Inconsistency

Barbara S. Glenn, Elizabeth Radke, and Andrew Kraft

Office of Research and Development, US Environmental Protection Agency

 

#4 - Semi-Automated Data Extraction Workbench for Environmental Health

B. Howard, A. Maharana, A. Tandon, and Ruchir Shah

Sciome, LLC

 

#5 - Evidence Synthesis and Integration in the IRIS Program

Xabier Arzuaga and Andrew Kraft

Office of Research and Development, US Environmental Protection Agency

 

#6 - Research Update: Using SWIFT-Active Screener to Reduce the Expense of Evidence Based Toxicology

B. Howard, A. Tandon, J. Phillips, A. Maharana, and Ruchir Shah

Sciome LLC

 

#7 - Role of Semantics, Ontologies, and Adverse Outcome Pathways as a Point of Integration in Chemical Assessments

Michelle Angrish(1), George Woodall(1), Sean Watford(2), and Paul Whaley(3)

(1)Office of Research and Development, US Environmental Protection Agency; (2)Booz Allen Hamilton, Washington, DC; (3)Lancaster Environment Centre, Lancaster, UK

 

#8 - Strengthening the Evaluation of Mechanistic Evidence Categorized by the IARC 10 Key Characteristics of Carcinogens

Kirsten Zu, Julie E. Goodman, Robyn L. Prueitt

Gradient

 

#9 - Evidence Integration in Integrated Science Assessments

Michael J. Stewart, Ellen Kirrane, Thomas J. Luben, Jason Sacks, Barbara Buckley, and Jennifer Nichols

Office of Research and Development, US Environmental Protection Agency

 

#10 - Systematically Evaluating and Integrating Evidence in National Ambient Air Quality Standards (NAAQS) Reviews

Julie E. Goodman(1), Giffe Johnson(2), Robyn L. Prueitt(1), Kirsten (Ke) Zu(1)

(1)Gradient; (2)NCASI

 

#11 - Modeling Mechanistic Processes from Source to Outcome to Support Evidence Integration and Inform Risk Assessment

David E. Hines, Rory B. Conolly, and Annie M. Jarabek

Office of Research and Development, US Environmental Protection Agency

 

#12 - Application of the EFSA/ECHA Endocrine Disruption Guidance as a Framework for Evidence Integration in a Weight-of-Evidence (WoE) Analysis for Oxybenzone (BP-3)

Susan Borghoff, Seneca Fitch, Janice Britt, Kara Franke, and Daniele Wikoff

ToxStrategies

 

#13 - Using In Vitro ToxCast Assays to Evaluate Mechanistic Plausibility and Build Confidence in the Selection of Analogues for Quantitative Read-Across: A Case Study on p,p’-Dichlorodiphenyldichloroethane n

Lucina E. Lizarraga, Jeffry L. Dean, J. Phillip Kaiser, Scott C. Wesselkamper, Jason C. Lambert, Elizabeth O. Owens, Belinda Hawkins, and Q. Jay Zhao.

Office of Research and Development, US Environmental Protection Agency

 

#14 - Targeted Mechanistic Evidence Synthesis to Inform Evidence Integration Decisions on the Potential Human Carcinogenicity of Naphthalene Exposure

Ingrid Druwe(1), Janice Lee(1), Kris Thayer(1), John Bucher(2), and Erin Yost(1)

(1)Office of Research and Development, US Environmental Protection Agency; (2)National Toxicology Program, National Institute of Environmental Health Sciences

 

#15 - Three-Tiered approach to Integrating Evidence Streams Assessing Gestational Trichloroethylene Exposure and Congenital Heart Defects (TCE-CHD)

Jon D. Urban, Daniele Wikoff, and Laurie Haws

ToxStrategies

 

#16 - Evidence Integration in Deriving Toxicity-Based Benchmarks for Trichloroethylene

Thomas E. Sussan, Mark S. Johnson, and Glenn J. Leach

Toxicology Directorate, Army Public Health Center

 

#17 - A Fit-for-Purpose Framework for Use of Systematic Methods in Risk Assessment

Daniele Wikoff(1), Neeraja Erraguntla(2), Jeff Lewis(3) and Jennifer Foreman(3)

(1)ToxStrategies; (2)American Chemistry Council; (3)Exxon Biomedical

 

#18 - Evidence-Based Dose-Response Assessment for Thyroid Tumorigenesis from Acrylamide

Michael Dourson(1), Richard Hertzberg(2), Bruce Allen(3), Lynne Haber(4), Ann Parker(4), Oliver Kroner(5), Andy Maier(6), Melissa Kohrman(6)

(1)Toxicology Excellence for Risk Assessment; (2)Emory University; (3)Allen and Associates; (4)University of Cincinnati; (5)City of Cincinnati; (6)Cardno ChemRisk

 

#19 - Evidence Integration Using AOP Networks: Assessing Human Health Risks Associated with Hydrogen Sulfide Exposure

Katy O. Goyak and R. Jeffrey Lewis

ExxonMobil Biomedical Sciences, Inc.

 

#20 - Complex Evidence Integration Using Evidence-Based Tables: A Case Study Using the NTP Cancer Hazard Assessment of Night Shift Work and Light at Night Related to Circadian Disruption

Suril Mehta(1), Pamela Schwingl(2), Gloria Jahnke(1), Stanley Atwood(2), Sandford Garner(2), and Ruth Lunn(1)

(1)National Toxicology Program, National Institute of Environmental Health Sciences; (2)Integrated Laboratory Systems

 

#21 - Mechanistic Evidence Integration Case Study: Using Ten Key Characteristics of Carcinogens and a Systematic Review Approach for Antimony Trioxide (Sb2O3) Cancer Hazard Identification

Amy Wang(1), Joanne Trgovcich(2), Kristine L. Witt(1), Andrew Ewens(3), Jessica Geter(3)(formerly), Sanford Garner(3), Gloria Jahnke(1), Stephanie L. Smith-Roe(1), and Ruth Lunn(1)

(1)National Toxicology Program, National Institute of Environmental Health Sciences; (2)ICF; (3)Integrated Laboratory Systems

 

#22 - Using Study Evaluation to Inform Evidence Integration: Application in a Systematic Review of Hexavalent Chromium Male Reproductive Outcomes

Erin Yost, Xabier Arzuaga, Alan Sasso, and Catherine Gibbons

Office of Research and Development, US Environmental Protection Agency

 

#23 - Systematized Review Approaches in the Assessment of Tobacco Toxicants: Acrolein as a Case Study

Mary Kushman, R. Phillip Yeager, Susan Chemerynski, Roxana Weil, Xin Fu, and Hans Rosenfeldt

ToxStrategies, Inc.

 

#24 - Accelerating Chemical Assessments: A Case Study in Automatic Evidence Extraction from Text

Catherine Blake(1) and Jodi Flaws(2)

(1)School of Information Sciences and Department of Computer Science, University of Illinois, Urbana; (2)Department of Comparative Biosciences, College of Veterinary Medicine, University of Illinois, Urbana.

 

#25 - Exposure Evidence Integration in Systematic Review

Kevin Hobbie, A. Williams, T. Feiler, C. Henning, H. Hubbard

ICF

 

#26 - Technological Tools for Evidence Integration

Shane Thacker, Jennifer Nichols, and Ryan Jones

Office of Research and Development, US Environmental Protection Agency