National Center for Advancing Translational Sciences (NCATS) Resources
CTSA Compendium of D&I Catalogs - (click to open)
The CTSA Compendium of D&I Catalogs provides a curated list of resource catalogs relevant to the conduct of Dissemination & Implementation (D&I) science. The resource catalogs gathered here include frameworks/theories/models, methods/measures, funding resources, practice resources, training, and health equity resources. Included resource catalogs are curated/sponsored by academic and non-profit organizations with expertise in D&I; contain multiple resources that are systematically organized; and are (in almost all cases) both open-access and actively maintained/updated.
How to use the D&I Catalogs tool (detailed PDF): Use the Sort and Filter functions below to view resources in categories of interest, or to view “featured resources.” Use the D&I Resource Suggestion Form to suggest a new catalog for inclusion.
This resource was developed by the Clinical & Translational Science Awards (CTSA) Program’s “Advancing Dissemination and Implementation Sciences in CTSAs” working group. This group focuses on meeting both the conceptual as well as practical challenges to advancing the utilization of D&I across the translational science spectrum. In particular, this group focuses on the “how” of D&I integration within CTSA hubs nationally, and on creating and disseminating practical tools, resources, and insights that CTSAs can use to fully realize the potential of D&I to enhance CTSAs’ mission.
CTSA Working Group - the new D&I Working Group page is scheduled to be released in mid-October. More on the CTSA Website: https://ncats.nih.gov/ctsa
LOCAL RESOURCES - UNIVERSITY OF PITTSBURGH
Institute for Clinical Research and Education (ICRE) Courses directly relevant to D&I
- CLRES 2215: Foundations of Implementation Science Part I (1 credit, offered every Spring)
- CLRES 2216: Foundations of Implementation Science: Bedsides to Health Systems Part II (1 credit, offered every Spring)
- CLRES 2220: Applying Quality Improvement Methods in the Clinical Context (1 credit, offered every Fall)
- CLRES 2431: Translating Research for Policy and Practice (1 credit, offered every Spring)
- CLRES 2729: Idea 2 Impact (I2I) – ONLINE (1 credit, offered every Fall)
- CLRES 2731: From Benchtop to Bedside: What Every Scientist Needs to Know (2 Credits, offered every Spring)
QualEASE (part of the Center for Healthcare Research data Center) - D&I/Implementation research, or research conducted with D&I in mind, often includes qualitative elements as part of its investigation of the context where health interventions will take place.
Clinical and Translational Science Institute (CTSI) Consultations - For consultations with regulatory support, biostatistics, research design, informatics, pilot funding or a general consultation, fill out this brief form
IMPACT (Implementation to Maximize Population And Community Translation) Core: - Assists with projects in any stage of development, from conceptualization to polishing/revision of a finished product, and both with projects designated as “D&I” and projects simply designed with implementation/impact in mind.Services include:
- Identification of training resources related to dissemination, implementation, or D&I Science
- Assistance with applying for CTSI D&I Science Pilot Awards
- Assistance with community engagement techniques for promoting participant receptivity and research reciprocity
- Assistance with Human-Centered Design techniques for project development, collaborative brainstorming
- Review of grant proposals/current research projects including:
- Conceptual review/assistance with understanding D&I terminology and writing clear specific aims
- Advice on application of abstract concepts in D&I frameworks
- Input on implementation strategies
- Advice on how to lay the groundwork in current projects for future dissemination, implementation, and/or sustainability (i.e. how to “design for D&I”)
- Advice on how to bolster trials through “hybridization” of designs to allow collection of data on implementation factors (such as feasibility and acceptability)
Community PARTners Core -
For researchers, the Core helps develop studies that address the complex health questions which community partners state are most concerning. It provides training as well as funding opportunities for research development and partnered data collection.
For community organizations, the Core assists with providing evidence-based research interventions and practices. It supports communities with “getting the word out” on health research awareness and education.
Services include:
- Community Engagement Studios where small groups of (patient, provider, caregiver, etc.) community members answer questions about their lived experience
- Research ethics training for community partners involved in research studies (CPRET)
- Navigation of Stakeholder Engagement resources at Pitt
- Guidance on research and recruiting in schools across Western Pennsylvania:
- Background information on general school policies and guidelines
- Introductions to schools
- Assistance with IRB protocols
- Letters of support and contracts
- Presentations to school administrators
Materials and Videos from our Team
Evidence on the Effectiveness of Implementation Strategies: A Landscape Review Healthcare providers and systems use an array of implementation strategies to incorporate evidence-based practices into routine care, but navigating the evidence for these strategies can be challenging. Under contract with PCORI, a team of investigators from the RAND Corporation completed a landscape review of evidence for these implementation strategies, identifying implementation strategies with the strongest evidence of effectiveness. This resource can inform efforts by practitioners and others to select strategies for effectively implementing evidence-based practices into care delivery.
INFORMATION & NETWORKS
- ACCORDS (The Adult and Child Consortium for Outcomes Research and Delivery Science) D&D Program at the University of Colorado
- Advancing Dissemination and Implementation in CTSAs: A working Group
- Center for Prevention Implementation Methodology
- NHLBI Center for Translational Research and Implementation Science
- Implementation Science Centers for Cancer Control (ISC3)
- Implementation Science Exchange (IMPSCIX)
- National Implementation Research Network (NIRN)
- NIRN Active Implementation Hub
- Society for Implementation Research Collaboration (SIRC)
- VA Quality Enhancement Research Initiative (QUERI)
- VA QUERI Implementation Research Group (IRG)
- Penn Implementation Science Center at the Leonard Davis Institute (PISCE@LDI) for Health Economics at the University of Pennsylvania
Monthly e-Newsletters
- Implementation Science News, Consortium for Implementation Science: subscribe here
- NCI Implementation Science Updates: subscribe here
- University of Wisconsin-Madison Institute for Clinical & Translational Research D&I Launchpad: register here
- VA QUERI Implementation Research Group (IRG) Newsletter: contact CEIR@va.gov to subscribe
TRAININGS
Certificate or Degree Programs
- Dissemination and Implementation (D&I) Science Graduate Certificate Program: ACCORDS Dissemination and Implementation Graduate Certificate Program University of Colorado Anschutz Medical Campus
- University of California San Francisco Online Courses and Certificate Program in Implementation Science
- University of Washington in St. Louis Graduate Certificate in Dissemination and Implementation Science
- University of Washington, Seattle PhD program in Implementation Science
- U Penn Certificate in Implementation Science
- University of Maryland Implementation & Dissemination Science Graduate Certificate Program
Training Institutes for Junior or Mid-Career Researchers
- Colorado Pragmatic Research in Health Conference (COPRH)
- Duke Population Health Science Summer Institute
- The HIV, Infectious Disease and Global Health Implementation Research Institute (HIGH IRI)
- Institute for Implementation Science Scholars: IS-2
- Institute on Implementation Practice (UNC)
- Training Institute for Dissemination and Implementation Research in Cancer (TIDIRC)
- TIDIRC Open Access archived training
- University of California San Francisco Implementation Science Short Course
- University of Pennsylvania Implementation Science Institute
- University of Washington, Seattle Implementation Science in Global Health Summer Institute
- University of Wisconsin ICTR Dissemination & Implementation Short Course
CONFERENCES
- Annual Conference on the Science of Dissemination & Implementation in Health co-hosted by NIH and AcademyHealth
- Biennual Society for Implementation Research Collaboration (SIRC)
- Global Implementation Conference
- VHA Health Services Research & Development (HSR&D) and Quality Enhancement Research Initiative (QUERI) National Conference
- Society of Behavioral Medicine Annual Meeting
- Society for Prevention Research (SPR) Annual Meeting
RESOURCES
Methods and Tools
- ACCORDS Advancing the Science resources
- Agency for Healthcare Research & Quality, The Practice Facilitation Handbook: Training Modules for New Facilitators and Their Trainers
- Centers for Disease Control & Prevention Introduction to Program Evaluation for Public Health Programs: A Self-study Guide
- Columbia University’s Implementation Science Initiative Resources for Health Equity and Anti-Racism
- COM-B Model for Behavior Change – The Decision Lab
- Community Tool Box
- Community Engagement Studios: A Structured Approach to Obtaining Meaningful Input From Stakeholders to Inform Research
- CFIR - Consolidated Framework for Implementation Research (CFIR website, recording on Matt Chinman's presentation on the updated CFIR)
- Clinical & Translational Science Awards Program compendium of D&I papers
- Dissemination & implementation models in health research and practice
- Exploration, Preparation, Implementation, Sustainment (EPIS) framework
- Global Implementation Initiative resources
- Getting to Outcomes® (GTO) framework
- IDEO - Application of design for health care
- Improvement Science Research Network
- Institute for Healthcare Improvement
- NCI Implementation Science at a Glance guide
- NCI Implementation Science Research and Practice Tools
- NIH Pragmatic Clinical Trials Collaboratory
- Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) program planning and evaluation framework
- Stanford University/Palo Alto VA Medical Center Fidelity, Adaptation, Sustainability, and Training Lab (F.A.S.T. Lab)
- TDR Implementation Research Toolkit
- Tools for identifying, selecting, and implementing evidence-based Interventions
- University of Washington – Seattle Implementation Science Resource Hub
- University of Washington at St. Louis D&I Toolkits
- VA QUERI Roadmap for Implementation and Quality Improvement: A Resource Guide
- VA QUERI Using Implementation Facilitation to Improve Healthcare: Implementation Facilitation Training Manual Version 3.0
Implementation Science Journal
Implementation Science on YouTube
- UCLA Rapid, Rigorous, Relevant Implementation Science Hub YouTube Playlist
- "Essential Implementation" hosted by Kristian Hudson with the Improvement Academy in Yorkshire, England
- Interdisciplinary Research Leaders - Research and Science Course
Implementation Science Podcasts
- LeaRRN Podcast: Learning Health Systems Rehabilitation Research Network
- Implementation Science for Educators on Apple Podcasts
- UNC: Lessons Learned in Implementation Science on Apple Podcasts
- J of Public Health Management and Practice: Implementation Science Podcast
De-Implementation Articles & Resources
- Complete bibliography (updated 7/17/23)
- van Bodegom-Vos L, Davidoff F, Marang-van de Mheen PJ Implementation and de-implementation: two sides of the same coin? BMJ Quality & Safety 2017;26:495-501.
- Virginia Wang, Matthew L. Maciejewski, Christian D. Helfrich, Bryan J. Weiner, Working smarter not harder: Coupling implementation to de-implementation, Healthcare, 2018;6:(2):104-107 (email DISC@pitt.edu for PDF)
- Norton et al. Studying de-implementation in health: an analysis of funded research grants. Implementation Science 2017;12:144
- McKay et al. Letting Go: Conceptualizing Intervention De-implementation in Public Health and Social Service Settings Am J Community Psychol, 2018;62:189–202
- Norton, W.E., Chambers, D.A. Unpacking the complexities of de-implementing inappropriate health interventions. Implementation Sci 2020;15(2)
- Nilsen, P., Ingvarsson, S., Hasson, H., von Thiele Schwarz, U., & Augustsson, H. Theories, models, and frameworks for de-implementation of low-value care: A scoping review of the literature. Implementation Research and Practice, 2020;1.
- Walsh-Bailey, C., Tsai, E., Tabak, R.G. et al. A scoping review of de-implementation frameworks and models. Implementation Sci 2021;16, 100
- Augustsson, H., Ingvarsson, S., Nilsen, P. et al. Determinants for the use and de-implementation of low-value care in health care: a scoping review. Implement Sci Commun 2021;2:13
- Norton et al. DeImplementing Ineffective and Low-Value Clinical Practices: Research and Practice Opportunities in Community Oncology Settings, JNCI Cancer Spectrum, 2021;5(2)
- What Potentially Makes De-Implementation Different Than Implementation and Why Does it Mat... (va.gov)
- Promoting Health Equity through De-Implementation Research - PubMed (nih.gov)
- How the dual process model of human cognition can inform efforts to de‐implement ineffective and harmful clinical practices: A preliminary model of unlearning and substitution - Helfrich - 2018 - Journal of Evaluation in Clinical Practice - Wiley Online Library
- Recommendations for the Use of Audit and Feedback to De-Implement Low-Value Care (sagepub.com)
- Wynne Norton’s 12/6/23 cyber seminar at the UTHealth Houston Institute for Implementation Science on de-Implementation “Current Approaches and Future Directions in Advancing De-implementation Research.” (Recording)
QUALITATIVE AND MIXED METHODS TRAININGS AND RESOURCES
- The Consolidated Framework for Implementation Research (CFIR.org)
- ACCORDS Iterative RE-AIM and PRISM resources
- Checklists for using the Tailored Implementation for Chronic Diseases’ (TICD)
- Framework-informed codebook for analyzing qualitative data using the integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) framework
- Guide to using the Theoretical Domains Framework (TDF)
- NCI Qualitative Methods in Implementation Science (QualRIS) Whitepaper
- ResearchTalk, Inc - Qualitative Research Summer Intensive & Camps
- University of Michigan Mixed Methods Program
- Johns Hopkins Bloomberg School of Public Health Mixed Methods Research Training Program for the Health Sciences
- Stanford University Mixed Methods Research Workshop
FUNDING OPPORTUNITIES
- University of Pittsburgh Clinical and Translational Science Institute (CTSI)
- National Institude of Health (NIH) PAR 22-109. (This is the parent announcement for D&I/Implementation Science grants for multiple study sections)
- PCORI (Patient Centered Outcomes Research Institute)
- Open Competition PFA
- Other D&I Focused visit their Funding Opportunities page and search for "implementation"
- Agency for Research Healthcare and Quality (AHRQ)
Updated February 2024