kaiser permanente national guideline program implications of iom sr standards
DESCRIPTION
Kaiser Permanente National Guideline Program Implications of IOM SR Standards. Wiley Chan, MD Physician, Internal Medicine Methodologist, KP National Guideline Program. Kaiser Permanente: Largest Non-Profit Health Care Program in the United States. Founded in 1945 - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/1.jpg)
April 2009Netta Conyers-Haynes,Principal Consultant, Communications
Kaiser PermanenteNational Guideline Program
Implications of IOM SR Standards
Wiley Chan, MDPhysician, Internal MedicineMethodologist, KP National Guideline Program
![Page 2: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/2.jpg)
Kaiser Permanente: Largest Non-Profit Health Care Program in the United States
Founded in 1945 8 regions in 9 states
and District of Columbia8.6 million members (as of 12/09)
15,129 physicians (as of 12/09)
164,098 employees (as of 12/09)
KP Care Management Institute (CMI)
KP National Guideline Program (NGP)
Kaiser Foundation Hospitals
PermanenteMedicalGroups
KaiserFoundationHealth Plan
Kaiser Permanente
![Page 3: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/3.jpg)
Kaiser Permanente Evidence Network
15 KP National Evidence-Based Guidelines Supported by full Systematic Reviews
3.5 Staff FTEs dedicated to KP NGP work 1 Principal Consultant , 2 Analysts, 2 Project Managers
1.5 Physician FTEs dedicated to KP NGP work 7 Physician EBM Methodologists
External vendor: Doctor Evidence Search & Data Extraction Technology platform
• Data repository, analysis & documentation
![Page 4: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/4.jpg)
Kaiser Permanente National Guideline Program: Process & MethodologyNew
ClinicalIssue
ScheduledUpdate
ClinicalQuestions
(CQ)
ExistingGuideline?
CQMatch?
AssessGuideline
Acceptable?
ExistingSR by CQ?
AssessSR
Acceptable?
New RelevantStudies?
EvidenceSearch
AbstractArticleReview
Inclusion/Exclusion
DataExtraction
CriticalAppraisal
Qualitative/QuantitativeSynthesis
AssessEvidenceQuality
EvidenceSummary Rationale Recommendations
AssessImplementability ofRecommendations
GDT Approval
Internal Review
GQNGD
Approval
NationalGuideline
Yes
Yes
Yes
Yes
Yes
Yes
No
No
No
No
No
No
Implementation
OverviewKey to Abbreviations:• CQ Clinical Question• SR Systematic Review• GDT Guideline Development Team• GQ Guideline Quality Committee• NGD KP National Guideline
Directors
![Page 5: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/5.jpg)
Kaiser Permanente National Guideline Program: Process & MethodologyNew
ClinicalIssue
ScheduledUpdate
ClinicalQuestions
(CQ)
ExistingGuideline?
CQMatch?
AssessGuideline
Acceptable? GDT Approval
Internal Review
GQNGD
Approval
NationalGuideline
Yes
Yes
Yes
Implementation
Acceptable External GuidelineADAPTE/AGREE
![Page 6: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/6.jpg)
Kaiser Permanente National Guideline Program: Process & MethodologyNew
ClinicalIssue
ScheduledUpdate
ClinicalQuestions
(CQ)
ExistingGuideline?
CQMatch?
AssessGuideline
Acceptable?
ExistingSR by CQ?
AssessSR
Acceptable?
New RelevantStudies?
EvidenceSummary Rationale Recommendations
AssessImplementability ofRecommendations
GDT Approval
Internal Review
GQNGD
Approval
NationalGuideline
Yes
Yes
Yes
Yes
No
No
No
NoImplementation
No Acceptable External GuidelineAcceptable External Systematic Review
No New Relevant StudiesAMSTARGRADE
![Page 7: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/7.jpg)
Kaiser Permanente National Guideline Program: Process & MethodologyNew
ClinicalIssue
ScheduledUpdate
ClinicalQuestions
(CQ)
ExistingGuideline?
CQMatch?
AssessGuideline
Acceptable?
ExistingSR by CQ?
AssessSR
Acceptable?
EvidenceSearch
AbstractArticleReview
Inclusion/Exclusion
DataExtraction
CriticalAppraisal
Qualitative/QuantitativeSynthesis
AssessEvidenceQuality
EvidenceSummary Rationale Recommendations
AssessImplementability ofRecommendations
GDT Approval
Internal Review
GQNGD
Approval
NationalGuideline
Yes
Yes
Yes
No
No
No No
No
Implementation
No Acceptable External GuidelineNo Acceptable External Systematic Review Internal Systematic Review GRADE
![Page 8: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/8.jpg)
Kaiser Permanente Systematic ReviewProcesses, Responsibilities, & Tools
Clinical Questions KP: Population, Intervention, Comparison, Outcome
• Timing, SettingEvidence Search
Doctor Evidence with KP input• Masters-trained Medical Librarians (MLIS)
Abstract/Article Review & Inclusion/Exclusion Doctor Evidence
• Dual Inclusion/Exclusion with 3rd party adjudication KP: Evaluate exclusions
![Page 9: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/9.jpg)
Kaiser Permanente Systematic ReviewProcesses, Responsibilities, & Tools
Data Extraction Doctor Evidence
• Dual extraction with adjudication & 3rd party independent QA• Masters-trained & graduate student data extractors• Contact authors to clarify discrepancies in published data
KP: Quality AssuranceCritical Appraisal
KP: Cochrane Risk of Bias, Doctor Evidence platformQualitative/Quantitative Analysis
KP: Doctor Evidence platform
![Page 10: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/10.jpg)
Doctor Evidence Meta-Analysis Page
![Page 11: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/11.jpg)
Doctor Evidence Meta-Analysis Results
![Page 12: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/12.jpg)
Doctor Evidence Meta-Analysis Study Selection
Detailed study- and outcome-specific
descriptions of Cochrane Risk of Bias are exposed by
hovering
Select and de-select studies and Recalculate
![Page 13: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/13.jpg)
Doctor Evidence Study Summary
Detailed study-specific descriptions of
characteristics and outcomes are exposed
by hovering
![Page 14: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/14.jpg)
Kaiser Permanente Systematic ReviewProcesses, Responsibilities, & Tools
Evidence Grading KP: GRADE, GRADEPro
• Developing functionality in Doctor Evidence platformEvidence Summary (SR)RationaleRecommendations & Guideline
KP: GRADE, GRADEPro, Word• Developing functionality in Doctor Evidence platform
![Page 15: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/15.jpg)
Kaiser Permanente National Guideline Program: Process & Methodology
NationalGuideline
DiseaseManagementAccreditation
(NCQA)
Clinician &Staff Education
Tools(Clinical Library)
Patient EducationTools
(KP.ORG,National Patient
Instructions
Regions(EHR, CDS,Operations)
Guideline Implementation
Key to Abbreviations:• EHR Electronic Health Record• CDS Clinical Decision Support• KP.ORG KP publicly-accessible Internet site• NCQA National Committee for Quality
Assurance
![Page 16: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/16.jpg)
IOM Systematic Review StandardsProblem Areas for KP
2.6 Develop a systematic review protocol2.7 Submit the protocol for peer review2.7.1 Provide a public comment period for the
protocol2.8 Make the final protocol publicly available5.2.1 Use a 3rd party to manage peer review5.2.2 Provide a public comment period for the
report5.3 Publish the final report with free public
access
![Page 17: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/17.jpg)
IOM Systematic Review StandardsChallenges
Very resource-intensive Infinite needs - Finite resources Balance between efficiency versus rigor Investment in developing expertise & infrastructure
Migration of existing SRs & CPGs to new methodsUpdating SRs & CPGs
Every 2 years? Dynamic updating, based on evidence & impact?
External reviewPatient & public involvement in SRs and CPGs
![Page 18: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/18.jpg)
IOM Systematic Review StandardsOpportunities
Improved SR & CPG rigor & transparencyCommon evidence-grading & recommendation
strength languageCollaborate with other SR & CPG developers
Prioritize & coordinate topics Avoid duplication Target funding Share data extractions?
Devote more energy to CPG implementationCollaborate with performance metric developers
![Page 19: Kaiser Permanente National Guideline Program Implications of IOM SR Standards](https://reader036.vdocument.in/reader036/viewer/2022062811/56816083550346895dcfacd7/html5/thumbnails/19.jpg)
Implications of IOM SR Standards