ahrq 2011 annual conference september 20, 2011 national quality measures clearinghouse: an expanded...
TRANSCRIPT
AHRQ 2011 Annual Conference September 20, 2011
National Quality Measures Clearinghouse: An Expanded Tool with Real-world
RelevanceVivian H. Coates, MBA
Vice President, Information Services and Health Technology AssessmentProject Director, National Guideline Clearinghouse and National Quality Measures Clearinghouse
ECRI Institute
Eric C. Schneider MD, MScRAND Distinguished Chair in Health Care Quality
Director, RAND BostonAssociate Professor, Harvard Medical School
R. Heather Palmer, MB, BCh, SMProfessor, Health Policy & Management
Harvard School of Public Health
AHRQ 2011 Annual Conference September 20, 2011
Outline
•NQMC: An Introduction to the Web Site
•The NQMC Domain Framework: Development and Evolution
2
AHRQ 2011 Annual Conference September 20, 2011
Audience Background
Please select your primary professional
role:
A. Practicing clinician
B. Administrator or policy maker
C. Performance measure developer
D. Researcher
E. Student or trainee
F. Other
3
AHRQ 2011 Annual Conference September 20, 2011
3/19/2008 – Part 2
4
AHRQ 2011 Annual Conference September 20, 2011
Audience Background
Please describe your familiarity with
NQMC:
A. Never heard of it before today
B. Heard of it, but never visited the site
C. Visited the site a few times
D. Use NQMC fairly often
5
AHRQ 2011 Annual Conference September 20, 2011
Introduction to NQMC: What Is It and What Can It Do?
NQMC Web site went live Feb. 19, 2003 – 8 years old!
•6,760 measures submitted from 54 orgs (as of August 31, 2011)
•2,002 measure summaries currently published from 51 orgs (as of August 31, 2011)
•~14 measure summaries published per week (August 2010-August 2011 weekly average)
•563 additional measure summaries currently in progress in work queue (as of August 31, 2011)
6
AHRQ 2011 Annual Conference September 20, 2011
NQMC Web Site Usage
• NQMC Web Site Usage (August 1, 2010 – July 31, 2011):
▫ Average monthly visits: 17,250▫ Average weekly visits: 3, 980▫ Average time spent per visit: 7:51 minutes▫ Average page views per visit: 4.25▫ New visitors: 32,800
• Now sending weekly “What’s New e-mail alerts” to more than 40,323 subscribers (as of August 31, 2011)
7
AHRQ 2011 Annual Conference September 20, 2011
Profile of NQMC Users
▫38.2% of respondents: managers, purchasers, or policy makers
▫11.8% : physicians▫11.7% : researchers, measure
developers, or information specialists▫11.2% : physician assistants or nurses
▫Source: 2008 NQMC user survey
3/19/2008 – Part 2
8
AHRQ 2011 Annual Conference September 20, 2011
Profile of NQMC Users▫44.6% of respondents: affiliated with
inpatient care hospitals ▫15.4%: oversight organizations or
purchasers▫12.7 : outpatient ambulatory settings ▫11.9%: academic institutions
▫Source: 2008 NQMC user survey
3/19/2008 – Part 2
9
AHRQ 2011 Annual Conference September 20, 2011
What Can NQMC Do?•Help users to find and compare measures
(from many countries)•Search using multiple controlled
taxonomies (eg, UMLS vocabularies: including MeSH, SNOMED, ICD)
•Search using filters (eg, identify measures that are endorsed by NQF)
•Forum for debate: Expert Commentaries•Educate users about measurement and
measurement frameworks
3/19/2008 – Part 2
10
AHRQ 2011 Annual Conference September 20, 2011
Evolution of the Domain Framework
•NQMC classifies measures into domain categories that can assist users in searching and browsing the database
•Design of framework is empirically driven based on analysis of thousands of “measures” submitted to NQMC from across the globe
11
AHRQ 2011 Annual Conference September 20, 2011
NQMC Domain Framework:Donabedian View
12
AHRQ 2011 Annual Conference September 20, 2011
NQMC Domain Framework:v. 1.0 Clinical Quality Measures
13
AHRQ 2011 Annual Conference September 20, 2011
Audience Query:Classify this Measure
The percentage of adult members who were hospitalized and discharged alive with a diagnosis of acute myocardial infarction (AMI) and who received persistent beta-blocker treatment for six months after discharge.
In which domain would you classify this measure?A. ProcessB. AccessC. OutcomeD. StructureE. Patient Experience
14
AHRQ 2011 Annual Conference September 20, 2011
Audience Query: Classify this Measure
The percent of patients who have had a visit to an Emergency Department (ED)/Urgent Care office for asthma in the past six months.
In which domain would you classify this measure?A. ProcessB. OutcomeC. AccessD. Patient ExperienceE. None of the above
15
AHRQ 2011 Annual Conference September 20, 2011
Audience Query: Classify this Measure
The percent of diabetic patients in the clinical information system who are current smokers (documented in the last 12 months).
In which domain would you classify this measure?A. Structure B. ProcessC. OutcomeD. Patient ExperienceE. None of the above
16
AHRQ 2011 Annual Conference September 20, 2011
Audience Query: Classify this Measure
Whether a practice has a policy to ensure the prevention of fraud and has defined levels of financial responsibility and accountability for staff undertaking financial transactions.
In which domain would you classify this measure?A. ProcessB. StructureC. OutcomeD. Patient experienceE. None of the above
17
AHRQ 2011 Annual Conference September 20, 2011
NQMC Domain Framework:Related Health Care Delivery Measures
18
AHRQ 2011 Annual Conference September 20, 2011
Audience Query: Classify this Measure
The number of cases of selected Central venous catheter-related bloodstream infections per 100,000 population in county or Metro Area.
In which domain would you classify this measure?A. ProcessB. AccessC. OutcomeD. Health StateE. None of the Above
19
AHRQ 2011 Annual Conference September 20, 2011
NQMC Domain Framework
20
AHRQ 2011 Annual Conference September 20, 2011
Population Health Domain Rationale
• Denominator includes individuals who may not have received care from the clinical delivery system (“geographically-defined” denominator)
• AHRQ National Quality Report and National Health Disparities Reports include population health measures
• Federal and state agencies are investing in public health standards and measurement initiatives
• NQF considering expansion of its purview to include population health
• The Clearinghouses are well positioned to serve as a resource for public health professionals
21
AHRQ 2011 Annual Conference September 20, 2011
Population Health Domain
•Definition of Population
− a group of persons identified by geographic location, organizational affiliation or non-clinical characteristics. Denominator inclusion for measures classified in population health domains is not restricted to recipients of clinical care or enrollees in a health plan.
22
AHRQ 2011 Annual Conference September 20, 2011
Population Health Domain Development
• Public health measure analysis sets:
▫ LA County Department of Public Health
▫ U.S. Public Health Service’s Healthy People 2010
▫ CDC Indicators for Occupational Health Surveillance
▫ CDC Indicators for Chronic Disease Surveillance
▫ Commission for Environmental Cooperation: Children’s Health and the Environment in North America
▫ New York State County Health Assessment Indicators
▫ Utah Department of Health Indicator-Based Information System for Public Health (IBIS-PH)
▫ Swedish National Board of Health and Welfare
23
AHRQ 2011 Annual Conference September 20, 2011
NQMC Domain Framework
24
AHRQ 2011 Annual Conference September 20, 2011
Population Health Measures: Examples
• Population Process
▫ The proportion of adults ages 65 years and older in a county who have received an influenza vaccination in the past year.
• Population Access
▫ The percentage of smokers in a county who reported that they were able to receive services from a smoking-cessation program.
25
AHRQ 2011 Annual Conference September 20, 2011
Population Health Measures: Examples
• Population Outcome▫ The proportion of children with elevated blood lead
levels whose homes undergo lead remediation, and whose blood lead levels are subsequently reduced to normal levels.
• Population Experience▫ The percentage of smokers in a county reporting that
they have seen or heard public service announcements promoting a county health department-sponsored smoking-cessation program.
• Population Structure▫ The number of licensed child care facilities and slots in
a county.
26
AHRQ 2011 Annual Conference September 20, 2011
Population Health Measures: Examples
• Population Health Knowledge▫ The mean response score to a set of questions about
HIV prevention.
• Social Determinants of Health▫ The proportion of families living at or below the poverty
level.
• Environment▫ The number of days in the past year when the
concentration of particulate air pollution in a community exceeds a defined threshold.
27
AHRQ 2011 Annual Conference September 20, 2011
Audience Query: Classify this Measure
The proportion of families living at or below the poverty level.
In which domain would you classify this measure?A. Population OutcomeB. Population ProcessC. Population StructureD. Social Determinants of HealthE. Environment
28
AHRQ 2011 Annual Conference September 20, 2011
Audience Query: Classify this Measure
The mean response score to a set of questions about HIV prevention.
In which domain would you classify this measure?A. Population ProcessB. Population StructureC. Population Health KnowledgeD. Social Determinants of HealthE. Environment
29
AHRQ 2011 Annual Conference September 20, 2011
Audience Query: Classify this Measure
The number of days in the past year when the concentration of particulate air pollution in a community exceeds a defined threshold.
In which domain would you classify this measure?A. Population ProcessB. Population StructureC. Population Health KnowledgeD. Social Determinants of HealthE. Environment
30
AHRQ 2011 Annual Conference September 20, 2011
Measuring Cost and Efficiency: Rationale
• Costs and resource use measures now a high priority▫ NQF National Priorities Partners Areas ▫ Payment reform models▫ Interest in price transparency
• Earlier cost reporting efforts▫ Pennsylvania HC4 CABG Surgery Mortality Report
(1991)▫ NCQA Use of services measures (1993)
• Renewed efforts to try to measure efficiency▫ NCQA Relative Resource Use Measures▫ Use of Episode Groupers to carry out relative cost
measurement
31
AHRQ 2011 Annual Conference September 20, 2011
Efficiency and Cost Domain Development
• Cost▫ the monetary or resource units expended by a health
care organization or clinician to deliver health care to individuals or populations.
• Efficiency ▫ a measure of cost of care associated with a specified
level of quality of care.
32
AHRQ 2011 Annual Conference September 20, 2011
Cost vs. Efficiency
Hospital Cost Measure: Median Charge per Hospital Discharge, Total Hip Replacement (hypothetical)
33
Hospital Median Charge per Hospital Discharge
Hospital A $80,000
Hospital B $90,000
Hospital C $100,000
Hospital D $115,000
AHRQ 2011 Annual Conference September 20, 2011
Cost vs. Efficiency
Hospital Efficiency Measure: Quality-Adjusted Median Charge per Hospital Discharge, Total Hip Replacement (hypothetical)
34
Hospital Median Charge per Hospital Discharge
Composite Quality Index (CQI: max = 1.00)
Quality-Adjusted Median Charge per Discharge (Median Charge / CQI)
Hospital A $80,000 .80 $100,000
Hospital B $90,000 .95 $94,737
Hospital C $100,000 .75 $133,333
Hospital D $115,000 .90 $127,778
AHRQ 2011 Annual Conference September 20, 2011
NQMC Domain Framework
35
AHRQ 2011 Annual Conference September 20, 2011
Payment Models Needing New Performance Measures
• Global payment
• ACO shared savings
• Medical home
• Bundled payment
• Hospital-physician gainsharing
• Payment for coordination
• Hospital pay-for-performance
• Physician pay-for-performance
• Payment for shared decision-making
36
AHRQ 2011 Annual Conference September 20, 2011
Summary of New Measure Types Needed to Support Payment Reform
Models• Health outcomes
▫ Functional status & safety outcomes
• Care coordination ▫ Transitions
• Patient and caregiver engagement with care▫ Medical homes, shared decision-making
• Structure▫ ACOs, decision aids
• Efficiency ▫ Hospital and Physician P4P
37
AHRQ 2011 Annual Conference September 20, 2011
Some Anticipated Consequences• Potentially large increase in performance
measure submissions to NQMC as federally-funded projects complete measure development
• New types of measures?
• Potential increase in the variability of “measure quality”▫ Purposes for measures▫ Evidence used▫ Protocols used to develop measures▫ Validity and reliability testing
• How can NQMC adequately convey distinctions among these attributes of measures?
38
AHRQ 2011 Annual Conference September 20, 2011
Performance Measures and Health Reform: Issues for the Future
• Evolution in delivery organizations (medical homes, ACOs)
• New expectations about necessary evidence base
• Heightened concern about conflicts of interest
• New federal resources for quality measure development, selection and endorsement
• E-Specifications for traditional performance measures
• New types of performance measures leveraging EHR
• New performance measures to assess HIT and HIE
39
AHRQ 2011 Annual Conference September 20, 2011
NQMC Going Forward• Audience Q and A
40