measuring public health agency preparedness
DESCRIPTION
Measuring Public Health Agency Preparedness. Mary V. Davis, DrPH, MSPH December 20, 2006. What is the Role of Public Health Agencies in Disasters/Bioterrorism?. Feedback Poll. Is it possible for me to know whether my health department is prepared? Yes No. Measuring Preparedness. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/1.jpg)
North CarolinaInstitute for Public
Health
Measuring Public Health Agency Preparedness
Mary V. Davis, DrPH, MSPH
December 20, 2006
![Page 2: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/2.jpg)
What is the Role of Public Health Agencies in Disasters/Bioterrorism?
![Page 3: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/3.jpg)
Feedback Poll
Is it possible for me to know whether my health department is prepared?
A. Yes
B. No
![Page 4: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/4.jpg)
Measuring Preparedness
• What does it mean to be prepared?
• How can preparedness be measured?– Definitions– Metrics– Instruments
• What is the relationship between individual competency and agency preparedness?
![Page 5: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/5.jpg)
Measurement 1.0
Evaluation of Public Health Response to Hurricanes Finds North Carolina Better Prepared for Public Health Emergencies
January–June 2004
![Page 6: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/6.jpg)
Purpose of NC Study
Identify how BT funds improved public health capacity in North Carolina to prepare for and respond to bioterrorism events and other public health emergencies.
Examine how improvements in public health capacity for a specific public health emergency can translate to all public health emergencies.
![Page 7: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/7.jpg)
NC Context
• Capitalize on “natural experiment”– 1999 Hurricane Floyd– 2002 Infusion of Federal funds to address
bioterrorism– 2003 Hurricane Isabel
• Strong partnership history between NC DPH and UNC SPH
• No standard definition of “preparedness”
![Page 8: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/8.jpg)
Evaluation Questions—Resources
• Phases of Disaster Framework—Noji
• Public Health Management of Disasters—Landesman
• Criteria for evaluating management of disasters—Quarentelli
![Page 9: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/9.jpg)
NC Hurricane Evaluation Study
Handout Page 1Evaluation Questions
![Page 10: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/10.jpg)
Data Collection
• Key informant interviews—Professional role involvement in Floyd and/or Isabel
• Document review—state and federal protocols, documents, records
![Page 11: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/11.jpg)
Results Floyd
• Planning—no specific activities
• Preparation– Communication with local health departments
• Response– Command and Control– Surveillance and Assessment
![Page 12: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/12.jpg)
Floyd and “The Box”
![Page 13: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/13.jpg)
DPH Use of Federal Funds
• Created Infrastructure– Office of Public Health Preparedness & Response– Public Health Command Center– Public Health Regional Surveillance Teams
• Employed Staff– BT Coordinator– Office of Public Health Preparedness & Response staff– Public Health Regional Surveillance Team staff: 28
in 7 regions statewide– Public health epidemiologists: 12 statewide
• Implemented Health Alert Network
• Implemented NC Emergency Department Database
![Page 14: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/14.jpg)
Actions (cont’d)
• Enhanced Laboratory Capacity– Biosafety Level 3 and Level 2
• Purchased Equipment– 8 vehicles– Fixed vehicle-mounted and hand-held radios
• Strengthened Communication– Bioterrorism Steering Committee, reps from multiple agencies
• Provided Training– Emergency preparedness and core public health competencies
– Exercises and drills
![Page 15: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/15.jpg)
Resulted in Capacities Used in Isabel
• Effective, centralized communication through Public Health Command Center– Between state agencies
– With local public health departments
– With community and academic partners
– With citizens
![Page 16: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/16.jpg)
Capacities (cont’d)
• Command and Control Incident Management– Operational and functional plans
– Systematic response
– Decision making in real-time emergency conditions
– Epidemiology and surveillance• Rapid needs assessment
• Medical surveillance
![Page 17: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/17.jpg)
Preparedness Logic Model
Handout Page 2
NC Model
![Page 18: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/18.jpg)
Preparedness Logic Model
Handout Page 3
![Page 19: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/19.jpg)
Preparedness Logic Model
RAND Corporation. RAND Health. Learning from Experience, Page 9
• Goal: mitigate morbidity, mortality, stress
• Objectives– Early identification– Early and effective response– Earliest return to normal function
• Functional capabilities meet objectives
• Capacity-building activities result in capabilities
![Page 20: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/20.jpg)
Measurement 2.0
Mississippi Department of Health Hurricane Katrina After Action Report
January–June 2006
![Page 21: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/21.jpg)
Target Capabilities List
• U.S. Department of Homeland Security Target Capabilities List version 1.1
• Defines 36 prevention, protection, response, and recovery capabilities (measures)
• Capability measures: capacity (processes, infrastructure)
• Performance measures (demonstrate task execution)
![Page 22: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/22.jpg)
Why Target Capabilities?
• Becoming benchmarks for state performance
• Provide a framework for performance measures
• Create a performance plan– Specific– Measurable– Obtainable
![Page 23: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/23.jpg)
TCL Pilot Test
• MS Department of Health Katrina After Action Review– Specific type of evaluation– Identifies strengths and weaknesses in
response– Defines specific action plan for improvements
• Examined response in 21 TCLs– Emergency Support Function 8—public health– General TCL’s—planning
![Page 24: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/24.jpg)
Target Capabilities Examined in MDH Katrina AAR
• Handout 4
![Page 25: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/25.jpg)
NC Involvement
• MS requested NC to construct a team to assess ESF 8 response
• MDH planning with Region IV, specifically NC OEMS prior to Katrina
• NC mobilized SMAT to Waveland, MS during Katrina response
• NC personnel familiar with gulf communities and MDH structure
![Page 26: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/26.jpg)
MDH Katrina AAR
• Identify major points what worked/did not work well during MDH Katrina response Katrina in Emergency Support Function 8
• Data collection (all new instruments)– Responder Online Assessment– Responder Interviews– Community Assessment
• Results used to:– Inform Performance Improvement Plan– Revise MS State Emergency Operations Plan
![Page 27: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/27.jpg)
Online Survey Example
1.2.0 Interoperable Communications (Communications and Information Management)
* 1.2.0: Were you a part of Interoperable Communications (Communications and Information Management)?
Please choose only one of the following:YesNo
[Only answer this question if you answered 'Yes' to question '1.2.0 ']
1.2.2: Were sufficient back-up equipment and power sources available?
Please choose only one of the following:YesNoUnknown
[Only answer this question if you answered 'No' to question '1.2.2 ']
1.2.2n: Please explain why you answered no.
![Page 28: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/28.jpg)
Online Survey and Interview Data
• Feedback available for all TCLs– Least for Animal Health Emergency Support
– Most for Planning, Mass Care
• Substantive open-ended feedback from survey “no” responses
• Interviewees provided substantive information on what worked and areas for improvement
![Page 29: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/29.jpg)
AAR Recommendations
• Overarching capability and specific TCL
• Results from online survey, interviews, community assessment
• Experience and knowledge of MDH and NC team
• Federal guidelines
![Page 30: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/30.jpg)
Limitations
• First use of TCL Performance Measures as data collection instruments
• Limited time to create and validate data collection instruments
• Respondents lacked knowledge of performance measure
• MDH identified participant samples
• Challenge to digest the wealth of information from the results
![Page 31: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/31.jpg)
Take Home Points
• First use of Target Capability List as an AAR framework
• First instance of one state government conducting an AAR for another state
• NC team drew upon EM, OEMS, PHP&R, UNC SPH, and other expertise
• Approach yields data in performance measure framework
![Page 32: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/32.jpg)
Preparedness Measurement Next Steps
• Modify Target Capability measurement instruments
• Pilot in an After Action Review
• Continuously Refine Measures
• Use RAND Public Health Preparedness Logic Model as guide
• Measures should be – specific about responder function– specific about activities and capabilities
![Page 33: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/33.jpg)
Public Health Preparedness
• Continuous process—constant quality improvement
• Agencies need to test preparedness in real conditions– Exercises and drills
– Outbreak investigations
– Disaster, BT responses
![Page 34: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/34.jpg)
Individual Competency and Agency Preparedness
• Using RAND Public Health Preparedness Logic Model
• Individual Competency– Conduct capacity-building activities– Demonstrate competency to perform
functional capabilities
• Agencies– Implement functional capabilities– Achieve preparedness objectives and goals
![Page 35: Measuring Public Health Agency Preparedness](https://reader035.vdocument.in/reader035/viewer/2022062309/5681451f550346895db1e2b4/html5/thumbnails/35.jpg)
Resources
• NC Hurricane Evaluationhttp://www2.sph.unc.edu/nccphp/hurricane_10_19_04.pdf
Article in PH Reports in Jan/Feb 2007 issue
• MDH AAR Reporthttp://www.msdh.state.ms.us/msdhsite/_static/resources/1676.pdf
• Contact [email protected]