bradshaw institute pres - lifesavers v2 - jf edits...– injury prevention-safe kids upstate safe...
TRANSCRIPT
4/6/2018
1
You Don’t Need a PhD to Evaluate Your Program! You Don’t Need a PhD to Evaluate Your Program! You Don’t Need a PhD to Evaluate Your Program! You Don’t Need a PhD to Evaluate Your Program!
The importance of building impact measurement into The importance of building impact measurement into The importance of building impact measurement into The importance of building impact measurement into your Child Passenger Safety initiativeyour Child Passenger Safety initiativeyour Child Passenger Safety initiativeyour Child Passenger Safety initiative
Linda Brees, MSLinda Brees, MSLinda Brees, MSLinda Brees, MSDirector, Bradshaw Institute for Community Child Health & Advocacy
Children’s Hospital of Greenville Health System
ObjectivesObjectivesObjectivesObjectives
• Provide brief history of Bradshaw Institute for Community Child Health & Advocacy and Safe Kids Upstate
• Describe Institute-wide impact measurement and scorecard development process
• Share how evaluation has helped promote Safe Kids Upstate and Child Passenger Safety initiative
• Share lessons learned along the way
4/6/2018
2
GHS Children’s HospitalGHS Children’s HospitalGHS Children’s HospitalGHS Children’s Hospital
• 90 inpatient beds • 200 medical providers
• 80 NICU beds • >400,000 annual visits
• 40 specialties • Pediatric ED with >26,000 visits in FY17
Started as Started as Started as Started as GHS Children’s AdvocacyGHS Children’s AdvocacyGHS Children’s AdvocacyGHS Children’s Advocacy
Child advocacy work began over 20 years ago as a single injury prevention initiative and has evolved into an Institute with multiple program streams.
4/6/2018
3
Bradshaw InstituteBradshaw InstituteBradshaw InstituteBradshaw Institute
• Launched in June 2016– Largest gift in GHS History
• Started with a Car Seat Check
• 5 Performance Teams– Healthy Child Development-Help Me Grow SC
– Child Abuse Prevention– Community Pediatrics– School Health – Injury Prevention- Safe Kids Upstate
Safe Kids UpstateSafe Kids UpstateSafe Kids UpstateSafe Kids Upstate
• Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina
• Led by Children’s Trust of South Carolina
• We cover:– Greenville, Pickens and Oconee Counties
• Team and work is all philanthropically or grant supported by many organizations like:
6
4/6/2018
4
Child Passenger SafetyChild Passenger SafetyChild Passenger SafetyChild Passenger Safety
• Primarily sponsored by Kohl’s Cares• Safe Kids Upstate is a Staff of 6
– All Child Passenger Safety Trained• 2 CPS Instructors
• 2 CPS Instructor Candidates
• 2 CPS Technicians
• 1 Safe Travel for All Children Course Instructor
• 4 Safe Travel for All Children Trained
• Major growth in Child Passenger Safety (CPS) program over the last 2 years as a result of strategic planning and impact measurement
Child Passenger Safety Child Passenger Safety Child Passenger Safety Child Passenger Safety Program GrowthProgram GrowthProgram GrowthProgram Growth
Area of FocusArea of FocusArea of FocusArea of Focus RecentRecentRecentRecent ChangesChangesChangesChanges
# of permanent Car Seat Inspection Stations
Original stations:1. Greer Fire Department2. Bradshaw Automotive3. Fountain Inn Fire Department4. Medshore Ambulance5. Easley Fire Department6. Seneca Fire Department 7. Belmont Fire Department 8. Parker Fire Department
Additional Stations:9. Lake Cunningham Fire Department10. Nurse Family Partnership11 Walhalla Fire Department12. Pickens City Fire Department13. Greenville Memorial Hospital 14. Safe Travel for All Children Special Needs Clinic
4/6/2018
5
Child Passenger Safety Child Passenger Safety Child Passenger Safety Child Passenger Safety Program GrowthProgram GrowthProgram GrowthProgram Growth
Area of FocusArea of FocusArea of FocusArea of Focus RecentRecentRecentRecent ChangesChangesChangesChanges
Annual grant dollars $185,000 to $295,000
Average CPS appt. wait time
3 weeks to ~48 hours
Cost of On the Way program supplies (excluding staffing)
Average spend of $2,900/month ($34,800 annually) to $1,600/month ($19,200 annually)
Quality of program • CPST classes offered twice a year• CPST recertification reminders and programming to
engage current CPSTs built within last year• Monthly station newsletter with updates• Monthly station checklist reporting
Community event involvement
Participated in 87 community events in 2016; grew to 132 community events in 2017. Requests continue to grow over current staff capacity. Quality programming = more event requests
Journey to impact Journey to impact Journey to impact Journey to impact measurementmeasurementmeasurementmeasurement
• Bradshaw Institute is constantly challenged to prove worthprove worthprove worthprove worth as a non-revenue generating entity within a large health system
• Child Passenger Safety and other initiatives not just “nice to have” but “need to haveneed to haveneed to haveneed to have”
• Needed data for grant opportunities, marketing materials, and simply to understand what is working and what is notwhat is working and what is notwhat is working and what is notwhat is working and what is not
4/6/2018
6
Journey to impact Journey to impact Journey to impact Journey to impact measurementmeasurementmeasurementmeasurement
1. PLAN: 1. PLAN: 1. PLAN: 1. PLAN: Designate person responsible
2. COMMUNICATE: 2. COMMUNICATE: 2. COMMUNICATE: 2. COMMUNICATE: Meet with staff and stakeholders
3. UNDERSTAND: 3. UNDERSTAND: 3. UNDERSTAND: 3. UNDERSTAND: Capture existing data, set goals, identify new measures
4. ESTABLISH ACCOUNTABILITY: 4. ESTABLISH ACCOUNTABILITY: 4. ESTABLISH ACCOUNTABILITY: 4. ESTABLISH ACCOUNTABILITY: Report at regular intervals to staff and leadership
5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:Monitor data and set new goals
Journey to impact measurement: Journey to impact measurement: Journey to impact measurement: Journey to impact measurement: Safe Kids UpstateSafe Kids UpstateSafe Kids UpstateSafe Kids Upstate
1. PLAN: 1. PLAN: 1. PLAN: 1. PLAN: SKU started with discussing team roles and responsibilities
2. COMMUNICATE: 2. COMMUNICATE: 2. COMMUNICATE: 2. COMMUNICATE: Meetings with :• Safe Kids Staff• Physician
Champions within system
3. UNDERSTAND: 3. UNDERSTAND: 3. UNDERSTAND: 3. UNDERSTAND: • Look at current CPS data-
using SKW Checklist• State of SC reports some
measures to Children's Trust already
• 4. ESTABLISH 4. ESTABLISH 4. ESTABLISH 4. ESTABLISH ACCOUNTABILITY: ACCOUNTABILITY: ACCOUNTABILITY: ACCOUNTABILITY:
• SKU team reviews monthly at team meetings
• Quarterly at Institute meetings
5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:• Addition of grants - adjust metrics• Ability to report on “wins” to
leadership from a dashboard perspective
4/6/2018
7
Performance ScorecardsPerformance ScorecardsPerformance ScorecardsPerformance Scorecards
Performance ScorecardsPerformance ScorecardsPerformance ScorecardsPerformance Scorecards
Every Bradshaw Institute program priority and measure is linked with one of the four Institute goals
Every Bradshaw Institute program priority and measure is linked with a broader Greenville Health System priority or guiding principle
This provides our Safe Kids team the ability to link their work to the broader health system mission.
4/6/2018
8
Performance ScorecardsPerformance ScorecardsPerformance ScorecardsPerformance Scorecards
The program area, performance team or specific initiative within Bradshaw Institute (i.e. child passenger safety)
The high level priority for the program or initiative. Answers the question, “What do we want to do?”
SKUSKUSKUSKU----At HomeAt HomeAt HomeAt HomeSKUSKUSKUSKU----At PlayAt PlayAt PlayAt Play
SKUSKUSKUSKU----At SchoolAt SchoolAt SchoolAt SchoolSKUSKUSKUSKU----On the On the On the On the
WayWayWayWay
Performance ScorecardsPerformance ScorecardsPerformance ScorecardsPerformance Scorecards
The specific, measurable goal or metric, linked with the program priority. Answers the question, “How will we know we did it?”
Type of goal –process or impact
4/6/2018
9
Performance ScorecardsPerformance ScorecardsPerformance ScorecardsPerformance Scorecards
“How will we achieve our goal?” Managers assist every team member in creating an action plan, which will work towards achievement of the specific measure.
Name of team member
Color-coded progress marked each quarter
ProgressProgressProgressProgress Color
Goal on Track; Goal on Track; Goal on Track; Goal on Track; trending right trending right trending right trending right directiondirectiondirectiondirection
GoalGoalGoalGoal at risk; at risk; at risk; at risk; issues or delaysissues or delaysissues or delaysissues or delays
Goal not met; Goal not met; Goal not met; Goal not met; cancelledcancelledcancelledcancelled or or or or high riskhigh riskhigh riskhigh risk
Sample CPS Goal #1Sample CPS Goal #1Sample CPS Goal #1Sample CPS Goal #1BRADSHAW INSTITUTE
GOAL
GHS PRIORITY
ALIGNMENT
BRADSHAW PROGRAM
AREA
PROGRAM PRIORITY
MEASURE GOAL RATIONALE
ACTION PLAN PERSON ACCOUNT
ABLE
Q1-18 Q2-18
Create healthier and safer communitie
s
Quality; patient
experience satisfaction; trustees of the future
Injury Prevention- On the
Way
Improve access to
Child Passenger Safety
Program for Expectant Parents/ Newborns
Creation of a permanent inspection station at Greenville Memorial
Hospital by December 31,
2017
Process 1-Provide referral services to existing stations 2- Offer
Referral stations to families on Mother Baby Unit 3-Provide Onsite inspection services to families that ask 4- Provide information and
process to families prior to discharge for
onsite inspection stations 5-Offer
comprehensive car seat inspection
services during peak discharge times
Lee Penny,
Bridgette Watson
Start Date set for 4/16/18, delayed but
will be completed in
totality
Inspection station
opened M-F 8:30am-4:30pm for discharged families
from GMH
Scorecard allowed
physician champions
to push for progress
with administration;
gave updates on goals
to coalition
4/6/2018
10
Sample CPS Goal #2Sample CPS Goal #2Sample CPS Goal #2Sample CPS Goal #2BRADSHAW INSTITUTE
GOAL
GHS PRIORITY
ALIGNMENT
BRADSHAW PROGRAM
AREA
PROGRAM PRIORITY
MEASURE GOAL RATIONALE
ACTION PLAN PERSON ACCOUNT
ABLE
Q1-18 Q2-18
Create healthier and safer communitie
s
Quality; patient
experience satisfaction; trustees of the future
Injury Prevention- On the
Way
Improve quality of
Child Passenger Safety
Program Education for all families
Implementation of a family centered
satisfaction survey
administered to families who visit Safe Kids Upstate car
seat inspection stations by
April 1, 2018.
Process 1-Creation of survey template 2-Analysis of
best practice satisfaction surveys
used industry wide 3-Review Safe KidsWorldwide to consolidate
surveys/best practices 4-Draft sample survey
for families5-Educate CPS Techs to administer survey and implement survey
process
Lee Penny,
Bridgette Watson
Survey Drafted and put into
online platform
Implementation
expected to start on 4/17/18,with new hospital
inspection station.
Educating Techs on
new scorecard
InstituteInstituteInstituteInstitute----widewidewidewidelessons learned thus farlessons learned thus farlessons learned thus farlessons learned thus far
• Use literature, national data and requirements from funders to guide goal-setting
• Pre- and post-testing: an easy way to get started
• Cooperation avoids duplication
• Setting ourselves up for future success: process goals as important as impact goals
• Frequent reminders and accountability
• Culture shift: patience and support
4/6/2018
11
Safe Kids UpstateSafe Kids UpstateSafe Kids UpstateSafe Kids Upstatelessons lessons lessons lessons llllearned thus farearned thus farearned thus farearned thus far
• Important to review what is already being collected at a state and national level
• Encouragement is VITAL – red on scorecards is okay!• Determining staff roles and responsibilities was crucial• The shift to data tracking and analysis was an adjustment
for our programming but has led to enhanced accountability and data accessibility for grant applications– The scorecard process is also useful for setting appropriate grant
goals and metrics
• Important to build trust and understanding of data needs with stakeholders (e.g. technicians)– Techs required education on checklists, reporting and commitment to
Safe Kids Coalition
• Goal is to eventually have readily accessible program “dashboard” with data in real time
Thank youThank youThank youThank you
Linda Brees