bradshaw institute pres - lifesavers v2 - jf edits...– injury prevention-safe kids upstate safe...

11
4/6/2018 1 You Don’t Need a PhD to Evaluate Your Program! You Don’t Need a PhD to Evaluate Your Program! You Don’t Need a PhD to Evaluate Your Program! You Don’t Need a PhD to Evaluate Your Program! The importance of building impact measurement into The importance of building impact measurement into The importance of building impact measurement into The importance of building impact measurement into your Child Passenger Safety initiative your Child Passenger Safety initiative your Child Passenger Safety initiative your Child Passenger Safety initiative Linda Brees, MS Linda Brees, MS Linda Brees, MS Linda Brees, MS Director, Bradshaw Institute for Community Child Health & Advocacy Children’s Hospital of Greenville Health System Objectives Objectives Objectives Objectives Provide brief history of Bradshaw Institute for Community Child Health & Advocacy and Safe Kids Upstate Describe Institute-wide impact measurement and scorecard development process Share how evaluation has helped promote Safe Kids Upstate and Child Passenger Safety initiative Share lessons learned along the way

Upload: others

Post on 26-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Bradshaw Institute pres - Lifesavers v2 - JF edits...– Injury Prevention-Safe Kids Upstate Safe Kids Upstate • Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

4/6/2018

1

You Don’t Need a PhD to Evaluate Your Program! You Don’t Need a PhD to Evaluate Your Program! You Don’t Need a PhD to Evaluate Your Program! You Don’t Need a PhD to Evaluate Your Program!

The importance of building impact measurement into The importance of building impact measurement into The importance of building impact measurement into The importance of building impact measurement into your Child Passenger Safety initiativeyour Child Passenger Safety initiativeyour Child Passenger Safety initiativeyour Child Passenger Safety initiative

Linda Brees, MSLinda Brees, MSLinda Brees, MSLinda Brees, MSDirector, Bradshaw Institute for Community Child Health & Advocacy

Children’s Hospital of Greenville Health System

ObjectivesObjectivesObjectivesObjectives

• Provide brief history of Bradshaw Institute for Community Child Health & Advocacy and Safe Kids Upstate

• Describe Institute-wide impact measurement and scorecard development process

• Share how evaluation has helped promote Safe Kids Upstate and Child Passenger Safety initiative

• Share lessons learned along the way

Page 2: Bradshaw Institute pres - Lifesavers v2 - JF edits...– Injury Prevention-Safe Kids Upstate Safe Kids Upstate • Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

4/6/2018

2

GHS Children’s HospitalGHS Children’s HospitalGHS Children’s HospitalGHS Children’s Hospital

• 90 inpatient beds • 200 medical providers

• 80 NICU beds • >400,000 annual visits

• 40 specialties • Pediatric ED with >26,000 visits in FY17

Started as Started as Started as Started as GHS Children’s AdvocacyGHS Children’s AdvocacyGHS Children’s AdvocacyGHS Children’s Advocacy

Child advocacy work began over 20 years ago as a single injury prevention initiative and has evolved into an Institute with multiple program streams.

Page 3: Bradshaw Institute pres - Lifesavers v2 - JF edits...– Injury Prevention-Safe Kids Upstate Safe Kids Upstate • Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

4/6/2018

3

Bradshaw InstituteBradshaw InstituteBradshaw InstituteBradshaw Institute

• Launched in June 2016– Largest gift in GHS History

• Started with a Car Seat Check

• 5 Performance Teams– Healthy Child Development-Help Me Grow SC

– Child Abuse Prevention– Community Pediatrics– School Health – Injury Prevention- Safe Kids Upstate

Safe Kids UpstateSafe Kids UpstateSafe Kids UpstateSafe Kids Upstate

• Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

• Led by Children’s Trust of South Carolina

• We cover:– Greenville, Pickens and Oconee Counties

• Team and work is all philanthropically or grant supported by many organizations like:

6

Page 4: Bradshaw Institute pres - Lifesavers v2 - JF edits...– Injury Prevention-Safe Kids Upstate Safe Kids Upstate • Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

4/6/2018

4

Child Passenger SafetyChild Passenger SafetyChild Passenger SafetyChild Passenger Safety

• Primarily sponsored by Kohl’s Cares• Safe Kids Upstate is a Staff of 6

– All Child Passenger Safety Trained• 2 CPS Instructors

• 2 CPS Instructor Candidates

• 2 CPS Technicians

• 1 Safe Travel for All Children Course Instructor

• 4 Safe Travel for All Children Trained

• Major growth in Child Passenger Safety (CPS) program over the last 2 years as a result of strategic planning and impact measurement

Child Passenger Safety Child Passenger Safety Child Passenger Safety Child Passenger Safety Program GrowthProgram GrowthProgram GrowthProgram Growth

Area of FocusArea of FocusArea of FocusArea of Focus RecentRecentRecentRecent ChangesChangesChangesChanges

# of permanent Car Seat Inspection Stations

Original stations:1. Greer Fire Department2. Bradshaw Automotive3. Fountain Inn Fire Department4. Medshore Ambulance5. Easley Fire Department6. Seneca Fire Department 7. Belmont Fire Department 8. Parker Fire Department

Additional Stations:9. Lake Cunningham Fire Department10. Nurse Family Partnership11 Walhalla Fire Department12. Pickens City Fire Department13. Greenville Memorial Hospital 14. Safe Travel for All Children Special Needs Clinic

Page 5: Bradshaw Institute pres - Lifesavers v2 - JF edits...– Injury Prevention-Safe Kids Upstate Safe Kids Upstate • Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

4/6/2018

5

Child Passenger Safety Child Passenger Safety Child Passenger Safety Child Passenger Safety Program GrowthProgram GrowthProgram GrowthProgram Growth

Area of FocusArea of FocusArea of FocusArea of Focus RecentRecentRecentRecent ChangesChangesChangesChanges

Annual grant dollars $185,000 to $295,000

Average CPS appt. wait time

3 weeks to ~48 hours

Cost of On the Way program supplies (excluding staffing)

Average spend of $2,900/month ($34,800 annually) to $1,600/month ($19,200 annually)

Quality of program • CPST classes offered twice a year• CPST recertification reminders and programming to

engage current CPSTs built within last year• Monthly station newsletter with updates• Monthly station checklist reporting

Community event involvement

Participated in 87 community events in 2016; grew to 132 community events in 2017. Requests continue to grow over current staff capacity. Quality programming = more event requests

Journey to impact Journey to impact Journey to impact Journey to impact measurementmeasurementmeasurementmeasurement

• Bradshaw Institute is constantly challenged to prove worthprove worthprove worthprove worth as a non-revenue generating entity within a large health system

• Child Passenger Safety and other initiatives not just “nice to have” but “need to haveneed to haveneed to haveneed to have”

• Needed data for grant opportunities, marketing materials, and simply to understand what is working and what is notwhat is working and what is notwhat is working and what is notwhat is working and what is not

Page 6: Bradshaw Institute pres - Lifesavers v2 - JF edits...– Injury Prevention-Safe Kids Upstate Safe Kids Upstate • Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

4/6/2018

6

Journey to impact Journey to impact Journey to impact Journey to impact measurementmeasurementmeasurementmeasurement

1. PLAN: 1. PLAN: 1. PLAN: 1. PLAN: Designate person responsible

2. COMMUNICATE: 2. COMMUNICATE: 2. COMMUNICATE: 2. COMMUNICATE: Meet with staff and stakeholders

3. UNDERSTAND: 3. UNDERSTAND: 3. UNDERSTAND: 3. UNDERSTAND: Capture existing data, set goals, identify new measures

4. ESTABLISH ACCOUNTABILITY: 4. ESTABLISH ACCOUNTABILITY: 4. ESTABLISH ACCOUNTABILITY: 4. ESTABLISH ACCOUNTABILITY: Report at regular intervals to staff and leadership

5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:Monitor data and set new goals

Journey to impact measurement: Journey to impact measurement: Journey to impact measurement: Journey to impact measurement: Safe Kids UpstateSafe Kids UpstateSafe Kids UpstateSafe Kids Upstate

1. PLAN: 1. PLAN: 1. PLAN: 1. PLAN: SKU started with discussing team roles and responsibilities

2. COMMUNICATE: 2. COMMUNICATE: 2. COMMUNICATE: 2. COMMUNICATE: Meetings with :• Safe Kids Staff• Physician

Champions within system

3. UNDERSTAND: 3. UNDERSTAND: 3. UNDERSTAND: 3. UNDERSTAND: • Look at current CPS data-

using SKW Checklist• State of SC reports some

measures to Children's Trust already

• 4. ESTABLISH 4. ESTABLISH 4. ESTABLISH 4. ESTABLISH ACCOUNTABILITY: ACCOUNTABILITY: ACCOUNTABILITY: ACCOUNTABILITY:

• SKU team reviews monthly at team meetings

• Quarterly at Institute meetings

5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:5. CONTINUOUSLY IMPROVE:• Addition of grants - adjust metrics• Ability to report on “wins” to

leadership from a dashboard perspective

Page 7: Bradshaw Institute pres - Lifesavers v2 - JF edits...– Injury Prevention-Safe Kids Upstate Safe Kids Upstate • Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

4/6/2018

7

Performance ScorecardsPerformance ScorecardsPerformance ScorecardsPerformance Scorecards

Performance ScorecardsPerformance ScorecardsPerformance ScorecardsPerformance Scorecards

Every Bradshaw Institute program priority and measure is linked with one of the four Institute goals

Every Bradshaw Institute program priority and measure is linked with a broader Greenville Health System priority or guiding principle

This provides our Safe Kids team the ability to link their work to the broader health system mission.

Page 8: Bradshaw Institute pres - Lifesavers v2 - JF edits...– Injury Prevention-Safe Kids Upstate Safe Kids Upstate • Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

4/6/2018

8

Performance ScorecardsPerformance ScorecardsPerformance ScorecardsPerformance Scorecards

The program area, performance team or specific initiative within Bradshaw Institute (i.e. child passenger safety)

The high level priority for the program or initiative. Answers the question, “What do we want to do?”

SKUSKUSKUSKU----At HomeAt HomeAt HomeAt HomeSKUSKUSKUSKU----At PlayAt PlayAt PlayAt Play

SKUSKUSKUSKU----At SchoolAt SchoolAt SchoolAt SchoolSKUSKUSKUSKU----On the On the On the On the

WayWayWayWay

Performance ScorecardsPerformance ScorecardsPerformance ScorecardsPerformance Scorecards

The specific, measurable goal or metric, linked with the program priority. Answers the question, “How will we know we did it?”

Type of goal –process or impact

Page 9: Bradshaw Institute pres - Lifesavers v2 - JF edits...– Injury Prevention-Safe Kids Upstate Safe Kids Upstate • Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

4/6/2018

9

Performance ScorecardsPerformance ScorecardsPerformance ScorecardsPerformance Scorecards

“How will we achieve our goal?” Managers assist every team member in creating an action plan, which will work towards achievement of the specific measure.

Name of team member

Color-coded progress marked each quarter

ProgressProgressProgressProgress Color

Goal on Track; Goal on Track; Goal on Track; Goal on Track; trending right trending right trending right trending right directiondirectiondirectiondirection

GoalGoalGoalGoal at risk; at risk; at risk; at risk; issues or delaysissues or delaysissues or delaysissues or delays

Goal not met; Goal not met; Goal not met; Goal not met; cancelledcancelledcancelledcancelled or or or or high riskhigh riskhigh riskhigh risk

Sample CPS Goal #1Sample CPS Goal #1Sample CPS Goal #1Sample CPS Goal #1BRADSHAW INSTITUTE

GOAL

GHS PRIORITY

ALIGNMENT

BRADSHAW PROGRAM

AREA

PROGRAM PRIORITY

MEASURE GOAL RATIONALE

ACTION PLAN PERSON ACCOUNT

ABLE

Q1-18 Q2-18

Create healthier and safer communitie

s

Quality; patient

experience satisfaction; trustees of the future

Injury Prevention- On the

Way

Improve access to

Child Passenger Safety

Program for Expectant Parents/ Newborns

Creation of a permanent inspection station at Greenville Memorial

Hospital by December 31,

2017

Process 1-Provide referral services to existing stations 2- Offer

Referral stations to families on Mother Baby Unit 3-Provide Onsite inspection services to families that ask 4- Provide information and

process to families prior to discharge for

onsite inspection stations 5-Offer

comprehensive car seat inspection

services during peak discharge times

Lee Penny,

Bridgette Watson

Start Date set for 4/16/18, delayed but

will be completed in

totality

Inspection station

opened M-F 8:30am-4:30pm for discharged families

from GMH

Scorecard allowed

physician champions

to push for progress

with administration;

gave updates on goals

to coalition

Page 10: Bradshaw Institute pres - Lifesavers v2 - JF edits...– Injury Prevention-Safe Kids Upstate Safe Kids Upstate • Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

4/6/2018

10

Sample CPS Goal #2Sample CPS Goal #2Sample CPS Goal #2Sample CPS Goal #2BRADSHAW INSTITUTE

GOAL

GHS PRIORITY

ALIGNMENT

BRADSHAW PROGRAM

AREA

PROGRAM PRIORITY

MEASURE GOAL RATIONALE

ACTION PLAN PERSON ACCOUNT

ABLE

Q1-18 Q2-18

Create healthier and safer communitie

s

Quality; patient

experience satisfaction; trustees of the future

Injury Prevention- On the

Way

Improve quality of

Child Passenger Safety

Program Education for all families

Implementation of a family centered

satisfaction survey

administered to families who visit Safe Kids Upstate car

seat inspection stations by

April 1, 2018.

Process 1-Creation of survey template 2-Analysis of

best practice satisfaction surveys

used industry wide 3-Review Safe KidsWorldwide to consolidate

surveys/best practices 4-Draft sample survey

for families5-Educate CPS Techs to administer survey and implement survey

process

Lee Penny,

Bridgette Watson

Survey Drafted and put into

online platform

Implementation

expected to start on 4/17/18,with new hospital

inspection station.

Educating Techs on

new scorecard

InstituteInstituteInstituteInstitute----widewidewidewidelessons learned thus farlessons learned thus farlessons learned thus farlessons learned thus far

• Use literature, national data and requirements from funders to guide goal-setting

• Pre- and post-testing: an easy way to get started

• Cooperation avoids duplication

• Setting ourselves up for future success: process goals as important as impact goals

• Frequent reminders and accountability

• Culture shift: patience and support

Page 11: Bradshaw Institute pres - Lifesavers v2 - JF edits...– Injury Prevention-Safe Kids Upstate Safe Kids Upstate • Member of Safe Kids Worldwide – 1 of 13 coalitions in South Carolina

4/6/2018

11

Safe Kids UpstateSafe Kids UpstateSafe Kids UpstateSafe Kids Upstatelessons lessons lessons lessons llllearned thus farearned thus farearned thus farearned thus far

• Important to review what is already being collected at a state and national level

• Encouragement is VITAL – red on scorecards is okay!• Determining staff roles and responsibilities was crucial• The shift to data tracking and analysis was an adjustment

for our programming but has led to enhanced accountability and data accessibility for grant applications– The scorecard process is also useful for setting appropriate grant

goals and metrics

• Important to build trust and understanding of data needs with stakeholders (e.g. technicians)– Techs required education on checklists, reporting and commitment to

Safe Kids Coalition

• Goal is to eventually have readily accessible program “dashboard” with data in real time

Thank youThank youThank youThank you

Linda Brees

[email protected]