monitoring a qris: opportunities for cost controls and ......licensed fcc, ccc, certified tribal,...

35
Monitoring a QRIS: Opportunities for Cost Controls and Efficiencies 2014 QRIS National Meeting July 24, 2014

Upload: others

Post on 16-Oct-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Monitoring a QRIS: Opportunities for Cost Controls and Efficiencies

2014 QRIS National Meeting

July 24, 2014

Page 2: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

QRIS Monitoring System Overview

Factors that Influence Monitoring

Opportunities for Cost Controls and Efficiencies

National Center on Child Care Quality Improvement 2

Page 3: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Factors that Influence Monitoring

Standards

Rating and Monitoring

Visits

Staffing Patterns and

Characteristics

National Center on Child Care Quality Improvement 3

Page 4: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Standards

Opportunities for Cost Controls and Efficiencies

Clear and concise standards

Clear and concise companion tools

Training and support

Equivalencies for standards

Even progression between levels

National Center on Child Care Quality Improvement 4

Page 5: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Rating and Monitoring Visits

Opportunities for Cost Controls and Efficiencies

Percentage of classroom observations

Frequency of assessments

Automation and sharing of data

Self-report with verification

Provider readiness

National Center on Child Care Quality Improvement 5

Page 6: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Staffing Patterns and Characteristics

Opportunities for Cost Controls and Efficiencies

Coordination with other programs

Building upon existing systems

Clearly defined roles and responsibilities

Establishment and maintenance of staff expertise

National Center on Child Care Quality Improvement 6

Page 7: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

State Examples

Efficiencies and Cost Controls in three States’ QRIS monitoring systems

National Center on Child Care Quality Improvement 7

Washington Oklahoma Arizona

Page 8: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Resources

• National Center on Child Care Quality Improvement (NCCCQI). (2014). QRIS Resource Guide. Washington, DC: Author. https://occqrisguide.icfwebservices.com/index.cfm?do=resourceguide

• Tout, K., Chien, N., Rothenberg, L. & Li, W. (2014). Implications of QRIS Design for the Distribution of Program Ratings and Linkages between Ratings and Observed Quality. OPRE Research Brief #2014-33. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.

http://www.acf.hhs.gov/programs/opre/resource/implications-of-qris-design-for-the-distribution-of-program-ratings-and-linkages-between-ratings-and-observed-quality

National Center on Child Care Quality Improvement 8

Page 9: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Thank You

National Center on Child Care Quality Improvement NCCCQI does not endorse any non-Federal organization, publication, or resource.

Phone: 877-296-2250 Email: [email protected]

Page 10: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports
Page 11: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Arizona’s quality improvement and rating system (QIRS)

• Began in 2009

• Voluntary system

• Programs must be regulated to participate

• Five level rating scale

• Components of Quality First o Coaching

o Assessment- ERS, CLASS and Points Scale

o Incentives- enhancement grant and scholarships

o Specialized TA- Mental Health, Inclusion and Child Health

o Professional Development- T.E.A.C.H scholarships

WHAT IS QUALITY FIRST?

Page 12: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

928 providers

• 731 Centers

• 197 Family Child

Care

• Statewide

• Variety of

program types

CURRENT PARTICIPATION

Page 13: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports
Page 14: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

USING THE CLASS ASSESSMENT FOR MONITORING • Assessment Process

o Centers and Homes

o Accredited and Head Start

• Frequency of Assessments

o Years of Participation

o Star Levels

o Rating Only

• Collecting CLASS Assessment Data

o Assessor reliability

o Coach Training

o Assessment reports provided to TA and Participant

• Using CLASS Assessment Data

o Development of goals

o Working on policy change for programs who have met a 3-5 Star Level and have had a CLASS assessment

o Incorporation of the Toddler CLASS

Page 15: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

QUALITY FIRST DATA SYSTEM • Internally built reporting system

• Users Friendly System for Efficiency o Participants

Can update their own information

o Coaches, Assessors, and Specialized TA

Activity log

Reports available

Communication

Support for participants on the input of information

o Grantees

Monitoring

Communication

Data input

Quality Assurance

o First Things First staff

Assigning positions and roles to control what each user sees

Creating internal reports

Automatic notifications

Revisions to the fields in the system are internal and based on feedback and what is needed

Page 16: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

DATA SYSTEM COLLECTION

Page 17: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

DATA DRIVEN DECISIONS AND LINKAGE

• Ongoing Improvements to Fields in the Extranet

o Less narrative

o What data do we need?

o Validation Study

o Making data driven decisions- Scaling up Quality First

o Improving implementation- Assessment process and coaching implementation

o More user friendly

• Linkage to Other Systems

o ADE child identifiers for school readiness indicators

o Professional Development registry to confirm degrees, credits, professional development and experience

o Professional Development Registry linkage to other state systems to ensure consistent data and information- DHS, DES, ADE

Page 18: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports
Page 19: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Monitoring QRIS

In Oklahoma

QRIS National Meeting

Page 20: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Organization of Child Care Services

Director of CCS

QRIS Program Manager

2-Stars Outreach Specialist

(Caseloads 2,000:1)

12-Consultation and Technical

Support Specialist (Caseloads 180:1)

Statewide Licensing

Coordinator

104 Licensing Specialist

(Caseloads 50:1)

Page 21: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Roles and Responsibilities for QRIS

Stars Outreach Specialists—Manage the application process for programs to apply for higher levels

Child Care Licensing Specialists—Manage the on-going monitoring of all programs for Licensing and QRIS, as well as providing the first level of technical assistance.

Consultation and Technical Support Specialist—Providing focused and intentional technical support services to programs that are 1+ and higher.

Page 22: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Reaching for the Stars Block System, started in February 1998.

100% of facilities rated (1 Star), with additional levels of

1+, 2, and 3 star.

Child Care Centers, Head Starts, Military, Tribal, School

age and Family Child Care Homes

Program applies using a paper application process,

reviewed by Stars Outreach Specialist

Monitored in the field from tablet by Licensing at least

annually for all criteria for specified level. The criteria is

either met or not met.

Page 23: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Star Level/Key Term

Criteria Indicator

Evidence/Acceptable

documentation

1+ Star

OAC 340:110-1-8.3(b) and

(c)(2)

MEET ALL 1 STAR AND

ADDITIONAL CRITERIA

INDICATED BY 1+ STAR

As verified above for all 1

Star criteria and meeting

all items listed with 1+

1+ Star

Administrative

OAC 340:110-1-8.5 (a)

Staff counted in staff child

ratio are members of the

Oklahoma Professional

Development Registry and

have a current professional

development ladder

certificate. New staff must

be on the registry within 12

months of employment.

OCCS staff verify

Professional Development

Registry at:

https://okregistry.org

1+ Star

Learning Environment

OAC 340:110-1-8.8 (a)

Weekly lesson plans for all

age groups of children

Lesson planning resources

are the

Oklahoma Early Learning

Guidelines

Infant/Toddler/2

Preschool

Current, written and readily

available lesson/activity plan

located in every classroom

for all groups of children

posted in every classroom

Copy provided

Observe on-site by OCCS

Page 24: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Levels do not expire as long as program continues to meet all the criteria for the given level.

Reduction procedure for programs that fail to meet all the criteria for their given level, this also includes an appeal process.

A Environment Rating Scale (ERS) or Program Administration Scale (PAS) is conducted every 3 years. Scores are not used to determine participation, instead the scale is a tool for continuous quality improvement. The ERS is completed by an assessor from a contracted agency and the results are hand delivered and reviewed with the program by the Consultation and Technical Support Specialist.

Reaching for the Stars

Page 25: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

2013 STARS PARTICIPATION

Page 26: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Selection of QUALITY

staff along with

high quality professional development

is key to success

Applications—give basic info

Let past behavior predict future behavior

Core competencies

Core training, including field visits with veterans and practicum component

On-going professional development including policy training, follow up from quality assurance reviews and annual statewide Licensing conference

Page 27: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Ensuring Ongoing Quality Matters in Oklahoma Using methods such as Quality Assurance Reviews, Bi-annual

provider satisfaction surveys and community meetings we are able to evaluate the effectiveness of policies and procedures for monitoring child care programs

Monthly meetings with partners and quarterly meetings with licensing supervisors are some of the strategies we use to include staff from different regions in all areas of quality assurance to assists with consistency of the program

Meaningful and purposeful evaluation leads to continuous quality improvement

Page 28: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Monitoring a QRIS – Washington State

QRIS National Meeting

Page 29: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Early Achievers At-A-Glance Implemented July 2012

Hybrid, Five Level System

Licensed FCC, CCC, Certified Tribal, Certified Military, Head

Start, State Pre-k

Implementation Partners

Resource and Supports

Incentives

Coaching and Technical Assistance

July 2014 QRIS National Meeting

Page 30: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Data Collection Process

Technical Assistance Specialist

Community Liaison

Data Collector

Coach

QRIS National Meeting July 2014

Child Care Aware of Washington

Navigating Early Achievers level 2

Tailoring supports to the individual needs of

each early learning program

Head Start and State Preschool programs

follow an alternative, streamlined pathway

Find out more here: www.childcarenet.org

Page 31: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Data Collection Process

Technical Assistance Specialist

Community Liaison

Data Collector

Coach

QRIS National Meeting July 2014

University of Washington

What is a community Liaison?

Why is this unique position important?

How do community Liaisons help to streamline the data

collection process?

Learn more here: www.cqel.org

Page 32: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Data Collection Process

Technical Assistance Specialist

Community Liaison

Data Collector

Coach

QRIS National Meeting July 2014

University of Washington

Scheduling

On-site data collection

Reliability

Post visit Surveys

Learn more here: www.cqel.org

Page 33: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Data Collection Process

Technical Assistance Specialist

Community Liaison

Data Collector

Coach

QRIS National Meeting July 2014

Child Care Aware of Washington

Review of rating data

Planning and implementing change

Communication to ensure alignment between the

assessment team and the coaching team

Find out more here: www.childcarenet.org

Page 34: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

Building the ‘System’ to Support the ‘System’

Targeted Intervention – Defining Roles and Expectations

Infant Toddler Consultants

Pre-k Coaches

Other (school age, health, licensing)

Data Systems– Alignment and Integration

Licensing and Registry

Pre-K Data System

QRIS Data

Comprehensive Support – Expanding Services

Pre-K Expansion

Training Resource Centers

July 2014 QRIS National Meeting

Page 35: Monitoring a QRIS: Opportunities for Cost Controls and ......Licensed FCC, CCC, Certified Tribal, Certified Military, Head Start, State Pre-k Implementation Partners Resource and Supports

QRIS National Meeting

July 2014

Questions?