uk vocational qualification reform programme research and evaluation (project 2): an overview 2nd...

UK Vocational Qualification Reform Programme

Research and Evaluation (Project 2): An overview2nd Vocational Qualification Reform Conference3 June 2010

Purpose

Interactive session Raise awareness of P2 activities Encourage contribution into development of

future activities and ensure NI requirements are met

Highlight ways in which P2 work can be used in NI

Discuss early findings Consider future work

Background

One of five projects with UK remit Responsibility of UKCES since April 2009 Two full-time staff currently in post Role extends to March 2011 Independent / objective perspective on

Programme

Objectives

To assess the level, extent and nature of benefits for employers and learners (summative)

To review progress towards benefits to inform Programme design and implementation (formative)

Learner benefits

Learner

LB1: More appropriately skilled

LB2: Better understanding of career opportunities

LB4: Improved understanding of

qualifications

LB3: Increased flexibility of learning

“I have skills that are aligned to the needs of my industry/sector/employer

and that will help me in my current /future job”

“I understand how this qualification will benefit

me in my current job and how it can benefit me in

future jobs”

“I can take qualifications in a manner that suits my lifestyle &

fits with my employers time demands.”

“I can choose to mix and match the units that are applicable to

me”

“I understand what I will learn in my qualification

and how it compares with other qualifications”

Employer benefits

“My employees’ qualifications give them the skills that enable them to

have an immediate impact on my company’s bottom

line”

“I can influence or create a qualification that addresses

the skills gaps in my organisation”

“Qualifications are created in a timeline that is

consistent with my needs”

“My workforce can take the qualifications at a time and

in a mode that suits my business”

“I understand what my employees will learn in their qualifications, how

these compare with other qualifications and how

they will help my employees progress within

my business”

Employer

EB2: Demand responsive qualificationsEB1: More appropriately

skilled workforce

EB3: More flexible qualification system

EB4: Improved understanding of qualifications

Approach Monitoring and evaluation framework:

Levers Process measures Immediate outcomes Benefits realisation, universal element Causality

LB3: Increased flexibility of learning“I can take qualifications in a manner that suits my lifestyle & fits with my employer's time demands.” “I can choose to mix and match the units that are applicable to me”

Current activities

Programme outcomes baseline End-to-end VQ case studies Progress monitoring system (dashboard) Synthesis of project evaluation work Overarching report May 2010

KEY FINDINGS

LB1 / EB1: Relevance of content

Progress in populating QCF Significant take-up of QCF VQs Some reformed VQs more relevant than

predecessors Majority of content migrated without reform –

tactical vs strategic development Commitment to ongoing development

LB2 –VQs and career development

VQ development supports pathways in some sectors

Not being communicated to learners yet Supporting elements not in place: LR/RTA,

IAG readiness

LB3 / EB3 - Flexibility

VQ development process showing increased engagement with QCF principles

Much of potential flexibility remains notional Flexibilities generally not being realised

through delivery at this stage Except for some cases of full cost provision

to employers

LB4 / EB4 – understanding of QCF principles

QCF titling conventions being applied Readiness at early stage Learners: little evidence of understanding

of QCF principles Employers stress continuity; also some

concerns

EB2 – Demand responsive VQs

Employers feel they have had an influence when directly involved in VQ development

Continued concerns over timeliness of development but long initial lead time may indicate good practice

Providers often receive VQ information on “just in time” basis

Questions

To what extent do initial findings reflect situation in NI?

In which areas has NI seen greatest progress?

What are the main barriers to progress in NI? What should priorities be for future evaluation

work?