israel accession seminar piaac: programme for international assessment of adult competencies skills...
TRANSCRIPT
11Is
rael
Acc
essi
on S
emin
arP
IAA
C:
Pro
gram
me
for
Int
erna
tiona
l as
sess
men
t of
Adu
lt C
ompe
tenc
ies
Skills strategy in OECD
Programme for the International Assessment of
Adult Competencies
22-23 November 2011
Etienne Albiser
22 I
srae
lA
cces
sion
Sem
inar
PIA
AC
: P
rogr
amm
e f
or I
nter
natio
nal
asse
ssm
ent
of A
dult
Com
pete
ncie
sPIAAC
PIAAC fills a key gap and will be important for education and skills strategies. Identify key competencies and levels of
literacy, numeracy and problem solving to participate in a modern economy and society.
Shed light on the process of acquisition, maintenance and loss of competency over the life cycle in relation to exposure to education, training and work.
Relates competencies at different ages with patterns of training, employment and wages as well as social outcomes.
33 I
srae
lA
cces
sion
Sem
inar
PIA
AC
: P
rogr
amm
e f
or I
nter
natio
nal
asse
ssm
ent
of A
dult
Com
pete
ncie
s
Not
co
mp
lete
d s
ch
ool
Up
per
seco
nd
ary
Un
ivers
ity
Not
co
mp
lete
d s
ch
ool
Up
per
seco
nd
ary
Un
ivers
ity
Not
co
mp
lete
d s
ch
ool
Up
per
seco
nd
ary
Un
ivers
ity
Country A Country B Country C
150
200
250
300
350
Skill score
Interquartile range in skill distribution by educational qualific-ation
Qualifications cannot be equated with actual skills
44 I
srae
lA
cces
sion
Sem
inar
PIA
AC
: P
rogr
amm
e f
or I
nter
natio
nal
asse
ssm
ent
of A
dult
Com
pete
ncie
s
Identify and measure cognitive competenciesbelieved to underlie both personal and societal
success; Assess the impact of these competencies
on social and economic outcomes at individual and aggregate levels
Gauge the performance of education and training systems in generating required competencies;
Help to clarify the policy levers that could contribute to enhancing competencies.
PIAAC Objectives
55 I
srae
lA
cces
sion
Sem
inar
PIA
AC
: P
rogr
amm
e f
or I
nter
natio
nal
asse
ssm
ent
of A
dult
Com
pete
ncie
s
PIAAC is the most comprehensive internationally comparable data on adult skills (16-65 years) across 25 countries.
Based on a direct and computer-based assessment (with paper-pencil version) in respondent’s homes;
Allowing trends to be monitored from previous surveys (IALS and ALL).
PIAAC will provide Data on competencies in literacy, numeracy and
problem solving skills in technology rich environments.
Data on skills used in the work place and other contexts and the match between required and measured competencies.
Information on the antecedents, economic and social outcomes and contexts of competency development and use.
PIAAC Overview
• No direct links between PIAAC and PISA but PISA 2000 included some literacy and numeracy questions.
• PISA cohorts may provide evidence of the impact of early performance on competencies of young adults in PIAAC
• For example: PISA cohort 2000 will be 27-28 year old people at the time of PIAAC data collection
66 I
srae
lA
cces
sion
Sem
inar
PIA
AC
: P
rogr
amm
e f
or I
nter
natio
nal
asse
ssm
ent
of A
dult
Com
pete
ncie
sParticipating countries
23 Member countries and 2 non-Member countries are participating in PIAAC.
AustraliaAustriaBelgiumCanadaChileCyprusCzech RepublicDenmarkEstoniaFinlandFranceGermanyIreland
ItalyJapanKoreaNetherlandsNorwayPolandPortugalRussian FederationSlovak RepublicSpainSwedenUnited KingdomUnited States
77 I
srae
lA
cces
sion
Sem
inar
PIA
AC
: P
rogr
amm
e f
or I
nter
natio
nal
asse
ssm
ent
of A
dult
Com
pete
ncie
sPIAAC Timeline
Develop framework for assessment
Develop framework for assessment
Pilot Job Requirements Approach survey
Pilot Job Requirements Approach survey
Develop survey instruments and computer platforms
Develop survey instruments and computer platforms
Conduct Field TestConduct Field Test
Conduct MS
Conduct MS
Analyse dataAnalyse data
Inter-national report
Inter-national report
2007 2008 2009 2010 2011 2012 2013
FT analysis Preparation for
Main Survey
FT analysis Preparation for
Main Survey
Second round
Project launch in January 2012
88 I
srae
lA
cces
sion
Sem
inar
PIA
AC
: P
rogr
amm
e f
or I
nter
natio
nal
asse
ssm
ent
of A
dult
Com
pete
ncie
sPIAAC : Progress to date
Field Test 2010 completed Conducted in 25 countries, in 35 languages and
delivered completely on computer Sample of 1500 cases per country
(in the main study: 4500 to 5000 adults in each country)
High quality data gained (e.g. few missing values, etc.)
Good or relatively good comparability of assessment items across country and assessment modes
Main operational challenge are response rates
Preparation for Main Study completedFinal item selection based on FT completedAssembly of virtual machine, training completed
Main Study under way until March 2012Approximately 167 000 completed cases are
sought
99 I
srae
lA
cces
sion
Sem
inar
PIA
AC
: P
rogr
amm
e f
or I
nter
natio
nal
asse
ssm
ent
of A
dult
Com
pete
ncie
sDemographic challenges
Skills by age
15 25 35 45 55 65225
235
245
255
265
275
285
295
305
No adjustmentAdjusted for immigrant status and educationAdjusted for immigrant status, education and reading engagement
Age
Skill score
1010 I
srae
lA
cces
sion
Sem
inar
PIA
AC
: P
rogr
amm
e f
or I
nter
natio
nal
asse
ssm
ent
of A
dult
Com
pete
ncie
sKeeping learning beyond school
Cross-sectional skill-age profiles for youths by education and work status
16 17 18 19 20 21 22 23 24 25220
230
240
250
260
270
280
290
300
310
320
Age
Mean skill score
Youth in education
Youth in education and work
Youth in work
Not in education, not in work
1111 I
srae
lA
cces
sion
Sem
inar
PIA
AC
: P
rogr
amm
e f
or I
nter
natio
nal
asse
ssm
ent
of A
dult
Com
pete
ncie
s
Proficiency levels of population (what people can do)
Distributions of proficiency Correlates of performance and outcomes Match/mismatch of skill Returns to education and basic
competencies Change in levels and distributions of basic
competencies for groups and nations (20 countries in both IALS/ALL [previous surveys] and PIAAC)
Picture of demand for competencies by occupations
PIAAC results in 2013
1212 I
srae
lA
cces
sion
Sem
inar
PIA
AC
: P
rogr
amm
e f
or I
nter
natio
nal
asse
ssm
ent
of A
dult
Com
pete
ncie
s
Policy issues that can be addressed: Performance of education/training systems
in developing basic competencies Measurement of stock of human capital Economic and social outcomes related to
basic competencies Effects of aging (individuals and society) Social inclusion and access to social
opportunities by level of competencies Factors aiding retention of competencies,
those promoting the improvement of existing competencies and those related to new competencies.
PIAAC policy potential
1313Is
rael
Acc
essi
on S
emin
arP
IAA
C:
Pro
gram
me
for
Int
erna
tiona
l as
sess
men
t of
Adu
lt C
ompe
tenc
ies
Further information
Education Directoratewww.oecd.org/edu
PIAAC and Skills strategywww.OECD.org/piaacwww.oecd.org/education/SkillsStrategyEmail: [email protected]