making the difference – why measurement matters in work with young people gemma rocyn jones
DESCRIPTION
Making the difference – why measurement matters in work with young people Gemma Rocyn Jones The Young Foundation NYCI Conference, 25 November 2011. The Young Foundation. We bring together insight, innovation and entrepreneurship to address social needs - PowerPoint PPT PresentationTRANSCRIPT
Slide 1 The Young Foundation 2010
Making the difference – why measurement matters in work with young people
Gemma Rocyn Jones The Young FoundationNYCI Conference, 25 November 2011
Slide 2 The Young Foundation 2011
The Young Foundation
• We bring together insight, innovation and entrepreneurship to address social needs
• Independent non-profit organisation without an endowment
• Base in UK, outposts in US, France, Australia, and with international perspective
Slide 3 The Young Foundation 2011
The Young Foundation today
• Research – into emerging social needs and how to innovate to meet them
• Collaborations – piloting innovations in public services
• Advising governments – on supporting innovation and social entrepreneurship
• Social ventures – supporting and spinning out start-ups
Slide 4 The Young Foundation 2011
What matters more: the pleasure or the measure?
Slide 5 The Young Foundation 2011
It’s both
Slide 6 The Young Foundation 2011
The drive to measure impact…•Central and local government – growing need to demonstrate VFM, accountability and transparency •Rise of PBR and outcomes-based commissioning •Changing profile of philanthropists and growth of social investment – greater interest in impact of investments, more ‘business-like’ approach•Increasing need to address inequality, disadvantage and exclusion •Fewer resources mean services need to be better targeted
Slide 7 The Young Foundation 2011
Impact:
“The changes resulting from your organisation’s activities”
(Charities Evaluation Service)
Slide 8 The Young Foundation 2011
Or… “The real reason for the existence of many VCS organisations, and the justification for the personal effort and money that go into that organisation”
Assessing Impact, Charities Evaluation Service
Slide 9 The Young Foundation 2011
The importance of impact measurement – why do it?
•The impact of negative outcomes on young people and communities •The costs associated with poor outcomes •The potential to improve outcomes and prevent harm •The reliance on public funding •The importance of advocacy •The potential to influence policy and practice
Slide 10 The Young Foundation 2011
How do we know we’re making a
difference?
How do we know we’re making a
difference?
How do we know where we’re going?
How do we know where we’re going?
How do we know how to get there?
How do we know how to get there?
So what?!So what?!
The challenge… Qualitative evidence is plentiful, and can be
powerful
“Every one of us at this table could tell you transformational stories about young people, particularly marginalised young people, who have engaged with youth workers in a positive way” (Fiona Blacke, CEO, NYA in oral evidence to Education Select Committee)
Quantitative evidence is less available, and dispersed
“I think it’s been all too easy for the Government and for local authorities to cut spending on services to young people, because we haven’t as a sector been able to demonstrate our impact well enough. Actually, we should never have been in that position, and we should never find ourselves in that position again” (respondent in telephone interview)
11
Slide 12 The Young Foundation 2011
And across the sector there is a lack of consensus, common language
and knowledge sharing
Not all youth sector providers are:•Considering their impact as part of their core business; or•Presenting outcomes in a consistent way.
Not all commissioners are:•Specifying social outcomes in tenders; or•Accounting for social impact in a ‘smart’ way when buying goods and services.
Not all investors are:•Accounting for social impact in a way that is appropriate for the youth sector when making investment decisions; or•Asking investees to report on their social impact.
In practice…
Slide 13 The Young Foundation 2011
Hitting the target but missing the point?
Define the point!
Slide 14 The Young Foundation 2011
If what gets measured, gets valued… how can we measure the things that matter the most?
Slide 15 The Young Foundation 2011
An agenda for the sector?
1.What is the outcome to be measured? Do organisations in the sector agree on a single outcome or set of outcome measures?
2.How is that outcome defined? Has it been defined by a measurement tool or set of criteria?
3.How should the outcome be captured? Are the right systems in place to enable services to capture it?
4.How can the outcome be attributed to an intervention? Can services explain what would have happened to young people without their intervention?
5.How can the outcome be valued? Are there good financial proxies that can be used to estimate value?
Measuring together – impact measurement in the youth justice sector, NPC
Slide 16 The Young Foundation 2011
Avoiding ‘measurement anxiety’ •Think about it•Plan it•Deliver it •Assess it•Improve it•Communicate it
NCVO
Slide 17 The Young Foundation 2011
The benefits of measurement
•Development of a common language – transparent, comparable and consistent•Builds an evidence base which testifies to the role and contribution of youth work and services for young people•Contributes to a virtuous circle where providers grow in confidence as do investors, commissioners and funders•Highlights your role to communities, schools and business, forging links and creating partnership opportunities•Grows a better understanding of value, and parameters for assessment •Allows proactive conversations with new and potential funders •Supports reflective practice, professionalisation and growth•Enables better service design and hence better outcomes•Helps to make a case for the most effective services
