evaluation and learning: the what works fund experience · adult questionnaire and child survey...
TRANSCRIPT
Evaluation and Learning: The What Works Fund experience
Rebecca Graham Money Advice Service|@FinCapStrategy
Juliette Collier Campaign for Learning|@JulietteCfl
Dr Laurence Piercy Good Things Foundation|@GoodThingsFDN
Stephanie Hayter The Money Charity|@TheMoneyCharity
Scott Morrison Money Advice Service|@FinCapStrategy
@FinCapStrategy #TalkMoney|#FinCap17
Evaluation and Learning: The What Works Fund experience
Rebecca GrahamResearch & Evaluation ManagerThe Money Advice Service (UK)[email protected]
@FinCapStrategy #TalkMoney|#FinCap17
Client Name
Financial Capability
• Learning• Improving• Evidencing
1. Why evaluation?
3
Evaluation & Learning: The What Works Fund experience
Financial Capability
Source copy
What is MAS doing about it?
4
Evaluation & Learning: The What Works Fund experience
VIS
ION
A highly effective financial capability sector
AC
TIV
ITIE
S
EvaluationToolkit
IMPACT Principles
Support
Evidence Hub
MAS evidence &
insight
What WorksFund
Financial Capability
Source copy
The Toolkit
5
Evaluation & Learning: The What Works Fund experience
Understand your
programme
Measure a change
Learn and Share
Financial Capability
The What Works Fund:
A programme of activity that seeks to increase our understanding of how to improve financial capability across the UK.
Financial Capability
6
Evaluation & Learning: The What Works Fund experience
Financial Capability
Source copy
What is MAS doing about it?
7
Evaluation & Learning: The What Works Fund experience
Organisation Life stage Project type Description + Evaluation
The Money Charity
Children and young people
Scale up To deliver financial capability workshops in schoolsand colleges across England, Wales and NorthernIreland and test whether the workshops deliveredhave a significant effect on students’ financialcapability when compared with a ‘business as usual’control, and whether this differs across age ranges.
Campaign for Learning
Children and young people
Pilot To pilot and evaluate the impact of flexible rent payments, savings and use of credit, delivered with social landlords.
Good Things Foundation
Working age Pilot To pilot and evaluate the impact of a new approach to improving the financial capability of vulnerable people using face-to-face community based support and digital learning.
Juliette CollierNational DirectorCampaign for Learningwww.campaign-for-learning.org.ukjcollier@cflearning.org.uk
Campaign for Learning
Family Fortunes:Building Family Financial Capability and Resilience
Campaign for Learning
Financial Capability
• Preventative approach• Family learning pedagogy• Training for trusted intermediaries• Inclusive model• Project target audience EAL families• Children aged 7-11• Flexible 10 hour programme
Family Fortunes Model
2
Family Fortunes
Campaign for Learning
Financial Capability
• A lesson plan for the session
• Resources and activities for parents
• Resources and activities for children with parents
• Children join parents in session where possible
• A ‘Take Away’ home learning activity for families
Programme Structure
2
Family Fortunes
Campaign for Learning
Financial Capability
2
Family FortunesFamily Fortunes Team
Campaign for Learning
Financial Capability
2
Family Fortunes
Why Family Fortunes?
Financial Capability
Campaign for Learning
Theory of Change
24
Family Fortunes
Financial Capability
Campaign for Learning
Research partner: Institute of Education, UCL
Point of delivery evaluations of practitioner training
Pre and post testing (adults and children) built into the programme delivery to evidence any changes in participants’ skills and knowledge
Comparison group
Follow up interviews to identify and understand any behavioural change
Process evaluation, including practitioner interviews to understand strengths and weaknesses of the delivery model and how it might be improved
Research Overview
25
Family Fortunes
Financial Capability
Campaign for Learning
Tutors Tutor Training Target Numbers: 60 Point of delivery Evaluation questionnaire Complete: 66 tutors completed training
FamiliesIntervention Group
FF Course Evaluation Target Numbers: 300
Weeks 1 and 5 of programme delivery Adult Questionnaire and Child Survey
3 weeks post Semi-structured Interviews
4-6 months post Semi-structured interviews
Families Comparison Group
Non FF Family Learning programme
Target Numbers: 300 Weeks 1 and 5 of non-Fncapprogramme delivery
Adult Questionnaire and Child Survey
On-going
Progammes Process Evaluation Target Numbers:: 30 Throughout project timeline and programme delivery
Focus groups,observations, semi-structured tutor interviews
On-goingI
Data Collection: Who, What, When and How
26
Presentation Title
Financial Capability
Campaign for Learning
Practitioner Training Evaluation
88%
88% of training participants rated the FF resources/material as ‘excellent.’
31 programmes delivered or set up across England
8% of training participants
had previously received financial capability training
8%
27
Family Fortunes
31
Financial Capability
Campaign for Learning
Financial Capability
"Thank you today has been fantastic and it was great to share ideas and good
practice both for this course and in general."
"Its great and I can't wait to deliver it."
"Everything was so beneficial from today. I can't fault it. Looking forward
to delivering the programme."
"It was an excellent mix of practical and thoretical - not much to improve!"
28
Presentation Title
Financial Capability
Campaign for Learning
Pre and Post Testing Tools
29
Family Fortunes
Financial Capability
Campaign for Learning
“The most useful bit was learning about things going on different websites that I didn’t know about; how you can save money, like you can make a chart about the bills what are going out every month and then what money you’ve got left over you can either save it or go out and buy something”
Financial Capability
30
Family Fortunes
Laurence Piercy
Researcher
Good Things Foundation
laurence.piercy@goodthingsfoundatio
n.org
Good Things Foundation & Toynbee Hall
Supported Transactions
Client Name
Financial Capability
Client Name
Q. Are individuals receiving financial capability support better able to transact online if they are also supported to undertake a live transaction online?
32
Supported Transactions
Financial Capability
Client Name33
Supported Transaction
Client Name
Financial Capability
Client Name
A. Yes
34
Supported Transactions
Financial Capability
Client Name35
Supported Transaction
Financial Capability
Client Name36
Financial Capability
Client Name
Surface the transaction
Different messaging for different audiences
Choice, autonomy, and personal relevance
Fear of losing control may be a bigger factor than security
37
Supported Transactions
Financial CapabilityFinancial Capability
Q&A
Juliette Collier, Campaign for LearningDr Laurence Piercy, Good Things Foundation Stephanie Hayter, The Money CharityScott Morrison, Money Advice Service
39
Evaluation & Learning: The What Works Fund experience
Financial CapabilityFinancial Capability
To hear more about how we can support you to evaluate your financial capability programme, contact us at [email protected]
40
Evaluation & Learning: The What Works Fund experience
Thank you
www.fincap.org.uk@FinCapStrategy |#TalkMoney|#FinCap17