welcome to maxsumo training session
DESCRIPTION
Welcome to MaxSumo training session. Pernilla Hyllenius Mattisson, Trivector Traffic, SWEDEN EU project MAX (2006-2009) Work Package B: Behaviour change model and Methods for Evaluation - PowerPoint PPT PresentationTRANSCRIPT
slide 1
Welcome to MaxSumo training session
Pernilla Hyllenius Mattisson, Trivector Traffic, SWEDEN
EU project MAX (2006-2009)
Work Package B: Behaviour change model and Methods for Evaluation
Partners: ILS (D), CNRS (F), NU Napier (UK), Univ. of AUTH (GR), Uni Griesen, Uni Magdeburg, Trivector (S), ESTC (USA)
slide 2
MaxSumoA tool that gives guidance on how to plan, monitor and evaluate an MM-project
slide 3
MaxSumo
• Based on MOST-MET (MOST), CAF (Tapestry), SUMO• Further developed in the EU project MAX
• Has great possibilities to become a common European standardised evaluation tool ensuring…
… that evaluations are able to be done at all
… that evaluations are done in a comparable way
slide 4
Mobility Management
System impact
MaxSumo
slide 5
System impacts
Mobility Management
services
System impacts
New mobility option
Mobility Management
slide 6
Example: Test Traveller / Job ticket project
Background Before data: 5 % PT, 95 % car (in TT group)
Mo
bility
Services
Activities: 10 posters, Intra net info, meetings, 100 E
Awareness: 48 % (480 employees)
Usage: 28 % (280 employees) particip. in info-meet.
Satisfaction: 80 % satisfied with info and test concept
Mo
bility O
ptio
n O
ffered
Acceptance: 6 % (54 people) signed a contract
Take up: : During: 85 % PT (in TT group)
Satisfaction: 90 % of TT satisfied with commuting by PT
Effects
Perm travel beh. After 12 months: 40 % PT (in TT group)
Decrease/year: Car traffic: 110.000 km, CO2: 20 tonnes
slide 7
How to use MaxSumo?
slide 8
MonitoringCollect a basic data-set
Evaluationof the data collected
Monitoring and Evaluation
Project Start
Target Groups
Services & Option offered
Uppdragsbeskrivning& målsättningar
Mission Statement and Objectives
Targets and indicators on Assessment Levels
MEP: Monitoring
and Evaluation
Plan
for the actual project
Methods
slide 9
MonitoringCollect a basic data-set
Evaluationof the data collected
Monitoring and Evaluation
Project Start
Target Groups
Services & Option offered
Uppdragsbeskrivning& målsättningar
Mission Statement and Objectives
Targets and indicators on Assessment Levels
MEP: Monitoring
and Evaluation
Plan
for the actual project
Methods
slide 10
Overall goals
Target groups
Mobility services provided
Mobility option(s) offered
MaxSumo Monitoring and Evaluation Plan
Template 1
10
slide 11
Level Targets Indicators Methods When
Servicesprovided
A Project activities and outputs
B Awareness of mobility services provided
C Usage of mobility services provided
D Satisfaction with mobility services provided
Mobilityoption offered
E Acceptance of mobility options offered
F Take up of mobility option offered
G Satisfaction with the mobility option offered
Overall effects
H Long-term attitudes and behaviour
I System impacts
MaxSumo Monitoring and Evaluation Plan
Template 2
slide 12
Level Targets Indicators Methods When
Servicesprovided
A Project activities and outputs
XXX XXX
B Awareness of mobility services provided
XXX XXX
C Usage of mobility services provided
XXX XXX
D Satisfaction with mobility services provided
XXX XXX
Mobilityoption offered
E Acceptance of mobility options offered
XXX XXX
F Take up of mobility option offered
XXX XXX
G Satisfaction with the mobility option offered
XXX XXX
Overall effects
H Long-term attitudes and behaviour
XXX XXX
I System impacts XXX XXX
MaxSUMO Evaluation Plan
Template 2MaxSumo Monitoring and Evaluation Plan
Template 2
slide 13
Level Targets Indicators Methods When
Servicesprovided
A Project activities and outputs
XXX XXX
B Awareness of mobility services provided
XXX XXX
C Usage of mobility services provided
XXX XXX
D Satisfaction with mobility services provided
XXX XXX
Mobilityoption offered
E Acceptance of mobility options offered
XXX XXX
F Take up of mobility option offered
XXX XXX
G Satisfaction with the mobility option offered
XXX XXX
Overall effects
H Long-term attitudes and behaviour
XXX XXX
I System impacts XXX XXX
MaxSUMO Evaluation Plan
Template 2MaxSumo Monitoring and Evaluation Plan
Template 2
slide 14
Level Targets Indicators Methods When
Servicesprovided
A Project activities and outputs
XXX XXX XXX
B Awareness of mobility services provided
C Usage of mobility services provided
XXX XXX XXX
D Satisfaction with mobility services provided
Mobilityoption offered
E Acceptance of mobility options offered
XXX XXX XXX XXX
F Take up of mobility option offered
XXX XXX XXX
G Satisfaction with the mobility option offered
Overall effects
H Long-term attitudes and behaviour
XXX XXX XXX XXX
I System impacts XXX XXX XXX
MaxSUMO Evaluation Plan
Template 2MaxSumo Monitoring and Evaluation Plan
Template 2
slide 15
OK, let´s practice!
• Case 1: Personalised travel planning
• Case 2: Walk and Bike to school
slide 16
Overall goals
Target groups
Mobility services provided
Mobility option(s) offered
MaxSumo Monitoring and Evaluation Plan
Template 1
16
slide 17
MaxSumo Evaluation Plan
Template 1
Overall goals To decrease the use of car and decrease the CO2 emissions.
Target groups Inhabitants living in Gros i San Sebastian.
Services - Information letter to all households (timetables, bikemaps, etc)
- An ”answering card” with possibility to:
- ask for personalised advices
- to order a free 1-week PT ticket
Mobility option offered
To travel by public transport, bike or foot instead of using the car.
slide 18
Level Targets Indicators Methods When
Servicesprovided
A Project activities and outputs
B Awareness of mobility services provided
C Usage of mobility services provided
D Satisfaction with mobility services provided
Mobilityoption offered
E Acceptance of mobility options offered
F Take up of mobility option offered
G Satisfaction with the mobility option offered
Overall effects
H Long-term attitudes and behaviour
I System impacts
MaxSumo Monitoring and Evaluation Plan
Template 2
slide 19
MaxSumo gives you
- Help to manage and pilot
- Guidance on survey design:
- control group
- comparison group
- one group
- Practical help (examples of questions)
- Help throughout the whole process: stop and go
- Early results- Comparable results
To be aware of…
- Clear objective
- Clear conceptions of services and options offered
- Best if used already in the planning stage
- You don´t have to use all levels
- Only provides a structure – still the same requirements on the competence of the evaluator
- Seems to be easier than it is…
slide 20
• Interactive database with input and output modules• Based on MaxSumo and Swedish SARA
• Accumulates results from different projects evaluated using MaxSumo
• Gives guidance on how to evaluate• Makes it possilible to benchmark with others
MaxEva web-based tool
slide 21
Thank you!
Pernilla Hyllenius Mattisson
MaxSumo and MaxEva: www.epomm.eu / Max MM-tools