1

Version 1 | Internal Use Only © Ipsos MORI

Version 1 | Internal Use Only

Community Learning Mental Health Pilot Evaluation Training Webinar

2

Version 1 | Internal Use Only © Ipsos MORI

Today…

• Introduction to the evaluation

• Introduction to the evaluation tools

−Learner survey

−Monitoring Information Return Template

• How to use the tools

• How to return the tools to the evaluation team

• Timetable

• Any questions?

3

Version 1 | Internal Use Only © Ipsos MORI

Introduction to the evaluation

• The evaluation team:

− Ipsos MORI, an independent research company

− The Centre for Citizenship and Community

− The Centre for Mental Health

• The evaluation data collection activities:

− Learner surveys

− Collection of monitoring information

− Case study visits to some pilots to interview learners,

volunteers, delivery staff and management

• The evaluation reporting dates:

− November 2015, to inform the Year 2 pilot

− Summer 2016, for our final report on the first year.

4

Version 1 | Internal Use Only © Ipsos MORI

Learner survey

The purpose of the survey is to find out:

− what other benefits community learning may have for

learners, in addition to mental health benefits;

− whether some groups of learners particularly benefit from

community learning.

• It will give us an evidence base to inform discussions about

Year 2 of the pilot and beyond.

The survey asks questions about:

1. How learners found out about the course and why they

chose it;

2. Learners’ previous experience of learning and their

attitudes towards learning;

3. Learners’ roles and responsibilities, such as caring and

work;

4. Learners’ health, and what other support they may have

for their mental health problem.

5

Version 1 | Internal Use Only © Ipsos MORI

Monitoring Information return template

The monitoring information return is for you to:

• Submit the mental health scores collected from learners;

• Tell us what courses you are running;

• Tell us about your pilot’s workforce development activities;

• Tell us about your pilot’s learner involvement and co-

production activities;

• Tell us about the organisations your pilot is working with, if

these have changed since you last spoke to us;

• Give us any other feedback or comments.

6

Version 1 | Internal Use Only © Ipsos MORI

How to use the learner survey

• The survey will be available in both paper form and

online.

• We will send you paper questionnaires (based on the

number of learners you expected in your application).

• We will also send you links to the online survey. This

can be completed on a computer, tablet or smartphone.

• You will be responsible for encouraging your learners to

complete this survey.

• Learners can complete the survey on site or at home,

but:

− surveys must be completed as soon as possible to the

appropriate time;

− if learners take the paper survey home they must

return it to you.

• There are three survey

questionnaires:

1. Baseline (at the

beginning of the

learner’s first course)

2. Interim (at the mid-point

of the course, for

courses six weeks long

or more)

3. Final (at the end of each

course the learner

completes).

• There will be different paper

questionnaires and different

online links for each of

these three questionnaires.

7

Version 1 | Internal Use Only © Ipsos MORI

How to return the surveys to the evaluation team

• Surveys completed online will be automatically

submitted.

• Please return completed paper survey forms to Ipsos

MORI at the end of each month.

• Ipsos MORI will provide you with pre-paid, recorded

delivery bags to send the forms back in – enough for

one per month.

• Each pack of questionnaires should include a survey

administration form.

• You may wish to produce

alternative versions of the

questionnaire as required

by your learners, e.g.

− large print

− other languages

− easy read

• Please use the online

survey form to submit

answers from these

questionnaires.

• Do not send us alternative

versions of the

questionnaire on paper, as

we will not be able to

process these.

8

Version 1 | Internal Use Only © Ipsos MORI

How to use the monitoring information return

The monitoring information return is an Excel spreadsheet with 7

tabbed sheets:

• A cover sheet

1. Information about your pilot

2. Baseline mental health scores

3. Interim mental health scores (to be completed only where

necessary)

4. Final mental health scores

5. Mental health scores for learners using alternative scoring

systems due to learning difficulties (optional)

6. Feedback for the evaluation team (optional)

Please supply basic details about each learner next to their

scores, so we can match their scores to their survey responses

and the ILR. You will only need to enter these details once and

they will automatically appear on the other sheets.

• We have provided the

option for you to provide the

score obtained for each

question on the mental

health scales.

• However, it is only

mandatory for you to enter

the total score for each

scale.

• There are also options for

you to record whether

learners:

− missed out a

question/scale

− refused a question/scale

− were too distressed to

answer a question/scale

9

Version 1 | Internal Use Only © Ipsos MORI

How to return the monitoring information

• Your pilot lead is responsible for making sure the data

in the return is accurate and complete.

• Please save the Excel spreadsheet in the format:

<<UKPRN>>_MI Return_<<DDMMYY>>_CONFIDENTIAL

• Once you have encrypted and password protected

the Excel return, email it to:

communitylearningevaluation@ipsos.com.

• Copy in your evaluation point of contact to all

correspondence.

• We will then confirm safe receipt.

• As this file will contain

information about your

learners, you must

encrypt it using Winzip

and password protect it

before you email it to us.

• We will provide you with

instructions for how to do

this using Winzip.

10

Version 1 | Internal Use Only © Ipsos MORI

Timetable

Cut-off date for

including learners

in data

Date

information

must be sent

by

Learner

Surveys

Learner Level MI

Worksheet 1 Worksheets 2-6

30th September 2015 7th October 2015

30th October 2015 6th November 2015

30th November 2015 4th December 2015

11th December 2015 18th December

2015

29th January 2016 5th February 2016

29th February 2016 7th March 2016

31st March 2016 7th April 2016

11

Version 1 | Internal Use Only © Ipsos MORI

11

Any questions?

15 minutes

12

Version 1 | Internal Use Only © Ipsos MORI

Version 1 | Internal Use Only

Thank you communitylearningevaluation@ipsos.com

© Ipsos MORI This work will be carried out in accordance with the requirements of the international quality standard for market research, ISO 20252:2006 and with the Ipsos MORI Terms and Conditions which can be found here