Emma Church

THE USE OF WP DATA: HOW IT CAN BE DEPLOYED TO

INFORM PRACTICE AND

INTERVENTION?Uses of Data in the

East MidlandsExamples of the

Use of Data

Introduction to the East Midlands Widening Participation Research and Evaluation

Partnership (EMWPREP)

EMWPREP: 8 HEIs in the East Midlands Continuing the work of Aimhigher in the East

Midlands Work includes:

Monitoring and evaluating institutions’ outreach programmes

Evaluation of discrete outreach activitiesTargeting students for outreach activityAnalysing partner institutions’ student data

Analysing external data: UCAS; DfE

USES OF DATA: There are three main ways in which data is

used in the East Midlands:

1. Targeting

2. Monitoring

3. Evaluation

TARGETING: Targeting for inclusion in WP interventions

takes place on two levels:

School Level

Individual Level

TARGETING: SCHOOL LEVEL  % residing in POLAR3 quintile % residing in IMD2010 area Free School Meals

(FSM)GCSEs KS2 No. of

Pupils  Targeting  

School Name qYPR 1 qYPR 2 qYPR 1or2 10% most deprived

20% most deprived

40% most deprived

% eligible for FSM (performance table stats) (Jan 2013 Census)

% 5+ A*-C inc E&M 2012 % achieving level 4 or above in reading and mathematics test and writing teacher assessment 2012

Total No. of Pupils

No. used in analysis

Target School

Total All Criteria

School A 64% 34% 97% 94% 95% 99% 49% N/A 77% 342 342 P 10School B 62% 3% 65% 9% 9% 57% 29% N/A 74% 120 116 P 4School C 62% 11% 73% 17% 32% 61% 17% N/A 46% 760 759 P 3School D 60% 1% 61% 56% 60% 97% 44% NO DATA AVAILABLE N/A 293 289 P 9School E 46% 45% 92% 0% 0% 20% 17% NO DATA AVAILABLE N/A 395 395 P 1School F 44% 22% 67% 43% 70% 84% 67% 0% N/A 63 63 P 8School G 44% 44% 88% 0% 0% 20% 17% 31% N/A 403 403 P 1School H 42% 35% 77% 49% 52% 81% 25% 49% N/A 1,040 1035 P 6School I 41% 26% 67% 35% 40% 50% 18% NO DATA AVAILABLE N/A 500 498 P 2School J 41% 38% 80% 0% 0% 14% 9% NO DATA AVAILABLE N/A 468 467   0

TARGETING: INDIVIDUAL LEVEL Currently a student will fall into the cohort if they

meet the following criteria: They are predicted a 40% (city)/ 50% (county)

chance of achieving 5+ A*-C GCSEs AND They are eligible for Free School Meals (FSM), OR They fall within one of the 20% most deprived areas

nationally according to the Indices of Multiple Deprivation (IMD), OR

They fall within one of the 20% lowest young HE participation wards (quintile 1) of POLAR3, OR

They fall within one of the 40% most deprived areas nationally according to IMD AND within one of the 40% lowest young HE participation wards (quintile 1 or 2) of POLAR3.

MONITORING: M&E DATABASE

MONITORING: ACTIVITY PROFORMASActivity Pro-forma This pro-forma should be filled in by the Activity Lead. Refer to the guide to completion for more information. Date (s):

Activity Name:

Lead Provider:

Funding Stream (please tick one) HEI WP Funding HEI Recruitment REACH

Other Funding (please specify)

Funding Year: 2013/14 2014/15 Category: Cat1 / Cat2

Activity Type: Sub-activity Type:

Project (please specify):

Core Activity Type (please tick one) Campus Visits (generic) Information, Advice and Guidance Student Ambassadors Master Classes, including subject enrichment

or revision sessions

Mentoring School or college based interventions as part

of an agreed programme Summer Schools and other HE related

residential experiences

Residential: Yes / No Activity Duration: Activity Description:

Receiving Organisation(s) (schools/colleges/other):

Target Group (please tick all that apply) General (not targeted beyond school level) Identified Cohort G&T Cohort Travellers Students with EAL BME Learners Looked After Children Students with Disabilities Communities Rural Deprivation

Primary School Students Mature Students Parents Gender Inequalities - Female Gender Inequalities – Male Apprentices and Advanced Apprentices Vocational Learners Work-based Learners Other (state) _ ______ ____ __ __ ____ ____ __

Activity Organiser Details (staff):

Activity Providers (providing institutions):

Number of participants: Number of Teachers: Number of Schools/ Colleges:

Number of Parents:

Year Group(s): Were consent forms collected for this activity?

Yes / No

Outcomes (of the activity)

Recommendations

I mpact (on learners)

Commentary

The proformas allow HEIs to record a wide variety of information about their interventions such as activity type, category, funding stream, duration, location, target group and importantly the number of participants involved

MONITORING: CONSENT FORMSParental / Carer Consent Form Dear Parent/Carer, Your child/dependent may have the opportunity to take part in university visits, mentoring programmes, summer schools, subject tasters, revision classes and a whole range of other rewarding activities. To make sure these activities are useful and effective for young people, we need to gather certain information which we use purely for research purposes. We would be really grateful if you could take a few minutes to complete this consent form and return it to your child/dependent’s school.

The information collected on this form will be used for research purposes only.

Student Name: Date of Birth: D D M M Y Y Y Y

Year Group: Home Address:

Home Postcode: Sex: Female Male School / College:

Educational background of parents / carers Have any of your child/dependent’s parents or carers been to university or taken a degree? Yes No Don’t know Parental / carer occupation - we would like to know the following information for research purposes only:

What is the occupation of the highest earning parent/carer currently living in the household (please state)?

Student Ethnicity (please tick): Chinese Bangladeshi Indian Pakistani Other Asian Background

Black Caribbean Black African Other Black Background White White & Asian

White & Black African White & Black Caribbean Other Mixed Background Other Ethnic Background Prefer not to say

Student Disability (please tick): No known disability Dyslexia or other learning

need Blind/partially sighted

Deaf/hearing impaired Wheelchair user/mobility difficulty Mental health difficulty Unseen disability

Multiple disabilities Autistic Spectrum Disorder /

Asperger’s Syndrome Other disability Prefer not to say

Photography Universities in the East Midlands sometimes use photography for publicity purposes. We would like your permission to photograph your child/dependent for possible use in our publications, website and other publicity material. They may also be used by our partner organisations (noted above) with our permission. The image(s) will remain the property of the university providing the activity and will be used for the sole purpose of promoting similar activities. I agree* / do not agree* to my child/ dependent having their photograph taken (* please delete as appropriate)

Further Contact From time to time we may send information to you or your child/dependent that we feel is useful, including university/education information or more opportunities to take part in activities. We may also wish to make contact for further research purposes. I agree* / do not agree* to me or my child/ dependent being contacted by the partners mentioned above (* please delete as appropriate)

I f you do not give your consent for the information collected on this form to be used in the above mentioned research

Data Protection In order to ensure that our activities are effective and reaching the right people, we collect and analyse statistical information, including information about your child/dependent’s ethnicity and disability statement. The research is being undertaken in partnership with universities in the East Midlands, the Higher Education Funding Council for England (HEFCE), the Universities and Colleges Admissions Service (UCAS), the Higher Education Statistics Agency (HESA), Connexions and the school or college’s Local Authority. Any personal data we collect is confidential and will only be shared with the partners mentioned above and will not be used for any other purpose. Data will be processed in accordance with the Data Protection Act 1998. For more information, please see http://www.legislation.org.uk/ or call 01509 223462. PLEASE COMPLETE THE INFORMATION BELOW Name of parent / carer: Relationship to child / dependent: Signature of parent / carer: Date:

MONITORING: PARTICIPANT BIOGRAPHY

EVALUATION: REACH ACTIVITY AND PARTICIPANT DEMOGRAPHICS

Summary  No. Activities 111No. Participants 3806

Category No. Activities%age of Activities No. Participants

%age of Participants

Cat1 28 25.2% 2032 53.4%Cat2 83 74.8% 1774 46.6%Total 111 100.0% 3806 100.0%

Activity Type No. Activities %age of ActivitiesNo. Participants

%age of Participants

Academic Experience Day 2 1.8% 59 1.6%HE Experience 1 0.9% 59 1.6%HE Talks 6 5.4% 415 10.9%HE/University Experience Days 18 16.2% 871 22.9%IAG 80 72.1% 2272 59.7%Master Classes 2 1.8% 46 1.2%Taster Sessions 2 1.8% 84 2.2%Grand Total 111 100.0% 3806 100.0%

EVALUATION: REACH ACTIVITY AND PARTICIPANT DEMOGRAPHICS

Targeting Summary %age in target group Total No. ParticipantsIMD 56.9% 945NS-SEC 53.8% 625qYPR 51.3% 945qAHE 62.3% 945Parents/Carer HE 70.6% 892Total No. Participants in analysis n/a 985

2011/12 2012/13 2013/140.0%

10.0%20.0%30.0%40.0%50.0%60.0%70.0%80.0%

IMDNS-SECqYPRqAHEParents/Carer HE

There has been a decrease in the percentage of participants meeting various targeting criteria between the interim stage in 2012/13 and the interim stage in 2013/14.

EVALUATION: ATTAINMENT & PROGRESSION Predicted versus Actual

Establish links between talking part in outreach interventions and doing better than expected in key assessments

Progression to HE Link participant of outreach interventions to

applications, offers and acceptances at partner institutions

EVALUATION: SPECIFIC EVALUATIONS Activity Questionnaires

Activity Evaluation Questionnaire LET US KNOW WHAT YOU THINK!

We want you to help us make sure that our activities are a success. Please fi ll in this questionnaire to help us find out about the impact of our activities, and help us identif y areas we may need to improve. The questionnaire is totally confidential and we will not be asking for your name. Your views are important to us, so please be honest in your answers.

Are you: Female □ or Male □ Year Group:…………………………………………………………………

Name of School: ………………………………………………………………………………………………………………………………………………

Name of Activity: ………………………………………………………………………………………………………………………………………………

Date of Activity: ………………………………………………………………………………………………………………………………………………

1. Before attending this event, did you plan to study at university/higher education level in the future?

Yes No Don’t know

2a. Has the activity influenced your thoughts about studying at university/higher education level in the future?

Yes No Don’t know

2b. In what ways?

3a. Has the activity influenced your thoughts about studying at [insert HEI name] University?

Yes No Don’t know

3b. In what ways?

Please answer the following statements with your own opinions, by circling the number that best applies to your answer. 1 = Strongly Agree 2 = Agree 3 = Not sure 4 = Disagree 5 = Strongly Disagree

4. The activity has increased my understanding of university/higher education

1 2 3 4 5

5. The activity has increased my confidence about studying at university/higher education level

1 2 3 4 5

Please answer the following statements with your own opinions, by circling the number that best applies to your answer. 1 = Strongly Agree 2 = Agree 3 = Not sure 4 = Disagree 5 = Strongly Disagree

6. The activity has increased my understanding of [insert HEI name] University

1 2 3 4 5

7. I learned new things today in the following sessions that will help me in the future:

1 2 3 4 5

1 2 3 4 5

1 2 3 4 5

8. The activity has increased my interest in this area of study 1 2 3 4 5

9. The activity has motivated me to do well with my current studies 1 2 3 4 5

10. I would consider studying this subject area at university degree level

1 2 3 4 5

11. How do you think we could improve any future activities?

EVALUATION: SPECIFIC EVALUATIONS Bespoke Evaluations

In-depth analysis utilising multiple mixed methods approach to evaluation

Examples: Loughborough University’s Mentoring Scheme University of Leicester’s Students in Classrooms

Programme University of Leicester’s Summer School

Programme

CONCLUSION Correct identification of target school and

pupils within those schools is important

Collection of consent forms is crucial to monitoring and evaluation as it’s the way to establish links as to “what works”

Activity evaluations give an ‘immediate’ picture of the success of an event

ANY QUESTIONS?

CONTACT DETAILS

Emma ChurchWidening Participation Research & Evaluation CoordinatorT:  01509 223462E:  E.Church@lboro.ac.uk

Hazlerigg Building, Rm 201.0.18Loughborough UniversityLE11 3TU