bps school climate surveys

BPS School Climate Surveys

SY 2012-2013

Office of Data and Accountability

Agenda

2

Welcome and Intros Activity: Your Vision for Family & Student Engagement School Climate Survey Overview School Level Data Review Wrap Up

Objectives

3

By the end of this session, you will be able to:1. Interpret school climate data

2. Use climate data to identify areas of strength and areas for improvement in school-wide engagement practices

3. Tap into OFSE supports for planning/implementing school-wide engagement practices

Your Vision for Family & Student Engagement in Your School

4

Write your vision for family & student engagement in your school on a note card (no more than 50 words)

Share your ideas with a partner.

Climate Surveys

5

What is school climate? No clear definition in research Encompasses experiences and atmosphere in

schools Why do we administer climate surveys?

Assess climate of our schools from constituents’ perspectives

Provide data to plan for improvement Provide a forum for parents, students, and teachers to

voice their opinions

Research shows school climate is important for student achievement

6

Based on a meta-analysis of research on factors that are related to academic achievement at the K-12 level, variables in four major categories demonstrate “direct empirical links”1

Student engagement Learning strategies School climate Social-familial influences

1Lee, Jihyun and Shute, Valerie J. (2010) ‘Personal and Social-Contextual Factors in K-12 Academic Performance: An Integrative Perspective on Student Learning’, Educational Psychologist, 45: 3, 185

School Climate

7

Academic emphasis “Expectations of schools for their students and positive reactions

from school community”2

Teacher variables “Collective efficacy, teacher empowerment, sense of affiliation”3

Principal leadership “Collegiality, setting high morale, and clearly conveying goals”4

2Lee, Jihyun and Shute, Valerie J. (2010) ‘Personal and Social-Contextual Factors in K-12 Academic Performance: An Integrative Perspective on Student Learning’, Educational Psychologist, 45: 3, 1873Ibid4Ibid

1Lee, Jihyun and Shute, Valerie J. (2010) ‘Personal and Social-Contextual Factors in K-12 Academic Performance: An Integrative Perspective on Student Learning’, Educational Psychologist, 45: 3, 185

History of Climate Surveys in BPS

8

In BPS, we began administering the climate surveys in Spring 2009

Today, the surveys are administered: Online for teachers, with follow-up email reminders (3) including

response rate updates to all teachers by school. Survey responses are anonymous.

On paper for students (grades 3 through 11). Beginning in 2012, seniors complete a separate Senior Exit Survey. Student responses to both surveys are linked to their BPS IDs so that results can be analyzed by demographic characteristics.

Online and paper for parents and guardians, in all 8 languages. Parents receive the initial survey through backpacks, followed by a reminder postcard mailed directly to the home; and a second copy of the survey also mailed directly to the home. Parent responses are anonymous and linked only to the school(s) their child attends.

Climate Surveys in BPS

9

2008-2009 2009-2010 2010-2011 2011-20120.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

13.5% 13.5%19.3%

23.6%

Parent climate survey response rates


10

2008-2009 2009-2010 2010-2011 2011-20120.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

53.3%57.5% 59.7%

78.8%

Student climate survey response rates


11

2008-2009 2009-2010 2010-2011 2011-20120.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

58.0%53.3% 55.4%

65.0%

Teacher climate survey response rates

Analysis of Climate Surveys

12

Factor analysis of all items to determine which items belong together in a component

Compute each component for individuals by averaging individual responses

Compute average component scores for whole district and for individual school by averaging all component scores in each group

Distribution of Data

13

District-wide report located on www.bostonpublicschools.org under “Reports” tab

Individual school results located on www.bostonpublicschools.org under individual school page

http://www.bostonpublicschools.org/

http://www.bostonpublicschools.org/

District Results: 2011-2012

14

Student Survey

Grade 313%

Grade 412%

Grade 512%

Grade 611%Grade 7

12%

Grade 811%

Grade 910%

Grade 109%

Grade 119%

Distribution of responses by grade levelN=28,883

*40 responses did not have a grade level.


15

Student Survey

*40 responses did not list a gender.

Distribution of responses by gender

Male51%

Female49%

Distribution of responses by genderN=28,883


16

Student Survey

*40 responses did not list a special education status.

Not students with disabilities81%

Students with disabilities19%

Distribution of responses by special education statusN=28,883


17

Student Survey

*40 responses did not list a lunch status.

Non Free or Reduced Price Lunch

27%

Free or Reduced Price Lunch73%

Distribution of responses by Free or Reduced Price Lunch Status

N=28,883


18

Student Survey

Free Lunch92%

Reduced Lunch8%

Distribution of responses for free or reduced price lunchN=21,227


19

Student Survey

Non LEPFLEP55%

LEPFLEP45%

Distribution of responses by limited English profi-cient (LEP) and formerly English proficient (FLEP)

status N=28,883

*40 responses did not list a LEP/FLEP status.


20

Student Survey

Identification with and overall perceptions of school (N=25442)

Student enthusiasm for learning (N=27135)

Teacher Effectiveness (N=26756)

Principal Effectiveness (N=27811)

Perception of school as a friendly environment (N=27059)

Feeling of acceptance at school (N=27038)

School Safety (N=27959)

1.00 1.50 2.00 2.50 3.00 3.50 4.00

2.98

3.36

3.27

3.11

3.11

3.19

3.30

District Average Values for Student Climate Survey Components

District Trends

21

Student Survey

Identifica

tion with

and ove

rall p

ercep

tions of sc

hool

Studen

t enth

usiasm

for le

arning

Teac

her Eff

ective

ness

Princip

al Eff

ective

ness

Percep

tion of school a

s a fri

endly

envir

onment

Feeli

ng of a

ccep

tance at

school

School S

afety

1.00

1.50

2.00

2.50

3.00

3.50

4.00

2.98

3.373.26 3.27

3.143.25 3.27

2.96

3.33 3.24 3.20 3.133.27 3.31

2.98

3.36 3.273.11 3.11 3.19

3.30

Student perceptions over time

2009-2010 2010-2011 2011-2012

Range of Responses: Student Survey 2011-2012

22

*District Average: 78.8%**See attached handout for individual school response rates

Lowest Median Highest0.0%

10.0%20.0%30.0%40.0%50.0%60.0%70.0%80.0%90.0%

100.0%

0.00%

90.0%

100.00%

Selected questions from Student Survey: 2011-2012

23

Strongly Disagree

Disagree

Agree

Strongly Agree

0 10 20 30 40 50 60 70 80 90 100

1.17

3.58

44.07

51.17

My teacher(s) works hard to help me learnN=28,566

% of student responses


24

Strongly Disagree

Disagree

Agree

Strongly Agree

0 10 20 30 40 50 60 70 80 90 100

0.98

2.95

37.85

58.22

My teacher(s) expects me to make good gradesN=28,450



25

Strongly Disagree

Disagree

Agree

Strongly Agree

0 10 20 30 40 50 60 70 80 90 100

1.71

7.23

51.22

39.84

My teacher(s) provides daily opportunities for students to contribute in class

N=28,275



26

Parent Survey

Perception of Principal Performance (N=11650)

Perception of Teacher Effectiveness/Performance (N=11527)

School Safety (N=9392)

Parent Engagement at Home (N=12017)

Parent Participation in School (N=12038)

Home-School Relations/Outreach Efforts by School (N=9858)

1.00 1.50 2.00 2.50 3.00 3.50 4.00

3.26

3.28

3.30

3.46

2.27

3.27

District Mean Values for Parent Climate Survey Components

District Trends

27

Parent Survey

Percep

tion of Prin

cipal P

erform

ance

Percep

tion of Tea

cher

Effec

tiveness

/ Perf

orman

ce

School S

afety

Parent E

ngage

ment a

t Home

Parent P

articip

ation in

School

Home-School R

elations/

Outreac

h Efforts

by Sch

ool1.00

1.50

2.00

2.50

3.00

3.50

4.00

3.27 3.23 3.323.46

2.29

3.293.28 3.28 3.323.46

2.28

3.273.26 3.28 3.303.46

2.27

3.27

Parent perceptions over time

2009-2010 2010-2011 2011-2012

Range of Responses: Parent Survey 2011-2012

28



10.0%20.0%30.0%40.0%50.0%60.0%70.0%80.0%90.0%

100.0%

2.9%

22.9%

72.9%

Selected questions from Parent Survey: 2011-2012

29

Strongly Disagree

Disagree

Agree

Strongly Agree

0 10 20 30 40 50 60 70 80 90 100

1.95

3.82

44.06

50.17

My child's school is a good place for my child to learnN=13,167

% of parent responses


30

Strongly Disagree

Disagree

Agree

Strongly Agree

0 10 20 30 40 50 60 70 80 90 100

2.44

6.47

47.74

43.35

My child's teacher(s) challenges him/her to do their best and works hard to meet the needs of my child

N=13,127



31

Strongly Disagree

Disagree

Agree

Strongly Agree

0 10 20 30 40 50 60 70 80 90 100

3.66

6.99

52.91

36.45

My child's school is doing a good job at preventing bullying and harassment based on race, gender, sexual preference, and dis-

abilitiesN=11,787


District Trends: 2011-2012

32

Teacher Survey

School Leadership (N=2440)

Teacher Influence over Classroom Decision Making (N=2688)

Collegial Work Environment (N=2688)

Collective Teacher Efficacy (N=2443)

Self-Efficacy for Instructional Strategies (N=2697)

Self-Efficacy for Classroom Management (N=2646)

Parent & Student Engagement (N=2544)

Relationships with Students and Parents (N=2728)

1.00 1.50 2.00 2.50 3.00 3.50 4.00

3.00

3.04

3.17

3.19

3.55

3.28

2.52

3.21

District Mean Values for Teacher Climate Survey Components

District Trends

33

Teacher Survey

School L

eadersh

ip

Teac

her Influen

ce ove

r Clas

sroom Dec

ision M

aking

Collegia

l Work

Envir

onment

Collective

Teac

her Effi

cacy

Self-E

fficacy f

or Instr

uctional Str

ategie

s

Self-E

fficacy f

or Clas

sroom M

anage

ment

Parent &

Studen

t Enga

gemen

t

Relationsh

ips with

Studen

ts an

d Parents

1.00

1.50

2.00

2.50

3.00

3.50

4.00

3.112.89

3.15 3.24

3.58

3.28

2.48

3.182.97 2.98

3.13 3.19

3.58

3.31

2.49

3.223.00 3.04

3.17 3.19

3.55

3.28

2.52

3.21

Teacher perceptions over time

2009-2010 2010-2011 2011-2012

Range of Responses: Teacher Survey 2011-2012

34



10.0%20.0%30.0%40.0%50.0%60.0%70.0%80.0%90.0%

100.0%

16.7%

66.7%

100.0%

Selected questions from Teacher Survey: 2011-2012

35

Discipline problems

Low expectations

Parents don't monitor or assist with student work

Poor instruction at previous school

Student expectations vary from teacher to teacher

Students' ability to learn

Teachers' lack of skills

Lack of resources

Students' home background

Unmotivated students

0.00 10.00 20.00 30.00 40.00 50.00 60.00 70.00 80.00 90.00 100.00

14.51

2.08

11.14

8.22

10.42

4.74

1.55

9.97

20.20

17.17

What do you think is the most important reason for why your school's results on the recent MCAS were not higher

N=2,639

% of teacher responses

Selected questions from Teacher Survey: 2011-2012

36

Family support

Family income

Intrinsic motivation of students

Quality of life in students' community

Teachers' knowledge of instructional practice

Academically challenging lessons

Classroom lessons requiring students to play an active role

Clear and regular feedback to students about performance

School and classroom discipline

0.00 10.00 20.00 30.00 40.00 50.00 60.00 70.00 80.00 90.00 100.00

26.12

0.80

16.50

7.07

9.18

3.93

16.87

8.27

11.26

What do you think is the most important factor influencing how much students learn in school

N=2,745

% of teacher responses

Parent and Student Engagement Questions: Teacher Survey2011-2012

37

Parent and Student Engagement Questions

Your students come to school ready to learn

The parents of most of your students are active in the schools parent organization

At this school, most students show respect for kids who get good grades

Most of your students parents or guardians talk with you about their childs grades

Students are willing to put in the work it takes to get good grades

Most parents encourage you to maintain high standards

Students try hard to improve on previous work

Parents advocate for school improvement at this school

Parents of your students help check their childs homework

You feel respected by your students

You feel respected by your students parents

.00 .50 1.00 1.50 2.00 2.50 3.00 3.50 4.00

2.742.02

2.952.52

2.64

2.802.73

2.482.30

3.233.19

Parent and Student Engagement Questions for Teachers

OFSE Capacity Building Supports

38

Data Review & Planning

Core Element Implementation

Professional Development and Parent U

Coaching & Facilitation

OFSE Supports

bps school climate surveys

Documents

school climate surveyssy

analysis of climate

history of climate surveys

student learning

student responses

student achievement

academic performance

survey responses