pbs evaluation and preparing for swis
DESCRIPTION
PBS Evaluation and Preparing for SWIS. Robin Galloway, PhD RISE, ISU, Iowa Behavior Alliance – W063 Cell - 641-430-1508 [email protected] Ismail Sahin, PhD RISE, ISU, Iowa Behavior Alliance Office – W063 - 515-294-9035 [email protected]. PBS Evaluation. What data do we need? - PowerPoint PPT PresentationTRANSCRIPT
PBS Evaluation and Preparing for SWIS
Robin Galloway, PhD– RISE, ISU, – Iowa Behavior Alliance – W063– Cell - 641-430-1508– [email protected]
Ismail Sahin, PhD– RISE, ISU, – Iowa Behavior Alliance Office – W063 - 515-294-9035– [email protected]
PBS Evaluation
What data do we need? When do we need the data? Why do we need the data?
SET
SET Evaluators - 4-H Youth Extension Specialists, Marion, Robin, Keli, Lori
Spring - 2005 through 2007
ISU Robin/Ismail
ITBS/ITED - 1995/1996 - 2003-2004 Robin/Ismail Fall of 2005
ISU Robin/Ismail
ITBS/ITED - 2004-2005 - 2007-2008 Robin/Ismail
Fall of 2005 - Fall of 2008
ISU Robin/Ismail
IYS 99', 02' Robin/Ismail Fall of 2005ISU Robin/Ismail
IYS 05' Robin/Ismail Fall of 2006ISU Robin/Ismail
Data Collected by Iowa Behavior Alliance from Year 1 and 2 Sites
PBS Evaluation Measure Collected by Whom Date Data Collected Analysis
SWIS - Average Number of Office Referrals Robin/Ismail
Quarterly - 2004/2005 through 2007/2008
ISU Robin/Ismail
Average Daily Attendance Robin/Ismail
Quarterly - 2004/2005 through 2007/2008
ISU Robin/Ismail
Suspensions/Expulsions Robin/Ismail
Quarterly - 2004/2005 through 2007/2008
ISU Robin/Ismail
Data Collected by Iowa Behavior Alliance from Year 1 and 2 Sites
PBS Evaluation Measure Collected by Whom Date Data Collected Analysis
PBS Evaluation Measure for Year 1
and 2 SitesCollected by
WhomDate Data Collected Analysis
Team Checklist PBS Site Team
Quarterly - 2004/2005 through 2007/2008 school years - October 26th,2005, February1, 2006 and May 1, 2006
ISU Iowa Behavior Alliance Office - Robin/Ismail
Self-Assessment Survey PBS Site Team Annually – Spring
ISU Iowa Behavior Alliance Office - Robin/Ismail
Data that Sites are Responsible for Completing and Submitting
PBS Site Evaluation
Checklist Data: Year 1 Sites - NW
Team Checklists (NW Quadrant-1st Year)
0
10
20
30
40
50
60
70
80
90
100
2005-06Site 1
2005-06Site 2
Site 3 2005-06Site 4
Site 5 Site 6 2005-06Site 7
2005-06 2005-06Site 8
2005-06 2005-06 Site 9 Site 10
%
Fully Partially
Checklist Data: Year 2 Sites - NWTeam Checklists (NW Quadrant-2nd Year)
0
10
20
30
40
50
60
70
80
90
100
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2005-0
6
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2005-0
6
2005-0
6
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2005-0
6
2005-0
6
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2005-0
6
2005-0
6
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2005-0
6
2005-0
6
2004-0
5
2004-0
5
2004-0
5
2004-0
5
2005-0
6
2004-0
5
2004-0
5
2005-0
6
Site 1 Site 2 Site 3 Site 4 Site 5 Site 6 Site 7 Site 8
%
Fully Partially
Preparing for SWIS: Big Message #4
Traditional approaches to punishment and exclusion are ineffective when used alone.
Behavior support needs to occur at the “whole-school” level
Teaching is the most powerful behavior support strategy available
On-going use of information for decision-making is a key feature of successful school-wide discipline systems.
Why Collect Discipline Information?
Decision making Professional Accountability Decisions made with data (information) are more
likely to be (a) implemented, and (b) effective
Key features of data systems that work.
The data are accurate The data are very easy to collect (1% of staff time) Data are used for decision-making
– The data must be available when decisions need to be made (weekly?)
– Difference between data needs at a school building versus data needs for a district
– The people who collect the data must see the information used for decision-making.
What data to collect for decision-making?
USE WHAT YOU HAVE– Office Discipline Referrals/Detentions
Measure of overall environment. Referrals are affected by (a) student behavior, (b) staff behavior, (c) administrative context
An under-estimate of what is really happening Office Referrals per Day per Month
– Attendance– Suspensions/Expulsions– Vandalism
Office Discipline Referral Processes/Form
Coherent system in place to collect office discipline referral data
– Faculty and staff agree on categories– Faculty and staff agree on process– Office Discipline Referral Form includes needed
information Name, date, time Staff Problem Behavior, maintaining function Location
When Should Data be Collected?
Continuously Data collection should be an embedded part of the
school cycle not something “extra” Data should be summarized prior to meetings of
decision-makers (e.g. weekly) Data will be inaccurate and irrelevant unless the
people who collect and summarize it see the data used for decision-making.
Organizing Data for “Information”
Counts are good, but not always useful To compare across months use “average office
discipline referrals per day per month”
0
10
20
30
40
50
60
70
Refe
rrals
Aug Sept Oct Nov Dec Jan Feb Mar Apr May Jun
School Month
Total Ref versus Ref/Day/MoNV High School
0
1
2
3
4
5 M
ean R
efe
rrals
per
Day
Aug Sept Oct Nov Dec Jan Feb Mar Apr May Jun
School Month
Total Ref versus Ref/Day/Mo
Is there a problem?
Office Discipline Referrals Attendance/Tardies Achievement Faculty Reports Student reports
The BIG 5
How often
where what
when
who
Interpreting Office Referral Data:Is there a problem?
Absolute level (depending on size of school)– Middle Schools (>5 per day)– Elementary Schools (>1.5-2 per day)
Trends– Peaks before breaks?– Gradual increasing trend across year?
Compare levels to last year– Improvement?
0
0.5
1
1.5
2
Ave R
efe
rrals
per
Day
Sept Oct Nov Dec Jan Feb Mar Apr May Jun
School Months
Office Referrals per Day per MonthLast year
0
5
10
15
20
Ave R
efe
rrals
per
Day
Sept Oct Nov Dec Jan Feb Mar Apr May Jun
School Months
Office Referrals per Day per MonthLast year
0
5
10
15
20
Ave R
efe
rrals
per
Day
Sept Oct Nov Dec Jan Feb Mar Apr May Jun
School Months
Office Referrals per Day per MonthLast Year and This Year
0
5
10
15
20
Ave R
efe
rrals
per
Day
Sept Oct Nov Dec Jan Feb Mar Apr May Jun
School Months
Office Referrals per Day per MonthLast Year and This Year
What systems are problematic?
Referrals by problem behavior?– What problem behaviors are most common?
Referrals by location?– Are there specific problem locations?
Referrals by student?– Are there many students receiving referrals or only a small number
of students with many referrals?
Referrals by time of day?– Are there specific times when problems occur?
0
10
20
30
40
50
Num
ber
of R
efe
rrals
Lang Achol ArsonBombCombsDefianDisruptDressAgg/fgtTheftHarassProp D Skip Tardy Tobac Vand Weap
Types of Problem Behavior
Referrals per Prob Behavior
0
10
20
30
40
50
Num
ber
of R
efe
rrals
Lang Achol ArsonBombCombsDefianDisruptDressAgg/fgtTheftHarassProp D Skip Tardy Tobac Vand Weap
Types of Problem Behavior
Referrals per Prob Behavior
0
5
10
15
Num
ber
of R
efe
rrals
Lang Achol ArsonBombCombsDefianDisruptDressAgg/fgtTheftHarassProp D Skip Tardy Tobac Vand Weap
Types of Problem Behavior
Referrals per Prob Behavior
0
10
20
30
40
50
Num
ber
of O
ffic
e R
efe
rrals
Bath RBus A Bus Caf ClassComm Gym Hall Libr Play G Spec Other
School Locations
Referrals by Location
0
10
20
30
40
50
Num
ber
of O
ffic
e R
efe
rrals
Bath RBus A Bus Caf ClassComm Gym Hall Libr Play G Spec Other
School Locations
Referrals by Location
Referrals per Student
0
10
20
Num
ber
of R
efe
rrals
per
Stu
dent
Students
0
10
20
Num
ber
of R
efe
rrals
per
Stu
dent
Students
Students per Number of Referrals
0
5
10
15
20
25
30
Num
ber
of R
efe
rrals
7:00 7:30 8:00 8:30 9:00 9:30 10:0010:3011:00 11:3012:0012:30 1:00 1:30 2:00 2:30 3:00 3:30
Time of Day
Referrals by Time of Day
0
5
10
15
20
25
30
Num
ber
of R
efe
rrals
7:00 7:30 8:00 8:30 9:00 9:30 10:0010:3011:00 11:3012:0012:30 1:00 1:30 2:00 2:30 3:00 3:30
Time of Day
Referrals by Time of Day
SWIS Readiness Checklist
Your SWIS facilitator will meet with you
Complete your SWIS Readiness Checklist
SWIS facilitator will meet with 3-4 key personnel for an approximate 3 hour training
QUESTIONS?????
Robin Galloway – [email protected] Ismail Sahin - [email protected]
ISU Iowa Behavior Alliance Office
Lagomarcino – W063
Office Number - 515-294-9035