west mifflin area school district an analysis of 4 sight and how it is used to inform instruction
DESCRIPTION
West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction. Dr. Bart Rocco, Assistant Superintendent Dr. Daniel Castagna, Principal, Homeville Elementary. Today’s Presentation. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/1.jpg)
Dr. Bart Rocco, Assistant Superintendent Dr. Daniel Castagna, Principal, Homeville Elementary
![Page 2: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/2.jpg)
Role of Central Office in Using Data to Make Informed Decisions to Improve Student Performance
Four Key Points to Process
A Quantitative Case Study Analysis of the 4 Sight Benchmark Assessment
Implications Questions/Answers
![Page 3: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/3.jpg)
3,400 Students 4 Elementary Schools,early Childhood
Center, Middle School, High School Pre-K- 12 Program 45% of Students Economically
Disadvantaged 40% Special Education Population AYP Status of Schools
![Page 4: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/4.jpg)
Two years ago no formalized benchmark assessments
Reviewed Benchmark Assessments Approved for Grants
Developed a Five-Year Plan
Classroom Excellence Initiative
Ed Insight Technology
Limitations/Needs Curriculum Alignment
Process
![Page 5: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/5.jpg)
Rearranged professional development time Act 80 2 hour delays Insisted on before school/after school grade
level, and department level meetings to address student data as a continuous process
10,000 hour rule – Outliers, Malcolm Gladwell
More time with students
![Page 6: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/6.jpg)
Review data and develop focused questions Look at specific student performance on
tests in math and reading Examine attendance Look at target populations What are root causes? Speak to previous year’s teachers about
student performance
![Page 7: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/7.jpg)
Staff’s need to examine best teaching practices
What is the best way to teach a concept in developing main idea or a specific math skill
Develop a toolbox of activities
Share Ideas with each other.
Replicate testing experience
![Page 8: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/8.jpg)
Principals need to allocate time for collaboration
Put data into the hands of teachers
Communicate to your staffs and support them in their needs
Be engaged in instruction and learning
![Page 9: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/9.jpg)
Curriculum Alignment to Standards Create a balance between improving test
scores and maintaining a culturally enriched curriculum
Don’t forget about what standardized tests cannot do for our students
Build trust with your administrators Work the vineyard
![Page 10: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/10.jpg)
Debbie Raubenstrauch
Jim Turner
Steve Biancaniello
On Hands School
![Page 11: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/11.jpg)
TierAssessment Purpose
Rate ofFeedback
Type of Feedback
Primary Target of Feedback
Comprehensive District Data
Plan
IIIAnnual large-scale – (PSSA TEST)
Infrequent
Frequent
General, broad
Specific,narrow
General accountability audience:PolicymakersCommunityAdministratorsOthers
II
Periodic grade level/subject area (4 Sight Tests)
AdministratorsTeachers
IOngoingclassroom
TeachersStudents
Why use the 4Sight tests???
![Page 12: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/12.jpg)
Source: taken from Pennsylvania and 4Sight, newsletter published by Success for All, October 2007.
![Page 13: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/13.jpg)
Are the predictions accurate? Is the money worth it? (over $10,000 annually)
Are we giving in to over-testing? Why are PVAAS projections lower than 4Sights?
Are the skills tested on the 4Sight correlated to those tested on the PSSA
![Page 14: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/14.jpg)
![Page 15: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/15.jpg)
Do the 4Sight exams accurately predict student’s raw scores on the PSSA exam?
Is there a high correlation between the predicted categorical classifications of students on the 4Sight tests when compared to actual PSSA Results?
Is the information gained from the fourth 4Sight test worth the loss of instructional time?
![Page 16: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/16.jpg)
Four Benchmark Tests were Administered: 4Sight Test #1 – September 11, 2007 4Sight Test #2 – November 22, 2007 4Sight Test #3 – January 12, 2008 4Sight Test #4 – April 14, 2008
PSSA Exams – April 1, 2, 3, 2008
West Mifflin Middle School Students in Grades 6, 7, and 8.
686 out of 731 qualified for the study (94% of total population).
![Page 17: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/17.jpg)
![Page 18: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/18.jpg)
Linear Regression with an (r) value. The independent variable- 4Sight Score (X) was used
to predict the dependent variable- PSSA score (Y) In the January/February 2008 Newsletter published
by the Success for All Foundation it was stated that, “The 4Sight correlations are determined by a statistical process called linear regression” (p 2).
Kappa Coefficient Formula. Measured the agreement between predicted
categorical classifications of students and actual PSSA categories.
![Page 19: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/19.jpg)
Linear Regression The (r) score can range from 0 to 1 with scores closer to 1
showing a stronger correlation and scores close to 0 showing a weaker correlation.
Kappa Coefficient Landis & Koch (1997) suggests the following kappa interpretation
scale: Below 0.00 - Poor 0.00-0.20 - Slight 0.21-0.40 - Fair
0.41-0.60 - Moderate 0.61-0.80 - Substantial
0.81-1.00 - Almost perfect
![Page 20: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/20.jpg)
Linear Regression R (Pearson Correlation) Values
Raw Scores Grade 6 Grade 7 Grade 8Total
Population
Third 4Sight Math/PSSA Math
0.817 0.829 0.846 0.831
Fourth 4Sight Math/PSSA Math
0.806 0.812 0.851 0.820
Third 4Sight Reading/PSSA 0.721 0.756 0.845 0.775
Fourth 4Sight Reading/PSSA 0.755 0.777 0.800 0.753
![Page 21: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/21.jpg)
Total School Population – Math
PSSA Math Category
Below Basic Basic Proficient Advanced
Third 4Sight Math Category
Below Basic 53 61 68 22
Basic 1 20 89 100
Proficient 0 1 36 155
Advanced 0 0 2 80
![Page 22: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/22.jpg)
Total School Population – Math
PSSA Math Category
Below Basic Basic Proficient Advanced
Fourth 4Sight Math Category
Below Basic 46 21 8 0
Basic 7 42 44 13
Proficient 1 19 113 128
Advanced 0 0 30 216
![Page 23: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/23.jpg)
Do the 4Sight exams accurately predict student’s raw scores on the PSSA exam?
Is there a high correlation between the predicted categorical classifications of students on the 4Sight tests when compared to actual PSSA Results?
Is the information gained from the fourth 4Sight test worth the loss of instructional time?
![Page 24: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/24.jpg)
![Page 25: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/25.jpg)
MATH
![Page 26: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/26.jpg)
1. All teachers were given a copy of updated anchors for Reading and Math.
2. Open ended items scored by teachers of the school.
3. Department meetings were held to review data and identify trends across students.
4. Item analysis breakdowns for each question (and corresponding anchor) were provided for all teachers.
![Page 27: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/27.jpg)
![Page 28: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/28.jpg)
Student Numbers/Operations Measurement Geometry Algebraic Concepts Data Analysis/Probability
1
2
3
4
5
6
7
8
9
10
6. Flexible groups were created within all subjects to highlight students with common areas of
concern.
Teacher________________________
Subject________________________
Period_________________________
![Page 29: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/29.jpg)
Assess strengths and weaknesses in light of the PA Reporting Categories and Academic Anchors
Develop strategies to address concerns at both class and individual student levels
Use this information to plan large group (across grade level).
TEST NARROWLY BUT TEACH BROADLEY
![Page 30: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/30.jpg)
With this degree of information, teachers can more easily embed these skills and knowledge in the larger curriculum.
SO…. Classroom curriculum is enhanced rather than narrowed!
We are not teaching to the test – We are teaching to the needs of our students!
![Page 31: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/31.jpg)
Practice run for the PSSA testing. Beneficial for both students and staff!
Students get use to the “testing room”. Scheduling issues were worked out (what do we do with
teachers who do not have homerooms?). We have enough pencils, paper and calculators!!! Students report that they were less nervous for the 2nd
round of the 4 Sight tests. Found/identified building level trends in open-ended
responses. Has opened communication between departments.
Created incentives for attendance and participation (grade level challenges!).
![Page 32: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/32.jpg)
Better use of Support Resources
EdInsight SoftwareSkills Tutor SoftwareStudy IslandPSSA Coaching Books
![Page 33: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/33.jpg)
2008 Final PSSA Results Including Sub-groups
PSSA Math 2007 2008 Net IncreaseAll Students 56.8 78.8 +22White 62.5 82 +19.5Black 32.6 64.7 +32.1IEP 26.9 38.5 +11.6Econ. 45.3 72.9 +27.6
PSSA 2007 2008 Net IncreaseAll Students 62.6 72.1 +9.5White 67.8 76.4 +8.6Black 40.7 54.4 +13.7IEP 21.3 34.1 +12.8Econ. 48.6 63.4 +14.8
![Page 34: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/34.jpg)
Investigate a longitudinal study that follows the use of the 4Sight test with a cohort of students over several years.
Identify a model of best practices to use when implementing 4Sight assessments.
Compare specific classroom interventions used in conjunction with benchmark assessment with student achievement growth.
![Page 35: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/35.jpg)
Expand this study to include all students in grades 3-8 and 11.
Narrow the focus of the study to a particular sub-group or groups.
Analyze specific skills assessed on the PSSA and compare them with skills tested on the 4Sight exam.
![Page 36: West Mifflin Area School District An Analysis of 4 Sight and How It Is Used to Inform Instruction](https://reader035.vdocument.in/reader035/viewer/2022062422/56812f69550346895d94f24b/html5/thumbnails/36.jpg)