implementing progress monitoring pennsylvania's statewide approach pennsylvania partnership for...
TRANSCRIPT
![Page 1: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/1.jpg)
Implementing Progress Monitoring
Pennsylvania's Statewide Approach
Pennsylvania Partnership for Professional DevelopmentPennsylvania Training and Technical Assistance NetworkPennsylvania Department of Education
![Page 2: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/2.jpg)
2
Session Goal
Provide an overview of Pennsylvania’s statewide progress monitoring initiative including: The Approach
Background and Getting Started: The PilotThe Design
General Outcomes and Specific Skills The Training PlanOutcomes
Challenges and Lessons Learned
![Page 3: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/3.jpg)
3
PA: Who We Are!
Pennsylvania Department of Education Bureau of Special Education
State Implementation Grant (SIG) Recipient
PATTAN East, Central and West
Intermediate Units School Districts
Pennsylvania Partnership for Professional DevelopmentPennsylvania Training and Technical Assistance NetworkPennsylvania Department of Education
![Page 4: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/4.jpg)
4
Monitoring Student Progress:
A Quick DetourAssessing Prior Knowledge
![Page 5: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/5.jpg)
5
What is Progress What is Progress Monitoring?Monitoring?
Progress Monitoring is the ongoing process which involves:
Collecting and analyzing data to determine student progress toward specific skills or general outcomes.
Making instructional decisions based on the review and analysis of student data.
![Page 6: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/6.jpg)
Progress Monitoring CycleInitial Assessment: •Direct Intervention
•Historical Data
•Standardized Assessments
•Diagnostic Assessment
•Curriculum-Based Assessment
•Parent Input
Design Instruction:• Develop Goals & Objectives
• Identify SDI
• Alignment to General Curriculum
• Instructional Grouping & Scheduling
• Identify Progress Monitoring
Deliver Instruction:•Deliver Instruction According to Goals & Objectives Using SDI
•Collect Data on Progress
•Monitor Student Response & Feedback
Ongoing Evaluation: •Evaluate Effectiveness of Instruction by Monitoring Progress
•Record and Use Data to Assess Progress & Make Decisions
•Adjust Goals & Objectives
•Adjust SDI & Instruction As Needed
•Report to Parents
![Page 7: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/7.jpg)
7
The Goals of Progress Monitoring
Provide data to assist in making decisions about students To guide instructional decisions
Provide data on student performance To determine current level of
learning/behavior/performance To measure and report progress toward goals
Provide data for the reevaluation process To determine if the student still meets eligibility for
special education AND still needs specially-designed instruction
![Page 8: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/8.jpg)
8
Benefits of Progress Monitoring
Parents and students know what is expected
Teachers have organized record of students’ performance
Teachers know what is working or not working with their instruction based on data
“Easy to Understand” way to show parents the progress
IEP teams have comprehensive data on student performance for decision making
![Page 9: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/9.jpg)
9
Essential Elements of Progress Monitoring
Measurable goals/outcomes
Sensitive to increments of student growth
Data driven
Efficient and effective for use in the classroom
Usable format
Connected with general ed. curriculum/appropriate activities
![Page 10: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/10.jpg)
Progress Monitoring in Pennsylvania
A SIG Initiative
![Page 11: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/11.jpg)
11
A Two-Prong Approach
Appropriate for all students, including learning support and at-risk students, working in the general education curriculum (reading and math)
The goals and objectives are based in the general education curriculum
Appropriate for all students with IEPs, particularly those with significant disabilities
The goals and objectives are referenced to the general education curriculum
General Outcomes Specific Skills
![Page 12: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/12.jpg)
12
Assessment (A balance between outcomes-based measurement and specific skills assessments)
Specific Skills Outcomes-based
Representative
Efficient
![Page 13: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/13.jpg)
13
They are simple, accuratesimple, accurate, and reasonably inexpensiveinexpensive in terms of time and materials. They are considered so importantimportant to doing business well that they are routineroutine.. They are collectedcollected on an ongoingongoing and and frequent basisfrequent basis. . They shape/inform a variety of important decisionsimportant decisions..
![Page 14: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/14.jpg)
14
Models of CBA:General Outcome Measurement
Standardized, Reliable, & Valid
Index growth in general curriculum over time and across a wide range of skills
May or may not be measuring directly the curriculum of instruction
Do suggest when instructional modifications are needed
Do not specifically suggest instructional modification
![Page 15: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/15.jpg)
15
PA’s Seven Step Process to Progress
Monitoring Monitoring: General
Outcomes and Specific Skills
1. Measurable Annual Goals and Objectives
2. Data Collection Decisions
3. Data Collection Tools & Schedule
4. Representing the Data
5. Evaluation of Data
6. Instructional Adjustments
7. Communicating Progress
![Page 16: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/16.jpg)
16
History of PM in Pennsylvania
The Pilots Original mini-pilot in spring, 2002 Statewide pilot, 2002 -2003
Level I: Statewide Training and Implementation in 2003 -2004
Level II Statewide Training and Data Collection in 2004 – 2005
Two year follow-Up of original 14 districts in statewide pilot in spring 2005
Special Projects Reading Fluency (Hagar) Algebra (Foegan) Writing (Edwards-Santoro) Specific Skills (Shapiro)
![Page 17: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/17.jpg)
Statewide Pilot 2002-2003:
Lessons from the Field
![Page 18: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/18.jpg)
18
Purpose of Pilot
Conduct a training project on the use of an outcomes based measurement approach to monitor student progress in reading and math
Discuss the use of data-based decision-making How can the analysis of student data improve educational
results? How can the analysis of student data suggest changes in
instructional grouping, instructional strategies, motivation systems, etc.?
![Page 19: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/19.jpg)
19
Participants and Target Areas
14 school districts and 71 teachers
Special education teachers assigned to learning support or emotional support, grades 1 through 5
Site coordinators in each district facilitated the implementation of the project
PaTTAN consultants
University consultants
Each teacher monitored at least two students in oral reading fluency and math skills
Selected measures were quick and easy to administer
![Page 20: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/20.jpg)
20
Materials for Monitoring
Reading All teachers used the
passages created and developed by the AIMSweb product
Passages were written and developed with readability specifically for the various grade levels
Students were assessed at levels indicated by teachers as providing reasonable challenge given current instructional level
Math All teachers used the
Monitoring Basic Skills Progress (MBSP), basic math computation and application blackline masters
Students were assessed at levels indicated by teachers as providing reasonable challenge given current instructional level
![Page 21: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/21.jpg)
21
Frequency of Monitoring
Reading: Monitored 2xweek, with at least one day between assessments
Math: Monitored 1xweek, with computation monitored one week and applications the next
![Page 22: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/22.jpg)
22
Training and Support
We taught teachers to: Collect data Graph data Display aim line or
goal line Display trend line or
inspect visually Use decision rules to
inform instruction
Training was provided via:
Large and small groups at regional PaTTAN facilities
On-site visits and individual feedback meetings
Whole group final follow-up session
![Page 23: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/23.jpg)
23
PM Implementation
Teachers implemented progress monitoring Nov. through May
Teachers graphed both reading and math data
School district site coordinators facilitated communication between participating teachers and PaTTAN consultants
PaTTAN consultants served as facilitators between site coordinators and University consultants
![Page 24: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/24.jpg)
24
Statewide Pilot Outcomes
PM was feasible for most teachers
Teachers learned to collect and analyze data
Some instructional arrangements presented PM challenges (full inclusion models)
Additional training was needed on using data for instructional decision making
Teachers found innovative ways to use the data (feedback to parents, IEP incorporation)
![Page 25: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/25.jpg)
25
Results of Pilot
All skills showed changes in desired direction during the course of the pilot
Substantial improvements in many skills
Confidence in the data increased in all areas
Strongest teacher confidence in oral reading fluency and computation data
Perceived importance of progress monitoring stronger after the pilot
![Page 26: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/26.jpg)
Table 1.Summary of TeacherSelf-Reported
Prior to Project As of March 2003
OVERALL-Previous Experience w/Progress Monitoring
2.90 4.06
OVERALL –Confidence in Using Data
3.41 4.07
Reading 3.19 3.92
Math Computation 3.39 4.01
Math Concepts 3.08 3.62
OVERALL-Importance of Progress Monitoring
3.88 4.73
![Page 27: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/27.jpg)
27
Lessons Learned
Data collection was deemed “doable” by teachers
Kids enjoyed participating
More kids wanted to be involved
More Professional Development needed for teachers and OTHERS
Consider structural aspects of special education Instruction in inclusive
settings Time allocated for
reading/math instruction
Juggling groups
![Page 28: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/28.jpg)
28
Challenges
Some computer problems Hand graphing
Difficulty extending aimline Need to indicate interventions
Time: How to fit in progress monitoring? Better use of instructional assistants Students do own graphing
![Page 29: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/29.jpg)
29
“It’s not an issue of losing time because progress monitoring helps make my instructional time more effective. Monitoring student progress optimizes my teaching because it makes it better.” Pilot Project Teacher
Most Frequently Asked Question: How LONG does progress monitoring take?
![Page 30: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/30.jpg)
Level I: 2003-04Statewide Training
and Implementation
![Page 31: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/31.jpg)
31
Project Decisions:
Mirrored Pilot Parameters Data Collection Decisions: Targets
Oral Reading Fluency - 2wcpm/wk Math Computation and Concepts/Application - 1
dcpm/wk.
Data Tools and Schedules 2x/wk reading, 1x/wk math.
Data Representation Graphed via hand or electronic tool
Decision Rule - 4 of 6 data points
![Page 32: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/32.jpg)
32
Roles and Responsibilities
TeachersSite coordinatorsIU CSPD consultantsPaTTAN consultantsUniversity consultants
![Page 33: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/33.jpg)
33
Teachers
Attend all scheduled trainings Participate in on-site team visitations led
by IU CSPD and PaTTAN consultants Implement progress monitoring by:
Administering appropriate data collection tools
Collecting, graphing and analyzing data Making instructional adjustments as
appropriate Communicating progress
![Page 34: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/34.jpg)
34
Teachers: Data Collection Expectations
Choose at least 2 special education students
Using the IEP, select an approach to monitor these students’ progress toward general outcomes or specific skills
![Page 35: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/35.jpg)
35
Teachers: Data Collection Expectations
Establish a baseline for each student based on the present levels of educational progress or baseline assessments on the skill
Based on a student’s expected rate of progress, establish an aim line (goal) for each student
![Page 36: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/36.jpg)
36
Teachers: Data Collection Expectations
Collect data on an ongoing basis according to the schedule you have established for progress monitoring
Each teacher should have collected a MINIMUM of 6 data points on each student prior to the Day 3 training in Oct/Nov 2003
Create a folder for each student whose progress you will be monitoring
![Page 37: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/37.jpg)
37
Teacher Expectations
Set annual goals and objectives Determine baseline Determine target Map aimline Monitor frequently using decision rule Implement and monitor instructional
change when decision rule is broached
![Page 38: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/38.jpg)
5th grader, baseline 60wcpm in 2nd grade text, goal 100wcpm in 3rd grade text
Reading
0
10
20
30
40
50
60
70
80
90
100
110
120
130
140
150
BL 1 2 3 4 5 6 7 8 9 10 11 12 13 14 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40
Weeks
WC
PM
BL Goal Line WCPM Errors/M Trendline (WCPM)
Wait: 3 of 4 data points below aimline
Wait: Data parallel to and hovering around aimline
Make a change? All data points are above the aimline. If so, what?
Robin's ORF Data
![Page 39: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/39.jpg)
39
Site Coordinators
Attend pre-training and all subsequent trainings with the district team
Participate in on-site visits led by PaTTAN and IU CSPD consultants
Act as a liaison between the district and team and PaTTAN/IU consultants
![Page 40: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/40.jpg)
40
Site Coordinators
Support team in implementing progress monitoring
Facilitate professional development efforts in progress monitoring with other special education teachers in the district
Meet with other administrators in to move progress monitoring forward in the district
![Page 41: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/41.jpg)
41
IU CSPD/PaTTAN Consultants
Attend all series trainings
Lead on-site visitations with district teams
Provide on-going on-site technical assistance and support as needed by district teams
Review district team action plans
Review data collected by districts
![Page 42: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/42.jpg)
42
University Consultants
Provide direction related to formal training content
Provide technical assistance and support related to on-site visits
Develop Frequently Asked Questions/Answers
Develop a process for collecting student data
![Page 43: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/43.jpg)
43
Level I: PM Training
Training Focus Progress Monitoring in Special
Education Focus Areas
Key Principles of Progress Monitoring District Action Planning On-Site Visits Progress Monitoring Updates to Staff
![Page 44: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/44.jpg)
44
PM Outcomes: 2003 -2004
2,690 special education students Approximately 300 districts, 29 IU’s trained LD = 1745; SED = 271; MR = 244 1967 = GOM ; 211 = SS; 166 = Behavior; 346 =
undetermined 1395 = reading; 489 = math computation 50.8% weekly collection; 31.8% 2x/week FOR LD: 728 Reading, 230 Math
![Page 45: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/45.jpg)
45
QuestionsReading and Math Computation
Average rate of gain across instructional grade levels?
Average rate of gain across DIFFERENCES between enrolled and instructional grade levels?
![Page 46: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/46.jpg)
Comparison of PA PM to Fuchs Study in Reading-Instructional Level
Grade Fuchs Study All Students LD
1 n/a .90 .85
2 1.5 1.04 1.10
3 1.0 1.08 1.06
4 0.85 1.29 1.19
5 0.5 .93 .91
6 0.3 1.24 1.22
![Page 47: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/47.jpg)
Comparison of PA PM to Fuchs Study in Math Computation-Instructional Level
Grade Fuchs Study All Students LD
1 n/a .17 .18
2 0.3 .40 .56
3 0.3 .32 .35
4 0.70 .52 .56
5 0.70 .21 .25
6 0.45 .47 .58
![Page 48: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/48.jpg)
Grade Minus Instructional Level - Reading
1.76
1.28
1.14
0.961.02
0.8
1.22
1.09 1.09
0.36
1.85
0
0.2
0.4
0.6
0.8
1
1.2
1.4
1.6
1.8
2
-1 Grade Level 1 2 3 4 5 6 7 8 9
Diff Enrolled - Instr Level
Wo
rds P
er
Week
![Page 49: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/49.jpg)
Grade Minus Instructional Level - Math
0.55
0.370.34
0.43
0.77
0.85
0.61
0.16
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
Grade Level 1 2 3 4 5 6 7
Diff Enrolled - Instrc Level
Dig
its C
or
Per
Min
![Page 50: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/50.jpg)
50
Conclusions: 2003-2004
1. PM, especially GOM, reflect gains in student performance in reading and math computation
2. Teachers were able to conduct PM on student for entire year
3. PM should be widely adopted as method to reflect basic performance in reading and math
4. Established realistic goals for students with LD
5. Data collected 3 points in time can be used to reflect year long outcomes
![Page 51: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/51.jpg)
51
2003-2004 Lessons Learned
1. Establish the data collection process at the start of the training year
2. Keep the data collection form simple
3. Focus data collection on GOM progress monitoring only
4. Enhance quality of training
![Page 52: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/52.jpg)
52
Lessons Learned and Adjustments Made (cont.)
5. Frequency of collection can be reduced to weekly IF decision rules are also adjusted.
6. Teachers assessing fluency often do not view it as an outcome but as a skill.
7. Teachers are reluctant to increase instructional level when a student is doing well.
8. Savvy administrators use progress monitoring data to inform supervisory and programmatic decisions.
![Page 53: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/53.jpg)
Level II: 2004-2005Statewide PM Training and
Implementation
![Page 54: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/54.jpg)
54
Training Focus
Using Data to Drive Instructional Interventions
Content Area Intervention Reading Math Behavior
Low-Incidence Disabilities
![Page 55: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/55.jpg)
55
Reading: Moving Beyond the Data
Intervention s in Reading content Areas Language Development Fluency Vocabulary Comprehension
Onsite guided practice
![Page 56: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/56.jpg)
56
Math Training
Math: Progress Monitoring in Math
Additional training in math content areas Math FluencyCalculationProblem Solving
Onsite Guided Practice
![Page 57: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/57.jpg)
57
Behavior Training
Antecedent and Consequence Strategies that Promote Individual and Group Behavior Change
Making Data-Based Decisions – Analyzing the Efficacy of Interventions
Prevention of Behavior Problems via Effective Classroom Management and Instruction
![Page 58: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/58.jpg)
58
Low Incidence Disability Populations
Effective instruction and research-based interventions for school-age students and early learners
Onsite Guided Practice
![Page 59: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/59.jpg)
Comparison of PA PM to Fuchs Study in Reading-Instructional Level
Grade Fuchs StudyReg Ed
All SpED Students
2004 –2005
LD2004 2005
All SpED Students2003 –2004
LD2003 –
2004
1 2.01.07 1.15 1.02 .85
2 1.51.18 1.18 1.40 1.10
3 1.01.08 1.09 .88 1.06
4 0.851.19 1.23 1.08 1.19
5 0.51.07 1.07 1.06 .91
6 0.31.17 1.27 1.07 1.22
![Page 60: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/60.jpg)
Comparison of PA PM to Fuchs Study in Computation-Instructional Level
Grade Fuchs StudyReg Ed
PDE Benchmarks
All SpED Students
2004 -2005
LD
2004 2005
All SpEd Students
2003-2004
LD2003 - 2004
1 n/a .3 .29 .27 .17 .18
2 0.3 .3 .31 .32 .40 .56
3 0.3 .3 .35 .33 .32 .35
4 0.70 .45 .26 .27 .52 .56
5 0.70 .45 .19 .20 .21 .25
6 0.45.19 .22 .47 .58
![Page 61: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/61.jpg)
Two Year Follow-up on Statewide Pilot
2005-2006
![Page 62: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/62.jpg)
62
Pilot Follow-up
13 of 14 original pilot districts visited Personal interviews with
Administrators Teachers (original) Teachers (newly trained.
Review of student data Original students Present students
![Page 63: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/63.jpg)
63
Status of PM in Pilot Districts
5 of the 13 are using progress monitoring as designed
2 maintained it in modified form
2 districts report use by a few teachers
4 districts have no concerted progress monitoring program.
![Page 64: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/64.jpg)
64
Lessons Learned
Successful Implementation of Progress Monitoring Requires Administrative mandate-’This is the way we do
business here.’
Administrative Support-’However, we will provide all the training, support, time, and materials required for success.’
Time-Teachers require two years to realize the benefits and efficiency of progress monitoring
![Page 65: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/65.jpg)
65
Pilot District Ongoing Needs:
Additional training in the use of progress monitoring to guide instruction.
Training in the use of progress monitoring in full-inclusion schools.
Additional training in general outcome vs. specific skill monitoring. (Teachers continue to view ORF as a skill measure not a reading health measure.)
![Page 66: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/66.jpg)
Progress Monitoring Efforts: 2004- 2005
Intermediate Units
![Page 67: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/67.jpg)
67
Progress Monitoring Expansion, 12/05
29 of 29 Intermediate Units Responded to a progress monitoring survey.
These IUs serve 501 LEAs
433 of PA’s 501 LEAs (86%) have received Level I Progress Monitoring Training.
![Page 68: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/68.jpg)
68
PM Expansion
201 of the 433 (46%) trained LEAs provided turn-around training.
377 progress monitoring events were provided thus far in the 05-06 school year.
162 events are planned for the remainder of the year.
![Page 69: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/69.jpg)
Training Format
Trained as District Teams 58%
Trained as School Teams 11%
Trained as Individual Teachers 31%
![Page 70: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/70.jpg)
Implementation11% Status not Reported
12% Trained LEAs have not Implemented (53)
31% Trained LEAs Implementing in all District Special Education Classes
(1398)
46% Trained LEAs implementing in Individual Buildings or Classes (203)
![Page 71: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/71.jpg)
71
Special PM Projects in PA
Reading Fluency Automated progress
monitoring system to allow students to record reading passages for automatic scoring
Algebra Research effort to
measure effectiveness of algebra probes
Writing Research effort to
generate information on the connection of various pm formats and writing instruction
Specific Skills Analysis of data and use
of data in PA’s Schools for the Blind to better define pm with low incidence populations
![Page 72: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/72.jpg)
72
Final Comments
Confidence in PM as a valuable tool for monitoring student progress in special education
Evidence of accountability: Administrative commitment is vital
Evidence of growth for students in special ed (LD in particular)*
Replication and strengthening of research findings over years
Direct implications of research-to-practice
![Page 73: Implementing Progress Monitoring Pennsylvania's Statewide Approach Pennsylvania Partnership for Professional Development Pennsylvania Training and Technical](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d895503460f94a6ef09/html5/thumbnails/73.jpg)
73
Quotable Quotes
‘I had no idea how many instructional decisions I make every day, I need a nap.’
‘We want to participate in your data gathering effort. Progress monitoring has been very valuable to all our staff.’
‘It saves so much time. My IEPs are done!’
‘I know who is doing what and how well. (administrator on his staff)
“Students love charting their progress and beating their scores!”