![Page 1: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/1.jpg)
Curriculum Based Measuresvs. Formal Assessment
Curriculum Based Measuresvs. Formal Assessment
What does it mean to me?
Why bother?
![Page 2: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/2.jpg)
Goals for this class
• General Principles:• Compare CRT, CBA, CBM, Formal tests• Understand why & how we use CBM?• Understanding Formal Assessment for achievement
• Specific to your own project• What CBM measures would you give & why
![Page 3: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/3.jpg)
CBA vs. CBM
• CBA=instructional tool based upon assessment of curricular information. (Glickling & Havertape, 1981)
• Test items taken from curriculum• Repeated measurement over time• Use of information for instruction
• Validated approach but less so than CBM.• CBA measures mastery and CBM measures
general outcome over time (Hosp & Hosp, 2003)
![Page 4: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/4.jpg)
Why CBA is not used?
• Perception of difficulty
• Time demands
• Efficacy with CBA
• State or district guidelines & performance objectives
![Page 5: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/5.jpg)
CBM
• Assess student’s academic growth repeatedly over time
• Provide strategies to support student’s needs
• Ascertain the need for additional diagnostic testing (Howell & Nolet, 1999).
• Evaluate and improve instructional efficacy (Deno, 1985).
• Progress monitoring not mastery achievement (Fuchs, 2006).
![Page 6: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/6.jpg)
CBM & RTI
• CBM provides us with the tools for monitoring and enhancing student growth and reflecting and changing our instructional practices.
• CBM also provides us with information in the area of diagnostic evaluation.
• To identify non-responders we have to show a discrepancy in performance and growth between student and peers.
![Page 7: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/7.jpg)
Assessment as Problem-Solving
What characterizes effective problem solving?
Generating as many alternative solutions as possible and
Testing ideas in a systematic mannerIEP is used for problem solving
![Page 8: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/8.jpg)
Problem-Solving Process
• Problem identification• Observing & recording student performance
• Problem definition• Describing the difference between actual & expected
performance
• Exploring alternative solutions• Goal setting, program planning
• Implement & evaluating solutions • Progress monitoring
• Problem solution
![Page 9: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/9.jpg)
Back to Joshua
• Problem identification
• Possible solutions
• Plan of action
![Page 10: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/10.jpg)
Need for CR-CBA-CBM
• Lack of focus
• Teachers & students are uncertain about what the key indicators of growth in basic skills are.
• Current focus is on standards and PACT• Problems with commercial achievement tests
• Failure to describe growth• Reliance on face validity• Small sample, relationship to curriculum
• Why CBM and not CRT or CBA?
![Page 11: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/11.jpg)
Curriculum-Based Measurement-Big Picture-
• CBM is a general outcome indicator that measures “vital signs” of student achievement in areas of literacy or basic skills
• CBMs function as “academic thermometers” designed to monitor student’s growth in literacy or basic skills
• It is an efficient and accurate way of assessing the effects of our instruction during the course of instruction (formative evaluation vs. summative evaluation)
![Page 12: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/12.jpg)
Curriculum-Based Measurement-Details-
• CBM is sensitive to difference among individuals and within individuals
• Sensitive to the short-term effects of instruction• Characteristics
• Indicator of student academic progress
• Direct & Repeated measurement
• Time-series graphic displays
• Individually-referenced & goal referenced
• Data decision rules
• Aimlines & trendlines
![Page 13: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/13.jpg)
What is Measured?
• Reading √ Words read aloud
• Written Expression √ Words written in response to a story starter
• Spelling √ Words spelled from dictation
• Math √ Math problems completed correctly
NOTE: see handout on details
![Page 14: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/14.jpg)
How Do We Measure?
• Use a task of constant difficultyWhen level remains constant we can see changes in
student performance
• Choose task from same pool of material
• CBM describes changes in performance on a specific level
![Page 15: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/15.jpg)
Procedures for Graphing
• Collect baseline performance• Set goals• Continually chart student progress• Summarize data
• Aimlines• Trend lines
![Page 16: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/16.jpg)
Data Interpretation
• Use data to monitor student progress
• Goal-oriented analysis
• Interpret data to determine instructional changes
√ Deciding when to change
![Page 17: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/17.jpg)
Deciding what to change
• Program adjustments must be introduced and maintained for a period of time
• Choose substantial changes• Clearly specify the changes
![Page 18: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/18.jpg)
Problem Identification
• A problem is defined as a difference between what is expected in the general education curriculum and how the student performs.
• If the discrepancy is large enough, formal assessment is warranted.
![Page 19: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/19.jpg)
![Page 20: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/20.jpg)
Problem Certification
• How severe is the problem?• Is the problem so severe that it is
unlikely to be addressed successfully in the regular education curriculum?
• What resources may be necessary to resolve the problem?
![Page 21: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/21.jpg)
![Page 22: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/22.jpg)
![Page 23: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/23.jpg)
Exploring Solutions
• What are the goals of intervention?
• What is the content of the intervention?
• What is the process of the intervention?
![Page 24: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/24.jpg)
Evaluating Solutions
• Is the intervention successful
• Is the student attaining the established goals?
• If not, does the intervention need modification or is the student in need of a different intervention?
![Page 25: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/25.jpg)
![Page 26: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/26.jpg)
![Page 27: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/27.jpg)
Problem Solution
• Is the discrepancy between expected and actual performance still important?
• If not can the additional resources be reduced or eliminated?
![Page 28: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/28.jpg)
![Page 29: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/29.jpg)
![Page 30: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/30.jpg)
Target criteria by grade level
• One example
Next pages from Michele Hosp Presentation on CBM Norms for ORF
![Page 31: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/31.jpg)
![Page 32: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/32.jpg)
![Page 33: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/33.jpg)
![Page 34: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/34.jpg)
Let’s practice
• Let’s do a one minute reading sample
• How did you do recording?
• Example:
• Median: 45
• Assume 1.5 words week for 36 weeks= 54
• Aim= 45 + 54 = 99 words per minute
Baseline Reading Probes 1: 45 words per minute
2: 42 words per minute
3: 46 words per minute
![Page 35: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/35.jpg)
Goals & Benchmarks
• In 36 weeks, when given a passage from the second grade reader, Jeremy will correctly read 99 words per minute.
• Every nine weeks, when given a passage from the second grade reading textbook and one minute to read, Jeremy will read 13-14 correct words over the number of words read correctly at the previous 9 week measurement.
![Page 36: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/36.jpg)
Aligning CBM and curriculum
• Dissect ELA curriculum
• Create 1 minute samples with one to three passages from each story read.
• Sample should be at the student’s instructional level.
• Authentic passages from a number of sources
• Calculate the readability of each passage.
• Determine baseline & aim line
![Page 37: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/37.jpg)
CBM and Tests
• Helwig & Tindal (2002) no differences between general outcome measures and state tests using CBM and mathematics.
• Epsin, Shinn & Busch (2005). Validity for using vocabulary matching tasks in content areas such as social studies.
• Teachers who believe in CBM had students who had better results and higher trend lines.
![Page 38: Curriculum Based Measures vs. Formal Assessment What does it mean to me? Why bother?](https://reader036.vdocument.in/reader036/viewer/2022062516/56649db65503460f94aa77a1/html5/thumbnails/38.jpg)
Resources
• Intervention Central
• http://www.interventioncentral.org
• OKAPI - CBM reading probes• http://www.interventioncentral.org/htmdocs/tools/okapi/okapi.php
• See other resources online
• Other Documents for resources• CBMprogressmonitoringinReading.pdf
• CBMprogressmonitoringinMath.pdf
• CBM data collection