standards and data and outcomes … oh my! moving from perception to reality with data and...
TRANSCRIPT
![Page 1: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/1.jpg)
Standards and Data and Outcomes … Oh MY!
Moving from Perception to Reality with Data and Professional Standards
2014 AER Conference
![Page 2: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/2.jpg)
Presenters
Kay Ratzlaff Florida TVI Instructional
Materials Center QPVI Facilitator
Nancy Toelle Texas TVI Texas School for the
Blind QPVI Developer
July 30 – August 3 AER 2014
![Page 3: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/3.jpg)
Discussion for Today Data
Strategies for data collection Managing data Using data for decision making
Professional Standards of Practice
Outcomes
Yes, we have to pay attention to the “man” behind the curtain!
![Page 4: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/4.jpg)
“Gee Toto, I’ve a feeling we’re not in Kansas anymore.”
July 30 – August 3 AER 2014
![Page 5: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/5.jpg)
Goals Identify strategies for collecting and
managing data to enhance program development and instruction
Establish professional development strategies that implement evidence-based practices and encourage program and individual professional growth
Select standards-based tools for conducting essential assessments and communicating results.
![Page 6: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/6.jpg)
Quality Indicators
• Timely Records• Services Meeting the Standard • Services Based on Assessed Needs• Outcomes Measured
![Page 7: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/7.jpg)
Which Characters Do You See in Your Staff?
Dorothy - dreamer who needs to be rescued
Tin Man – thinks with their heart Scarecrow – thinks only with their brain Lion – scared until absolutely necessary Glinda – pops in to make it “all better” Wizard – good intentions, but faulty
methodsJuly 30 – August 3 AER 2014
![Page 8: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/8.jpg)
And yes … Elphaba, the witch, that makes life
miserable for everyone!
July 30 – August 3 AER 2014
![Page 9: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/9.jpg)
How do you move from all these personalities to …
A team working together to make it to the Emerald City?
July 30 – August 3 AER 2014
![Page 10: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/10.jpg)
QPVI in Florida
FIMC-VI supporting and facilitating delivery to districts
Voluntary participation of districts Administrator commitment Self-study model Building Local Capacity model Ongoing support
![Page 11: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/11.jpg)
QPVI in Florida Aligns with increase in accountability Provides data to support programs and
services Provides training for administrators Addressing problems in programs and
practices based on data not perception Included in the Florida Department of
Education Strategic Plan
![Page 12: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/12.jpg)
Data
1. Timely (Compliance)a. Eye medical report
b. Assessments of functional vision and learning/literacy media
c. O&M screenings and evaluations
d. ECC screenings and evaluations
e. IEP and Reevaluation dates
![Page 13: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/13.jpg)
Data2. Student Information
a. Eye condition(s)
b. Acuities and peripheral fields
c. Time in general education
d. Primary and secondary conditions
e. Other services (OT, PT, etc.)
f. Primary and secondary learning media
g. Font sizes and working distance
h. Instructional reading levels and WPM
![Page 14: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/14.jpg)
Data
3. Program a. Service – direct or consult
b. Minutes of direct service
c. Minutes of consult or support
d. Paraeducators or braillist
e. Clinical low vision evaluations
f. FIMC-VI registrations
![Page 15: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/15.jpg)
Master List Example
![Page 16: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/16.jpg)
DATA FROM MASTER LIST
Example of Data-Driven Decision Making!
![Page 17: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/17.jpg)
Direct Versus Consult Services
55
38
1
21
DirectConsult504Blanks
Direct = 55Consult = 38504 = 1Blank = 21
![Page 18: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/18.jpg)
Comparison Data:Total Students 2009 - 2012
From 61 to 83 Direct Students = 31% to 33%From 136 to 169 Collaborative Con. Students = 69% to 67%
![Page 19: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/19.jpg)
Florida Sample Data – From QPVI Master List of 473 Students
Approximately 87% of students have more than one eye condition
45% of students have Visual Impairment as their primary disability
55% have another disability as primary 44% are labeled Intellectually Disabled (IND) 10% are labeled Orthopedically Impaired 8% are labeled Developmentally Delayed 7% are labeled Deaf Hard of Hearing or Dual Sensory
Impaired; or Hospital Homebound, or Other Health Impaired
6% are labeled Specific Learning Disability (SLD) 4% are labeled Autistic
![Page 20: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/20.jpg)
Common Visual Impairments Nystagmus (26%) Myopia (15%) Optic Nerve Atrophy
or Hypoplasia (13%) Cortical Visual
Impairment (10%) Retinopathy of
Prematurity (8%) Ambylopia (8%)
High Myopia (8%) Glaucoma (6%) Albinism – Ocular
and Oculocutaneous (5%)
Syndromes (5%) Colobomas (3%) Cataracts (3%) Aphakia (2%)
![Page 21: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/21.jpg)
6th Grade FCAT Data on Reading
0
10
20
30
40
50
60
70
80
2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012
Grade 6 VI
Grade 6 All
Grade 6 ESE
Percent of students scoring a 3 or better.
![Page 22: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/22.jpg)
Service Delivery Compared by Florida District
![Page 23: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/23.jpg)
QPVI Self-Study:
The results of each Key Component are applied to the Master List
Master List Eligibility Unique Needs Roles & Responsibilities Type/Amount Staff/Caseloads
![Page 24: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/24.jpg)
1. Baseline data (snapshot) is archived
2. Data is analyzed by VI staff to determine compliance problems and establish priorities
3. Action plan is designed with names, assignments, due dates, completion targets
Process after Data Collection
![Page 25: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/25.jpg)
Sustaining the Data1. Establish a process for program data
collection (shared drives, paper version to clerical person, etc.)
2. Update the student data after each IEP meeting
![Page 26: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/26.jpg)
TVI and O&M
Use the data for: Eligibility decisions Instructional goals Type, time, and intensity of
services Progress monitoring
![Page 27: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/27.jpg)
Program Supervisor
Use the data for Caseload management Tracking results on action
plans Monitoring student
outcomes Justification for supplies,
equipment, and personnel Consolidated data
![Page 28: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/28.jpg)
Noting Presence/Timeliness of VI Program Data
Determine most critical data points to reflect data-driven decision making
Identify data points that are critical to reflect quality programming (eye reports, FVA, LMA, etc.)
Develop Master List: Excel/Access or Numbers
Complete, analyze, set priorities, sustain
![Page 29: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/29.jpg)
District Baseline & Year One Comparison – Target 100%
![Page 30: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/30.jpg)
Dist 1 Dist 2 Dist 3 Dist 4 Dist 5Baseline 48% 64% 78% 65% 62%Current 87% 92% 100% 71% 85%
0%
20%
40%
60%
80%
100%
120%
Timely Functional Vision Assessments
![Page 31: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/31.jpg)
Key Components – Addresssing Issues of “Quality”
1. Developing a master list of students database
2. Eligibility for VI services
3. Unique VI student needs
4. Roles and responsibilities
5. Type and amount of VI service
6. Staff and caseloads
7. Self-study report
![Page 32: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/32.jpg)
Let’s analyze this master list
What’s wrong with this picture???
1. Analyze and aggregate the dataa. What are the good data points?
b. What are the bad data points?
2. How would you use that data to drive your decisions or change your practices?
![Page 33: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/33.jpg)
Why is Assessment Data Important???
9/18/201233
![Page 34: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/34.jpg)
Professional Standards for TVIs and O&Ms
Assessments that align with the EA Rubric
Instruction that implements the Expanded Core Curriculum
Data-driven decision making Needs of students determine service Use of published and peer-reviewed
materials and curricula
![Page 35: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/35.jpg)
Professional Practices for TVIs and O&M
Use of research-based instructional practices Delphi studies on instructional time for
literacy instruction Braille readers Readers with low vision
ABC Braille Study for instructional methods
![Page 36: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/36.jpg)
Professional Practices for TVIs and O&Ms
RIOT model for reevaluations (Record Review, Interview, Observation, Test)
Assessments of functional vision, learning media, and ECC areas are conducted with fidelity
![Page 37: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/37.jpg)
Professional Practices for TVIs
Peer-review of all reports Teaching ECC areas Collecting data on instructional
outcomes AS EVIDENCE OF PROGRESS
Using data to drive instruction and goals
![Page 38: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/38.jpg)
Strategies to Make it Happen
Intensive time for training Most school districts take 3 to 4 years to
implement the changes Follow-up on consistent basis “Inspect what you expect” – hold people
accountable Regular Communication
Wikis, shared drives, small group meetings, mentors, etc.
![Page 39: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/39.jpg)
To Make it Work … 1. Data collection process2. Commitment of administrators3. Established professional standards of
performance4. Commitment of administrators 5. Strategies for Communication:
Wikis, shared drives, small group meetings, mentors, etc.
6. Did we say … Commitment of administrators to enforce standards!
![Page 40: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/40.jpg)
Accountability Is Here To Stay Make It Count Use professional
resources - no more flying by the seat of our pants!
Engage in professional development - conferences, webinars, internet
Know your stuff Be a professional
Do It Right Implement the strategies
that work Take responsibility for
outcomes of students (no more blaming them!)
Be “in the room and at the table” to advocate for students and clients
![Page 41: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/41.jpg)
Data… Professional Standards … Quality … Instruction … Assessment ... Outcomes
![Page 42: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/42.jpg)
Establish goals for quality and train to meet those goals
Decide on your data points and processes. COLLECT AND ANALYZE DATA TO TRACK PROGRAM QUALITY
Clearly establish your professional standards
Peer reviews, “data days,” changes in practices, evaluations
Process is dynamic and not static, adjust as needed
Action Plan
DataData
StandardsStandards
QualityQuality
ImplementImplement
ReviewReview
![Page 43: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/43.jpg)
You are the professional in the room!
![Page 44: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/44.jpg)
Resources Assuring Quality Literacy Instruction for Students Who are Blind
by: Alan J. Koenig • Texas Tech University, and M. Cay Holbrook • The University of British Columbia; From: Koenig, A.J., & Holbrook, M.C. (2000). Ensuring high-quality instruction for students in braille literacy programs. Journal of Visual Impairment and Blindness, 94, 677-694. Available for download: www.nfb.org/images/nfb/documents/.../delphibraillestudentsholbrook.doc
Literacy for Students with Low Vision: A Framework for Delivery of Instruction, by Anne L. Corn • Vanderbilt University, and Alan J. Koenig • Texas Tech University: From: Journal of Visual Impairment and Blindness, May 2002, 96, . Available for download: http://www.afb.org/jvib/JVIB960503.asp
Quality Programs for Students with Visual Impairments, Nancy Toelle, developer: www.qpvi.com
Essential Assessments Rubric, www.earubric.com
9/11/2007 FIMC-VI
![Page 45: Standards and Data and Outcomes … Oh MY! Moving from Perception to Reality with Data and Professional Standards 2014 AER Conference](https://reader033.vdocument.in/reader033/viewer/2022051622/56649d825503460f94a6864c/html5/thumbnails/45.jpg)
Facilitators for Today’s Session
Nancy Toelle
QPVI Developer / Texas School for the Blind and Visually Impaired
[email protected] & www.QPVI.com Kay Ratzlaff
Coordinator of Instructional Resources
Florida Instructional Materials Center for the Visually Impaired
[email protected] & www.FIMCVI.org
July 30 – August 3 AER 2014