patterns of strengths and weaknesses(psw):  conceptualization and analysis

20
Patterns of Strengths and Weaknesses(PSW): Conceptualization and Analysis Edward K. Schultz PhD TEDA 2011 Padre Island

Upload: halona

Post on 09-Jan-2016

31 views

Category:

Documents


0 download

DESCRIPTION

Patterns of Strengths and Weaknesses(PSW):  Conceptualization and Analysis. Edward K. Schultz PhD TEDA 2011 Padre Island. Session Description. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Patterns of Strengths and Weaknesses(PSW):  Conceptualization and Analysis

Edward K. Schultz PhD TEDA 2011 Padre Island

Page 2: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Session Description

The participants of the session will be able to understand data collection and analysis when determining SLD via a pattern of strengths and weaknesses.

Page 3: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Outcomes

Recognize the similarities between SLD evaluation and Research Processes (Discuss rational-Educ. Diag. Program)

Increase professional judgment and confidence in data analysis

Summarize third method PSW approaches Describe organization and data collection

using a PSW approach Data analysis principles.

Page 4: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Similarities between SLD evaluation and Research Processes

SLD EVALUATION

Case Study/Single Case Reliable and Valid

methodology (design) Mixed-methods Referral Question Objective Data Collection Triangulation (PSW;

Variety of Assessment tools)

Analysis

GOOD RESEARCH

Case Study/Single Case

Reliable and Valid methodology (design)

Mixed-methods Research Questions Objective Data Collection Triangulation Analysis Controls

Page 5: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Operational Definition of PSW

A pattern is defined as “a combination of qualities, acts, tendencies, etc., forming a consistent or characteristic arrangement (Random House 2011).”

(a) multiple sources of data collected over a period of time using a variety of assessment tools and strategies

(b) data analysis which is grounded in the techniques of pattern seeking (McMillan & Schumacher, 2010)

Page 6: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Operational Definition of PSW

(c) possess predictive and treatment validity,

(d) uses logical and empirical evidence to guide decisions-making.

Page 7: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Third Methods Approaches

Integrating Response to Intervention and Cognitive Processing Approaches Cognitive Processing Approaches Cognitive Hypothesis Testing (CHT) Discrepancy/Consistency Approach

Page 8: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

State Examples

Idaho Oregon Texas

Page 9: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Formative/Classroom Data

This type of data refers to data collected “prior to and as part of the evaluation” (19 TAC Chapter 89, Subchapter AA) as written in the TX regulations concerning and the Commissioners Rules Guidance document (available http://www.tea.state.tx.us/special.ed/guidance/rules/89.1040.html)

Page 10: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Examples

Supporting documentation should be included for each area: Tutorial, compensatory, Response to Intervention,

and other academic or behavior supports available to all students. * General education options should be thoroughly explored prior to referral.

Data that demonstrates the child was provided appropriate instruction in reading and/or math within general education settings delivered by qualified personnel.

Review of curriculum and grade level performance by class/subject area *this is typically accomplished through a school improvement program that uses a grade-level or campus level progress monitoring system.

Page 11: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Data-based documentation of repeated assessments of achievement at reasonable intervals “reflecting student progress during classroom instruction” (formative assessment data)  

RtI progress monitoring results (Curriculum–based measurement (CBM)data)

In-class tests on grade level curriculum (state standards)

Benchmark assessment, criterion-referenced measures, or other regularly administered assessments.

*Data from repeated assessments results used in the SLD eligibility process should typically have been administered at evenly-spaced intervals. Such as once per week, over a reasonable period of time. (4-8 weeks, 6weeks on average) 

Current work samples (Analysis of student work samples is a special type of observation and is sometimes referred to as “permanent product analysis” or “outcome recording.” This method requires 1) collecting work samples, 2) scoring of samples, 3) noting/analyzing errors, and 4) sorting errors into meaningful categories.)

“prior to and as part of…”

Page 12: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Informal Data

Informal data collection should precede formal data collation and assist in determining what other data is needed and assist assessment personnel in determining a PSW.

Informal Data includes:

Interview data from multiple informants-student, parent, teachers. Social/Educational History information provided by the parent A thorough records review including: prior state assessment scores (TAKS),

report cards, attendance, discipline records, language survey, anecdotal records/notes, and any other useful record.

Observational data-classroom, testing session, ect. Work samples (Analysis of student work samples is a special type of

observation and is sometimes referred to as “permanent product analysis” or “outcome recording.” This method requires 1) collecting work samples, 2) scoring of samples, 3) noting/analyzing errors, and 4) sorting errors into meaningful categories.)

Results from Screenings or any other district assessments (TPRI, Stanford, etc.)

Medical history Vision/Hearing tests and results Rating Scales

Page 13: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Formal Data

Formal data is generally regarded as data gathered from standardized and/or norm-referenced assessments. These measures have established reliability and validity. Formal data should be collected and analyzed in the context of other data collection techniques. This includes such things as:

Standardized individuals tests of cognitive processes (WISC-4; KABC, WJ-III)

Standardized individual tests of achievement Standardized tests of adaptive behavior, language Standardized measures of grade level content Curriculum Based Measurement (CBM)

Page 14: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Data Analysis

Integrative Data Analysis: “the analysis of multiple data sets that have been pooled into one.” (Curran & Hussong,p. 81 2010).

Inductive Analysis: process of synthesizing and extracting meaning from data, starting with specific data and ending with patterns (McMillan & Schumaker, 2010)

Page 15: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Data Analysis: Pattern Seeking

Begins with hypothesis Thorough search of data-looking for

negative information and alternative explanations (exclusionary factors)

Code and categorize data Patterns of meaning will emeerge

Page 16: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Techniques

Trustworthiness: accuracy of sources, bias, enough info.

Triangulation: cross-validating among sources

Evaluating Discrepant and Negative Evidence: exclusionary factors, explainable

Ordering and sorting categories Constructing a Visual

Representations

Page 17: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Techniques

Logical cross analysis Plausability

Page 18: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Final Thoughts on Interpretation

Interpretation is the essence of research (exploit data fully, but do not go far beyond the data-Professional judgment)

The data must speak for themselves Defend your data: “to justify one’s

conclusions, to support’s ones statements with the backing of solid data that have been presented in the document” p. 296

Page 19: Patterns of Strengths and Weaknesses(PSW):   Conceptualization and Analysis

Decision

In practice: The diagnostician must be confident that the data collectively

identifies a pattern consistent with the definition of SLD. The integrative approach of data analysis is to ensure decisions concerning eligibility, instructional implications, and learner profiles are based on data that has been carefully examined in a way that logical and consistent. Each data source has its unique value and should converge to strengthen decisions. Conflicting data needs to be reconciled within an explanatory framework (Gall, Gall, & Borg, 2005). Sound decisions cannot be made with incomplete or conflicting data that cannot be explained. If the answer does not lie in the data, additional questions must be asked. The use of professional/clinical judgment to help guide an ARD committee to make the most appropriate eligibility recommendation is embedded in the integrative approach of data analysis.

Guiding principle: "Good judgment requires good data" (Howell, Fox, & Morehead, 2000, p. 95).