m0 school leader orientation-demo site

1

Student Learning/Support

Objectives (SLO/SSO)-School Leader Module-

2

Student Learning/Support

Objectives

Module 0Orientation to the SLO/SSO

Process

GoalProvide guidance and procedural suggestions to school leaders for the implementation of student learning/support objectives (SLO/SSO).

Objectives Participants will:

1. Explore the Student Learning/Support concept.2. Identify roles and responsibilities needed to implement

Student Learning/Support Objectives (SSO).3. Review tasks and suggested procedures for each

SLO/SSO phase (Design, Build, & Review).3

Orientation

4

CONCEPTUAL FRAMEWORK

Student Learning Objective (SLO)• An indicator of educator effectiveness based on

student achievement of targeted content standards.

Student Support Objective (SSO)• An indicator of professional effectiveness based on

services provided to support student achievement.

5

What is a Student Learning/Support Objective?

Five-Step Process1. Develop a goal statement2. Identify content or professional

standards3. Create a blueprint with objectives and

assessments4. Review the completed template5. Evaluate student performance

6

How is it Done?

7

1. Goals are based upon the key concepts.2. Objectives are specific, measurable, attainable, and

time-bound.3. Teacher expectations of student achievement are

challenging.4. Performance measures are valid, reliable, and

rigorous.5. Performance data are collected, organized,

summarized, and reported in a consistent manner.

Intent

Guiding PrinciplesSLO

1. Represent student performance in a specific course or subject area taught by the educator.

SSO2. Represent student performance in an identified

area of need to support achievement and school success.

8

Guiding Principles (cont.)SLO2. Align to a set of Targeted Content Standards that represents the depth and breadth of the Goal Statement.

SSO2. Align to a set of Professional Standards that reflects the Goal Statement.

9

Guiding Principles (cont.)SLO & SSO

3. Contain results from high-quality performance measures collected in an equitable, verifiable, and standardized manner.

4. Use metrics based on two time-bound events (i.e., data collection periods) or on summative performance measures with defined levels of achievement.

5. Include performance targets linked to performance measures. 10

11

PROCESS PHASE

The student learning/support objective process includes three phases: • Design(ing): think, organize, discuss, research• Build(ing): select, develop, complete, share • Review(ing): check, refine, edit, update, test

The SLO/SSO process contains five procedural steps “nested” within the three phases (see Slide 6).

12

Process Phases

Process Components

13

STEP #1 Goal

STEP #2 Standards

STEP #3 Blueprint

STEP #4 Form STEP #5 QA

SLO/SSO Process: Major Components

Goal

Objective #1

Assessment #1

Objective #2

Assessment #2

Goal & Targeted Content/Professional Standards

Performance Indicators

Performance Measures

15

Blueprint-Art Grade 3 Example-

Goal StatementDemonstrate the art skills, techniques, elements, and principles that are the foundation of visual communication and are key to communicating ideas, artistic messages, mood, and feelings.

Objectives OBJ #1: By the end of the final grading period, at least 75% of all students will earn at least one Proficient rating within the Paper Weaving Project.

OBJ #2:By the end of the third grading period, at least 80% of all students will earn at least one Proficient rating within the Still Life Painting Portfolio.

PM #2:Still Life Painting Portfolio comprised of four (4) unique paintings.

*Note* Also see Handout #1: Designing the SLO, Step #3–Blueprint.

16

Blueprint-School Psychologists Example-

Goal StatementImprove students' academic achievement, positive mental health, and social competence using interventions and mental health services.

Objectives OBJ #1: 70% of all identified students will show improvement on their targeted behaviors after 8 weeks of receiving services.

OBJ #2:80% of all identified students will maintain targeted behaviors after 16 weeks of receiving services.

PM #2:Functional Behavioral Assessment (FBA)-District

*Note* Also see Handout #1: Designing the SLO, Step #3–Blueprint.

17

School Leaders Roles and Responsibilities

18

Generic Procedural Timeline1. Establish initial SLO/SSO timeline at the

beginning of the school year2. Review completed template with educator3. Agree on any revisions; sign SLO/SSO

Template4. Establish “mid-cycle” implementation check5. Conduct end-of-year review of summarized

performance data6. Determine rating; sign SLO/SSO Template

19

Timeframe“Typical School Year”

July June

August September October November December January February March April May

● ● September

● ● Implementing

● ● Review PerformanceMarchDesign, Build, & Review (QA)

20

Phases-Roles and Responsibilities-

DESIGN

Roles & ResponsibilitiesTeachers: Identify content standards and studentsSpecialists:Identify professional standards and clients Leaders: Identify school-wide needs and timeline for submission

BUILD

Roles & ResponsibilitiesTeachers: Identify performance measures and expectations within the SLO formSpecialists:Identify performance measures and expectations within the SSO formLeaders: Clarify and guide SLO/SSO completion

REVIEW

Roles & ResponsibilitiesTeachers: Verify the SLO is complete and comprehensive Specialists:Verify the SSO is complete and comprehensive Leaders: Validate expectations and ensure coherency

Roles and Responsibilities

21

Assignments:• are determined locally and could vary nationally.• are flexible and may change during the school year.• for SLO/SSO development may be “shared” across

grade-levels or departments.• of new roles may include SLO/SSO trainer, co-

developer, and/or quality reviewer for lead teachers, department chairpersons and other leaders.

22

Tasks and Procedures

23

Design Phase: Tasks

24

SLO and SSO TemplatesTemplate 2a & 2c

The framework used to identify goals, objectives, and performance measures for the Student Learning/Support Objectives.

25

Template Sections

Context Goal

Objectives Measures

26

Design: Educator/Professional Tasks

1. Identify subject (service area) and students2. Concept/services from the content/professional

standards3. Draft a goal statement and rationale4. Identify preliminary objectives and

performance measures5. Develop a “blueprint”

27

Design: Leader Tasks

1. Establish timeline and expectations for SLO/SSOs

2. Identify training and other resources3. Identify any school-wide needs that can be

supported by the SLO/SSO process4. Disseminate achievement data from prior

year(s)

28

Build Phase: Tasks

29

ContextSLO Guiding Statement “Let me begin by describing my classroom.”

General Description• Contains demographic information about the

educational setting.• Identifies the course/subject, grades, and

students the SLO focuses on.• Provides class size, frequency, and time data.

30

SettingSSO Guiding Statement “Let me begin by describing the setting of my support services.”

General Description• Contains descriptive information about

the service setting.• Identifies the service area and location,

students’ grade levels, and other service and clientele information.

31

SLO Section I-Business RulesElement Definition

1.1 Content Area Name of the content area upon which the SLO is based

1.2 Course Name of the specific course/subject upon which the SLO is based

1.3 Grade Level Grade levels for students included in the course/subject in Element 1.2

1.4 Total StudentsAggregate number of students (estimated, across multiple sections) for whom data will be collected 

1.5 Average Class Size

The average number of students in a single session of the course/subject identified in Element 1.2

1.6 Class Frequency The frequency (within the given timeframe) of the course/subject identified in Element 1.2

1.7 Instructional Setting

The location or setting where the course/subject instruction is provided

1.8 Instructional Interval The time frame of the course/subject identified in Element 1.2

32

SSO Section I-Business RulesElement Definition

1.1 Service Area Name of the primary service area (e.g., speech) upon which the SSO is based

1.2 Service Location Name of the location(s) services are provided

1.3 Grade Level Grade level(s) of students and/or educator-type services are provided

1.4 Total Recipients Aggregate number of students and/or educators for whom data will be collected

1.5 Average Case Load

The “average” number of recipients of the services identified in Element 1.4

1.6 ServiceFrequency

The typical frequency (within the identified service interval-Element 1.8) services are provided to recipients identified in Element 1.4

1.7 Service Setting The contextual setting (e.g., school library, student’s home) services are provided

1.8 Service Interval The typical time frame of the service model

33

GoalSLO Guiding Statement “Here is a key concept my students need to understand fully.”

General Description• Contains a statement about the key concept

the SLO is based upon.• Provides the targeted content standards

associated with the goal.• Articulates an instructional strategy for the

Goal Statement.

34

GoalSSO Guiding Statement “Here is a primary service to my clientele.”

General Description• Contains a statement about the primary

service the SSO is based upon.• Provides the targeted professional

standards associated with the goal.• Articulates an implementation strategy for

the Goal Statement.

35

Element Definition

2.1. Goal Statement

A narrative that articulates a key concept upon which the SLO is based. The statement addresses What, Why, and How. 

2.2. Targeted Content Standards

Targeted Content Standards, which are the foundation of performance measures, are used to develop the SLO.

2.3. Instructional Strategy

The approach used to facilitate learning the key concept articulated in the Goal Statement and delineated among the Targeted Content Standards.

SLO Section II-Business Rules

36

Element Definition

2.1. Goal Statement

A narrative that articulates a key concept upon which the SSO is based. The statement addresses What, Why, and How.

2.2. Targeted Professional Standards

Targeted Professional Standards outline the requirements an organization must fulfill to ensure that products and services consistently meet customers' requirements. Content standards may also be identified for those individuals providing instructional services.

2.3. Implementation Strategy

The approach used to attain the primary service goal articulated in the Goal Statement and delineated among the Targeted Professional Standards.

SSO Section II-Business Rules

Objective

37

SLO Guiding Statement “My students need to achieve these learning targets to be successful.”

General Description• Identifies a starting point (baseline) and end point.• Includes all students identified in Section I and

may include a focused student group (optional).• States the objective associated with each

performance measure.• Identifies empirical ranges for each performance

category.

Objective

38

SSO Guiding Statement “My clientele need to achieve these performance targets to be successful.”

General Description• Identifies a starting point (baseline) and an end

point.• Includes all clients identified in Section I and may

include a focused client group (optional).• States the objective associated with each

performance measure.• Identifies empirical ranges for each performance

category.

39

SLO Section III-Business RulesElement Definition

3.1 Starting Point (Baseline)

 The baseline data used for comparing student results at the end of the instructional interval.   

3.2 Objectives (Whole Class)

The expected level of achievement for the entire student learning objective (SLO) population (as defined in Element 1.4). 

3.3 Objectives (Focused Students)

The expected level of achievement for a subset of the SLO population (as defined in Element 1.4). 

3.4 End Point (Combined)

 At the end of the instructional interval, the aggregate performance classification as delineated by four empirical ranges (i.e., Unsatisfactory, Emerging, Efficient, and Distinguished). 

40

SSO Section III-Business RulesElement Definition

3.1 Starting Point (Baseline)

The baseline data used for comparing student results at the end of the instructional interval.  

3.2 Objectives (All Clients)

The expected level of performance for the entire client population (as defined in Element 1.4).

3.3 Objectives (Focused

Clients)

The expected level of performance for a subset of the client population (as defined in Element 1.4).

3.4 End Point (Combined)

At the end of the service interval, the aggregate performance classification as delineated by four empirical ranges (i.e., Unsatisfactory, Emerging, Effective, and Distinguished).

41

Performance MeasuresSSO Guiding Statement “These measures are best suited to evaluate my clientele.”

General Description• Identifies all performance measures, including name,

purpose, and metric.• Articulates the administration and scoring details.• Measures aspects of the professional services

provided to clients.*Note* Section IV is based upon high-quality performance measures aligned to the

Targeted Content Standards. (See Quick Start training materials)

42

SLO Section IV-Business RulesElement Definition

4.1 Name The name of each performance measure for which an objective is established in Element 3.2.

4.2 PurposeThe purpose statement for each performance measure that outlines: (a) What the assessment measures, (b) How to use the scores, and (c) Why the assessment was developed.

4.3 Content Standards

The Targeted Content Standards (the foundation of performance measures) used to develop SLOs. The content standards are those aligned with each performance measure. 

4.4 Performance TargetsUsing the scoring tools for each performance measure (as listed in Element 4.1), the expected level of achievement for each student in the SLO population (as defined in Element 1.4).

4.5 Metric The metric by which the performance measure evaluates the performance target.

4.6 Administration

The administrative steps before, during, and after the assessment window, as well as the step-by-step procedures during each phase of administration; The requirements for completing the performance measure, including accommodations, equipment, and materials; The standard time to complete the overall performance measure; The standard scripts that educators read to give directions for completing the performance measure.

43

Element Definition

4.7 Scoring ToolsScoring Keys: Objective Measures Scoring Rubric: Subjective Measures

4.8 Results The number of students participating in the performance measure The number of students who met the target as stated in Element 4.4 The percentage of students who met the target as stated in Element 4.4

SLO Section IV-Business Rules (cont.)

Element Definition

SLO Rating One of four performance levels that the principal (or the evaluator) identifies after noting the actual performance in respect to each objective stated in the SLO. Note: Complete this section only after collecting, reviewing, and evaluating performance data against each performance target.

Notes and Explanation

Space for the educator to note influences, factors, and other conditions associated with the SLO Rating, as well as to reflect on a purposeful review of the data. Note: Complete this section only after collecting, reviewing, and evaluating performance data against each performance target.

44

SSO Section IV-Business RuleElement Definition

4.1 Name The name of each performance measure for which an objective is established in Element 3.2

4.2 PurposeThe purpose statement for each performance measure that outlines: (a) What the measure is evaluating, (b) How to use the scores, and (c) Why the measure was developed

4.3 Professional Standards

The Professional Standards (the foundation of measures) used to develop SSOs. The professional standards are those aligned with each identified measure.

4.4 Performance TargetsUsing the scoring tools for each performance measure (as listed in Element 4.1), the expected level of attainment for each client in the SSO population (as defined in Element 1.4)

4.5 Metric The metric by which the performance measure evaluates the performance target

4.6 Administration

The administrative steps before, during, and after the evaluation window, as well as the step-by-step procedures during each phase of administration; the requirements for completing the performance measure, including accommodations, equipment, and materials; the standard time to complete the overall evaluation.

45

Element Definition

4.7 Scoring Tools Scoring Keys: Objective Measures; Scoring Rubric: Subjective Measures; Data collection mechanisms

4.8 ResultsThe number of clients participating in the performance measure; the number of clients who met the target as stated in Element 4.4; the percentage of clients who met the target as stated in Element 4.4

SSO Section IV-Business Rules (cont.)

Element Definition

SSO Rating One of four performance levels that the principal (or the evaluator) identifies after noting the actual performance in respect to each objective stated in the SSO. Note: Complete this section only after collecting, reviewing, and evaluating performance data against each performance target.

Notes and Explanation

Space for the educator to note influences, factors, and other conditions associated with the SSO Rating, as well as to reflect on a purposeful review of the data. Note: Complete this section only after collecting, reviewing, and evaluating performance data against each performance target.

46

SLO Rating -P.E. Grade 7 Example (cont.)-

SLO Rating

Distinguished • Effective• Emerging• Unsatisfactory

Notes and ExplanationObjective was 95.0%; overall actual performance, 96.2%.

* Note* See also Handout #2a: Building the SLO, Step #4–SLO Form.

47

SSO Rating - School Psychologists Example (cont.)-

SLO Rating

Distinguished • Effective• Emerging• Unsatisfactory

Notes and ExplanationBehavior intervention plans, along with home-school compacts, were highly effective in communicating antecedents.

* Note* See also Handout #2c: Building the SSO, Step #4–SLO Form.

48

Build: Leader Tasks

1. Clarify expectations for SLOs/SSOs2. Provide additional training and other resources3. Screen draft material prior to conferencing with

educator4. Designate a school-based, subject matter expert

to support development5. Coordinate district and external professional

development services

49

Review Phase: Tasks

50

Helpful Resources

Participants should consult the following:

Training• Handout #3: QA Checklist

Step 5: Quality Assurance of the SLO/SSO form

Templates• Template #3: Coherency Rubric• Template #3a: Performance Measure Rubric

Resources• Help Desk• Demonstration #1-Art Grade 3-DEMO-Final• Demonstration #2-School Psychologists-DEMO-Final

51

Participants should consult the following:A. Completion of the SLO Form• Handout #3-Quality Assurance Checklist

B. Comprehensiveness of the Performance Measures• Template #3a-Performance Measure Rubric

C. Coherency of the SLO Design• Template #3-Coherency Rubric

Helpful Resources (cont.)

52

Task Structure

QA 1. CompletenessIs the SLO/SSO Form completed correctly?2. ComprehensivenessAre the assessments of high technical quality?

3. Coherency Are the SLO/SSO components aligned to each other?

53

Final Deliverables

A refined SLO/SSO Form with:• Rigorous, high-quality performance

measures designed to measure the targeted content/professional standards.

• Areas identified for further improvement/consideration (as documented within the Coherency Rubric).

54

Review: Educator Tasks

1. Evaluate each Section of the SLO/SSO Form (Template #2) using Handout #3-Quality Assurance Checklist

2. Identify and correct any element that deviates from the business rules

3. Organize the template, assessments, and summary data

4. Conduct review with school leader5. Finalize and sign form

55

Review: Leader Tasks1. Conduct preliminary review (screen) of proposed

SLO/SSO2. Implement conference with educator:

a) Develop “triage” of screening materialsb) Align time allocation given preliminary reviewc) Provide “key points of discussion” prior to

conference3. Discuss proposed SLO/SSO and applicable

performance measures4. Identify any corrections, refinements, etc.5. Sign form and establish follow-up timeline

56

Procedural -Conference-

The SLO/SSO process facilitates an ongoing conversation about expectations between educators and school leaders

57

Procedural -Discussion Points: Fall-

Goals-Standards• What is the subject/service focus?• Whom does it encompass?• How can it improve instruction/practice?

Measures• Why are they considered high quality measures?• Who administers and scores the measures?• What types of data are produced?

Indicators• What are the indicators of success?• How are they being measured?• Which students are they based upon?

58

Procedural -Discussion Points: Winter-

Goals-Standards

• How has the instruction/intervention supported the subject/content focus?

• Which student groups are making progress or struggling?

• What instruction/practice adaptations will be needed in the spring?

Measures

• Which measures have been administered so far?• Are additional measures necessary at this time?• What is the data telling us about student growth

and/or mastery?

Indicators

• Are indicators of success still applicable?• How well are the indicators working?• Which indicators are producing data about

student performance?

59

Procedural -Discussion Points: Spring-

Goals-Standards

• To what degree was the key concept/skill mastered by students?

• Which content/professional standards will need additional instruction?

• How can the standards be taught more effectively?

• How can the service be provided more effectively?

Measures

• Which measures should be discontinued or need significant revisions?

• To what degree did students meet your expectations?

• What data points had the most influence on your overall rating?

Indicators

• Which indicators were established too high or too low?

• What did the indicators tell you about student performance?

• Which student groups underperformed on selected indicators?

60

Procedural-Areas of Caution-

1. SLO/SSO is based upon small numbers of students or data points.

2. Goals and/or objectives are “loosely” linked to targeted standards.

3. Objectives are vague without specific criteria.4. Growth and/or mastery is not clearly defined.5. Performance measures are poorly designed,

lack rigor, or do not measure the targeted standard(s).

61

TRAINING

62

Integrated SLO/SSO Training

Training Phases

Module 2Building SLOs

Module 1Designing SLOs

SLO/SSO Process

Module 3Reviewing SLOs

Module 0 Orientation

Assessment Literacy

Process via Quick Start

Module 1Designing SSOs

Module 2Building SSOs

Module 3Reviewing SSOs

Training Describes the procedures within each of the three (3)

phases (i.e., Design, Build, and Review). Provides examples and information about the process.

Templates Assist in developing customized student learning

objectives (SLO) or student support objectives (SSO), including performance measures.

Resources Supplement the core training material.

63

SLO/SSO Components

64

65

66

Orientation to the SLO/SSO Process• Shared how the student

learning/support objective (SLO/SSO) process involves three phases, each having three components that integrate the training experience.

• Reviewed the SLO/SSO terminology and online training material.

67

Summary