Developing Operational Outcomes for Your Unit

Dr. Kim Yousey-Elsener, Associate Director of Assessment Programs

Goals of this session:

• Defining “operational” outcomes• Connecting outcomes “up”• Connecting outcomes with assessment

types• Writing effective outcomes• Measuring outcomes

Defining “Operational” Outcomes

Program

Operational

Target Metrics

Criteria for

success

Success indicators

“…are quantifiable measurements, agreed to beforehand, that reflect the critical success factors of an organization. They help an organization define and measure progress toward organizational goals.”

(Bresciani et al., 2010)

Determine the type of Outcome:

• Examine what a student (or other stakeholders) is to know, think or be able to do, as a result of the program, course, service.

Learning outcomes

• Examine what a program or process is to do, achieve or accomplish for its own improvement; generally needs/satisfaction driven.

Operational

outcomes

Connecting “Up”

Where is your inspiration?

Program & Policy

Creation or Improvemen

t

Improved Teaching

and Learning

Planning & Resource Allocation

Accountability &

Accreditation

Start with your “foundations”

• Strategic Plan• Priorities• Mission statement• Resource Needs• New

programs/services• Anything needing a

change• Political quandaries

Let’s get started…

What is your source of inspiration?

What do you need to find out?

Types of assessment:

Assessment

Usage

Needs

Program effectiveness

EnvironmentLearning

Comparison

Cost

Writing effective outcomes

ABCD Structure of an Outcome (Heinich, et al, 1996)

• Who or what does the outcome pertain to?Audience/Who

• What do you expect to change? • Learning – students do, think, feel• Operational - need, effectiveness, etc.

Behavior/What

• Under what conditions or circumstances will the change occur?Condition/How

• How much will be accomplished, and to what level?

Degree/How much

Outcome Statement:

ABCD

Program/Service will …<change what><under these circumstances / conditions><to this level of efficiency / effectiveness>

Let’s Practice!!

ABCD

Program/Service will …<change what><under these circumstances / conditions><to this level of efficiency / effectiveness>

Measuring outcomes

Sources of evidence

• Data systems• Tracking/Usage• Operational data• Trend/longitudinal data• Local surveys • National surveys• Rubrics• Objects

Evidence source: Data systems

Evidence source: Tracking systems

Evidence source: Operational data

Evidence source: Local survey

Evidence source: National survey

Evidence source: Rubric

Evidence Source: Objects

Let’s Practice!!

• Who is your audience?

• What kind of data will you need for that audience?

• In what format?• What source would

help you achieve that?

Questions?

Kim Yousey-Elsener, PhD.Associate Director, Campus Labs716-652-9400 press 1kimye@campuslabs.com