front end analysis

16
Front End Analysis: Show Me the Problem 1 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected] Front End Analysis What’s the Problem? Components of Assessment The assessment process examines what the problem is what needs to be learned what resources are available who the learners are what the learners already know in an attempt to define the problem the learning is intended to solve. What is the problem? Part of creating an e-learning solution is ensuring that an e-learning piece is actually the best solution for the problem. A performance consulting solution looks for the gap between the desired state and the existing state. Existing Behavior GAP Desired Behavior Zap the Gaps The solution, which may not be training at all, is the answer to bring the existing behavior to the desired behavior state. In Zap the Gaps , by Ken Blanchard, Dana Robinson and Jim Robinson, the process is identified as 1. Go for the “shoulds” (desired behavior) 2. Analyze the “is” (existing behavior) 3. Pin down the cause 4. Select the solution Look at Other Issues There are often other “fast fixes” which may be applied to the problem. Before we invest a lot of time in developing e-learning, we may want to look at other possibilities for the problem. Robert Mager 1 Continued on next page has created an excellent diagnostic tool that helps with the search. It is reproduced on the following page. 1 Mager, R. Pipe, P. (1997) Analyzing Performance Problems or You Really Oughta Wanna. Atlanta: The Center for Effective Performance

Upload: thivanka

Post on 03-Dec-2015

249 views

Category:

Documents


0 download

DESCRIPTION

Front End Analysis

TRANSCRIPT

Front End Analysis: Show Me the Problem 1 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected]

Front End Analysis

What’s the Problem?

Components of Assessment

The assessment process examines • what the problem is • what needs to be learned • what resources are available • who the learners are • what the learners already know

in an attempt to define the problem the learning is intended to solve.

What is the problem?

Part of creating an e-learning solution is ensuring that an e-learning piece is actually the best solution for the problem. A performance consulting solution looks for the gap between the desired state and the existing state. Existing Behavior GAP Desired Behavior

Zap the Gaps

The solution, which may not be training at all, is the answer to bring the existing behavior to the desired behavior state. In Zap the Gaps

, by Ken Blanchard, Dana Robinson and Jim Robinson, the process is identified as

1. Go for the “shoulds” (desired behavior) 2. Analyze the “is” (existing behavior) 3. Pin down the cause 4. Select the solution

Look at Other Issues

There are often other “fast fixes” which may be applied to the problem. Before we invest a lot of time in developing e-learning, we may want to look at other possibilities for the problem. Robert Mager1

Continued on next page

has created an excellent diagnostic tool that helps with the search. It is reproduced on the following page.

1 Mager, R. Pipe, P. (1997) Analyzing Performance Problems or You Really Oughta Wanna. Atlanta: The Center for Effective Performance

Front End Analysis: Show Me the Problem 2 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected]

What’s the Problem?, Continued

Front End Analysis: Show Me the Problem 3 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected]

What’s the Problem?, Continued

Joe Harless Front End Analysis

There are different issues when there is a new performance need as opposed to a present goal deficit.

Continued on next page

Front End Analysis: Show Me the Problem 4 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected]

What’s the Problem?, Continued

ISPI HPT Model

ISPI uses the Human Performance Technology Model and considers a variety of support tools.

Continued on next page

Front End Analysis: Show Me the Problem 5 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected]

What’s the Problem?, Continued

ASTD HPI Model

ASTD uses the Human Performance Intervention Model, considering the need for change management as part of the process.

Continued on next page

Front End Analysis: Show Me the Problem 6 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected]

What’s the Problem?, Continued

Six Boxes

The Six Boxes Model (Carl Binder, www.sixboxes.com ) or Behavior Influencing Model (Tina Teodorescu, www.competencesystems.com ) both have their roots in the work of TF Gilbert, and examine six areas that can be positively or negatively influencing the employee. We consider the positive and negative influences on each area in examining the system.

External/Environmental Conditions 85% of the problems are here

1) Expectations & Feedback 2) Tools & Resources 3) Consequences & Incentives

Internal/Employee Conditions 15% of the problems are here

4) Skills & Knowledge 5) Selection, Assignment, Capacity

6) Motives & Preferences

Front End Analysis: Show Me the Problem 7 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected]

Performance Influencing Model: Boxes 1-3

Exte

rnal

/Env

ironm

enta

l Inf

luen

ce

1) Expectations & Feedback 2) Tools & Resources 3) Consequences & Incentives

Enab

lers

Descriptions and measures of expected work outputs

Clear and relevant information/expectations on how to do the job

Relevant, timely, frequent, positive, concrete feedback about how one is performing against expectations

Constructive suggestions for improvement and corrective feedback

Tools, resources, time, materials, and physical environment designed to support optimal work output and comfort

Access to managers, coaches, and experts on a timely basis

Sufficient personnel to support efficient workgroup performance

Optimal work processes and job designs

Reference tools and resources that are easy to use and built of the job

Sufficient financial incentives contingent upon desired performance

Non-monetary incentives for success

Informal positive social consequences for doing the right thing from managers and peers

Career development opportunities

Clear consequences for poor performance

Consequences that match expectations and feedback

Obs

truc

tions

Poor contradictory, or absent descriptions and measures of expected work outputs

Ambiguous, subjective, or conflicting information /expectations on how to do the job

Vague, infrequent, negative, delayed, unconstructive feedback about hot one is performing against expectations.

Too many different expectations, lack of clear priorities

Not enough people, money, time, supplies, equipment, or other resources to do the job efficiently and effectively

Lack of good coaching from managers

Inefficient, poorly designed jobs and workflow

Lack of needed support functions/staff

Bad ergonomics or other physical environment factors.

Reference tools or needed information that is hard to use or find, irrelevant, absent, not helpful, and/or information overloaded

Too little compensation

No recognition for exemplary performance

Informal negative social consequences for doing the right thing from managers and/or peers

Informal positive social consequences or easy excuses for doing the wrong thing

Unclear or absent career development opportunities or career planning process

Poor performance rewarded the same as good performance

Consequences inconsistent with expectations and feedback

Front End Analysis: Show Me the Problem 8 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected]

Performance Influencing Model: Boxes 4-6

Inte

rnal

/Em

ploy

ee In

fluen

ce

4) Skills & Knowledge 5) Selection, Assignment, Capacity 6) Motives & Preferences

Enab

lers

Training that teaches the skills and knowledge required to accomplish organizational goals

Opportunity to learn by the most efficient and effective means, in classrooms, self-study, with means, with managers and coaches

Training designed to support performance of exemplary performers

Training to teach proficiency in the use of the best tools and resources

Effective skills training, opportunities to practice skills, and skill support/modeling from managers

A good match between the capacity and characteristics of people and jobs

Effective selection processes and tools

Other personal attributes and characteristics needed for success in the job

Assignment to jobs/tasks that are a good match with people’s skills, knowledge, and preferences

Incentives and compensation that people are motivated to work for- they want what is available

Assignments and job functions that sufficiently fit individual’s preferences

Positive, enthusiastic attitude about job and company

Good relations with co-workers and environment that supports positive social feelings.

Obs

truc

tions

Training and other learning methods that are cumbersome, ineffective, not worth the time, or don’t produce performance improvement

Training as the automatic solution to performance problems

Training not based on characteristics of exemplary performance

Training on wrong objectives/topics—not based on real gaps

People with intrinsically different abilities than the job requires

Performance scheduling demands that prevent people from being at their peak

Inappropriate social behavior

No background or interest in the job

Incentives and compensation that just isn’t worth the work, if there are other jobs available

Assignments and job functions that conflict with individuals’ preferences

Negative, cynical, or defeated attitude about job and company

Chronically problematic relations with co-workers

Unpleasant working conditions

Front End Analysis: Show Me the Problem 9 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected]

What Needs to Be Learned?

Task Analysis Once we determine that the issue is worth perusing and believe that e-learning

is the best solution, we need to analyze the tasks, looking for the knowledge, skills and attitudes of the desired end state. At this point we are compiling knowledge. We will need to cull this down as we write the course.

KSAs Look for the knowledge, skills and attitudes. Ask:

• What do they need to know at the end of the course?

• What do they need to be able to do at the end of the course?

• What attitudes do they need to have at the end of the course?

Practice Creating a chart like this is helpful for identifying the issues that need to be

covered. Knowledge Skills Attitudes

Front End Analysis: Show Me the Problem 10 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected]

Set the Plan

Understanding by Design

Front End Analysis: Show Me the Problem 11 Learning Solutions 2010 – Orlando, FL © 2010, Jean Marrapodi, Applestar Productions, [email protected]

McTighe & Wiggins, (2001) Understanding by Design

Stage 1: Identify Desired Results

Established Goals What relevant goals (e.g., content standards, course or program objectives, learning outcomes) will this design address? Enduring Understandings Students will understand that… • What are the big ideas? • What specific understanding about the ideas

are desired? • What misunderstandings are predictable?

Essential Questions What provocative questions will foster inquiry, understanding, and transfer of learning?

Students will know… • What key knowledge and skills students

acquire as a result of this unit?

Students will be able to…

In what way do the knowledge and skills help students to master the enduring understandings?

Stage 2: Determine Evidence for Assessing Learning

Performance Tasks: • Through what authentic performance tasks

will students demonstrate the desired understandings?

• By what criteria will performances of understanding be judged?

Other Evidence: • Through what other evidence (e.g., quizzes,

tests, academic prompts, observations, homework, journals) will students demonstrate achievement of the desired results?

• How will students reflect upon and self-assess their learning?

Stage 3: Build Learning Plan

Learning Activities: What learning experiences and instruction will enable students to achieve the desired results? How will the design… • Help students know where the unit is going and what is expected? • Help teachers know where the students are coming from (prior knowledge, interests)? • Hook all students and hold their interest? • Equip students, help them experience the key ideas and explore the issues? • Provide opportunities to rethink and revise their understandings and work? • Allow students to evaluate their work and its implications? • Be tailored (personalized) to the different needs, interests, and abilities of learners? • Be organized to maximize initial and sustained engagement as well as effective learning?

Question

Information

1. Are expectations clearly communicated?— Clearly sent— Clearly received

2. Is there any conflict overexpectations?— Conflicting expectations— Conflicting priorities

3. Are expectations achievablegiven capabilities, resources,and constraints?— Acceptable— Attainable

4. Are there adequate role modelsof desired performance?— Appropriate or credible

models— Accessible models

5. Are there performance standards?— Clear and measurable— Reasonable and attainable

6. Do workers receive feedback?— Timely— Specific— Confirming or corrective— Work-related, not personal

7. Do workers have access torequired information?— Easy to access— Timely— Accurate and up to date— Clear and comprehensible

Tools and Resources

1. Are required equipment andtools readily available?— Reliable— Efficient— Safe

2. Are materials and suppliesavailable?— Quantity— Quality

Findings Gap Factor

¨ Lack of clarity¨ In transmission¨ In reception

¨ Conflicting expectations¨ Conflicting priorities

¨ Expectations unacceptable¨ Expectations unattainable

¨ Lack of appropriate models¨ Inaccessible role models

¨ Lack of clear, measurable performance standards¨ Immeasurable standards¨ Unreasonable standards

¨ Lack of feedback that is¨ Timely¨ Specific¨ Confirming or corrective¨ Task focused

¨ Lack of access to requiredinformation¨ Hard to access¨ Not timely¨ Inaccurate or out of date¨ Unclear

¨ Equipment or tools unavailable¨ Unreliable¨ Inefficient¨ Unsafe

¨ Lack of materials or supplies¨ Quantity¨ Quality

Recommended Actions

¨ Clarify communication ofexpectations

¨ Resolve or eliminate expectation conflicts

¨ Modify expectations

¨ Provide role models

¨ Specify or modify performancestandards

¨ Develop a feedback system

¨ Provide access to requiredinformation

¨ Provide adequate equipment ortools

¨ Provide adequate materials orsupplies

Tool 8-1. Front-End Analysis Synthesis Tool

Question

Tools and Resources (continued)

3. Is there time to perform correctly?— Amount— Timing

4. Are there adequate job aids,performance-support tools, orreference materials to facilitateperformance?

5. Is the environment supportiveof desired performance?— Physical— Administrative— Emotional

6. Is there adequate human support to monitor and encour-age desired performance?— Management or supervisory— Specialists— Co-workers

7. Are policies, processes, or procedures supportive ofdesired performance?— Available— Based on sound logic and

efficiency— Clear and comprehensible

Incentives/Consequences

1. Is compensation adequate fordesired performance?— Competitive— Fair

2. Are there appropriate financialrewards for desired performance?— Perceived as fair— Perceived as fairly

distributed— Efficiently administered

3. Are there meaningful nonpayincentives or recognition fordesired performance?— Valued by recipients— Perceived as fair

Findings Gap Factor

¨ Lack of sufficient time¨ Amount¨ Timing

¨ Lack of support materials tofacilitate performance

¨ Lack of supportive environment¨ Physical¨ Administrative¨ Emotional

¨ Lack of human support¨ Management or supervisory¨ Specialists¨ Co-workers

¨ Lack of supportive policies,processes, or procedures¨ Not available¨ Not sound¨ Not clear

¨ Inadequate compensation¨ Not competitive¨ Perceived as unfair

¨ Lack of appropriate financialrewards¨ Unfair¨ Unfairly distributed¨ Poorly administered

¨ Lack of meaningful nonpayincentives¨ Insufficient or nonexistent¨ Not valued¨ Unfair

Recommended Actions

¨ Provide sufficient time orscheduling

¨ Provide job aids, performance-support systems, or referencematerials

¨ Redesign the environment

¨ Provide human support

¨ Provide or redesign supportivepolicies, processes, or procedures

¨ Adjust compensation

¨ Provide appropriate financialrewards

¨ Provide meaningful nonpayincentives or recognition

Question

Incentives/Consequences (continued)

4. Do workers see a relationshipbetween superior performanceand career advancement?— Perceived as adequate— Perceived as fair

5. Are incentives and rewardsscheduled appropriately?

6. Are workers punished for performing correctly?— By management or

supervisors— By co-workers— By customers

7. Are workers rewarded for performing incorrectly?— By management— By co-workers— By customers

Knowledge and Skills

1. Do workers possess the essential skills and knowledgeto perform adequately?— Basic skills and knowledge— Advanced or technical skills

and knowledge— Skills and knowledge for

specific tasks

2. Are workers able to discrimi-nate between good and poorperformance?— In others— In themselves

3. Are workers smooth and “fluent” in their performance?— Speed— Smoothness

4. Do workers have sufficientopportunities to apply skills and knowledge to maintain proficiency?— Frequency— Variety

Findings Gap Factor

¨ Lack of relationship betweenperformance and careeradvancement¨ Inadequate¨ Unfair

¨ Poor timing of incentives andrewards

¨ Punishment for desirable performance¨ By management¨ By co-workers¨ By customers

¨ Rewards for undesirable performance¨ By management¨ By co-workers¨ By customers

¨ Lack of essential skills andknowledge¨ Basic¨ Advanced or technical¨ Task specific

¨ Lack of discrimination betweengood and poor performance¨ Others¨ Self

¨ Lack of performance fluency¨ Slow¨ Hesitant

¨ Lack of opportunity to maintainproficiency¨ Lack of frequency¨ Lack of variety

Recommended Actions

¨ Link career-advancementopportunities with performance

¨ Redesign timing of incentivesor rewards

¨ Eliminate punishments fordesired performance

¨ Eliminate rewards for poor performance

¨ Provide training

¨ Provide performance discrimination training withfeedback

¨ Provide practice with feedback

¨ Provide periodic practice withfeedback

Question

Capacity

1. Do workers have the requiredcapacity to perform correctly?— Personal characteristics and

values— Intellectual— Emotional— Interpersonal— Management or organiza-

tional— Physical, perceptual, or

psychomotor

2. Do workers possess requiredprerequisites to perform cor-rectly?— Education or training— Technical— Experience

3. Do workers possess appropriate political, cultural, orlinguistic capacity to performcorrectly?

4. Do workers have personal limitations that prevent themfrom performing as desired?— Family— Health or disabilities— Education— Other

Motivation

1. Do workers value the requiredperformance?— Initially— Over time

2. Are workers confident they canperform as desired?— Underconfident— Overconfident

3. Do workers feel threatened intheir work?— By management or

supervisors— By co-workers— By their work environment

4. Do workers perceive that theyare treated fairly?— In work assignments— In career advancement— In compensation— In hiring practices

Findings Gap Factor

¨ Lack of capacity to perform¨ Personal traits¨ Intellectual¨ Emotional¨ Interpersonal¨ Management¨ Physical

¨ Lack of prerequisites¨ Educational¨ Technical¨ Experiential

¨ Lack of political, cultural, or linguistic capacity

¨ Personal limitations that inhibitdesired performance¨ Family¨ Health or disabilities¨ Education¨ Other

¨ Lack of value for desired performance¨ Initially¨ Over time

¨ Lack of appropriate level ofconfidence¨ Underconfident¨ Overconfident

¨ Threatening work conditions¨ Management¨ Co-workers¨ Environment

¨ Perceived lack of fairness¨ Work assignments¨ Career advancement¨ Equity

Recommended Actions

¨ Revise selection criteria andprocedures; shift personnel ortasks to match capacity withjob requirements

¨ Select for prerequisites; train orprovide seasoning experience

¨ Select for appropriate political,cultural, or linguistic requirements

¨ Provide accommodation orresources to overcome limitations

¨ Demonstrate value

¨ Provide credible models andsupport; provide examples of consequences due to overconfidence

¨ Eliminate threats and threatening conditions

¨ Eliminate discriminatory practices; demonstrate fairnessand equity practices

Question

Task Interferences

1. Do workers perform tasks thatinterfere with desired perform-ance?— Tasks interfere— Conditions interfere

External Forces

1. Are there factors outside theworkplace that affect attain-ment of desired performance?— Economic— Cultural, political, or social— Physical— Health related

2. Are there competitive factorsthat affect attainment ofdesired performance?

3. Are there events occurring thataffect attainment of desiredresults?

Findings Gap Factor

¨ Interferences¨ Tasks¨ Conditions

¨ External factors that inhibitdesired performance¨ Economic¨ Cultural, political, or social¨ Physical¨ Health related

¨ Competitive factors

¨ External events

Recommended Actions

¨ Eliminate interfering conditions;eliminate or reassign interferingtasks

¨ Counter or accommodate forexternal factors

¨ Counter or accommodate forcompetitive factors

¨ Exploit or accommodate forexternal events