msha performance analysis briefing report presentation joe breighner allison czapracki tangie gray...
TRANSCRIPT
MSHA Performance Analysis
Briefing Report Presentation
Joe BreighnerAllison Czapracki
Tangie GrayRashmi JainAbi Jones
October 23, 2006
Agenda
Statement of Work Background Performance Analysis Overview Drivers and Barriers Preliminary Data Task Analysis Design Approach Conclusion Next Steps
Statement of Work
The overall goal of this project is to develop a systematic and effective training strategy and course lessons for underground coal mine supervisors based on
State-of-the-art instructional design principles, processes, and learning technologies
The extensive and validated mine supervisor Job Task Analysis (JTA) developed by the Mine Safety and Heath Administration (MSHA) in cooperation with the U.S. Navy
Background
50% of the electricity produced in the U.S. is fueled by coal
Background
In 2004 58.3% of coal miners were above the age of 45
In 2004, 3.4% of coal miners were under the age of 25
Coal mine positions expected to increase by 10,000 over 20 years
“[The mining industry] will need to replace a major portion, approximately 50% of the underground coal mining workforce in the next 5 to 7 years.”
Bruce Watzman, V.P. Safety, Health and Human Resources for the National Mining Association
Background
Contributing factors to personnel shortage Diminishing pool of human resources Ever-changing production methods Increasing high technology environment
“How these skills will be gained in advance of employment is a continuous challenge,” Bruce Watzman
Mine Safety & Health Administration’s (MSHA) challenge: Formalize underground coal mine supervisor training program
Background
2005-06 Research The future high turnover in the coal mine industry The lack of trained and experienced coal mine
supervisors
2006-07 Immersion team to transition training prototype to accessible online training materials
The training must be 508 compliant Developed in Workforce Connections, a Learning
Content Management System (LCMS)
Performance Analysis
The performance analysis was conducted to
Analyze and validate the prototype created by the 2005-06 MSHA Immersion Team
Propose next steps for the task analysis and content analysis phases of the project
Performance Analysis
Process Held a meeting with members of the 2005-06
MSHA Immersion Team
Collected data from subject matter experts (SME), prototype evaluations, online resources, and extant data resources
Identified gaps in last year’s prototype from SME interviews
Identified the drivers that promote the project
Identified the barriers that hinder the project
Performance Analysis
Optimal situation Mine supervisors would possess
Overall knowledge of the mining process and specific knowledge in the following areas:
Safety issues Regulations Technical skills (e.g., ventilation/fluid dynamics,
roof and rib control) Management skills Organizational skills Logical thinking Problem solving
Performance Analysis
Optimal situation (contd…)
Mine supervisors would possess the ability to Communicate effectively and develop a good
rapport with co-workers
Respond appropriately and competently during emergencies and unusual situations
Job task analysis (JTA) spiders would be translated into an engaging, practical and effective training strategy
Performance Analysis
Actual situation Expected shortage of experienced mine
supervisor candidates due to attrition Few mine supervisor training programs are
available Current training programs are mostly
On-the-Job Training (OJT) Smaller mines do not have formal training
programs
Drivers Access to
SME’s, MSHA personnel, and mine environments Extensive mine safety resources Compiled data from 2005-06 MSHA team Target audience as usability and content testers Single expert source to validate training content
High number of mining fatalities during 2006
High rate of impending retirement of experienced miners
Critical role of mine supervisors and the complexity of associated tasks
Barriers
Limitations of LCMS in light of Section 508 and SCORM compliance
Access to experienced miners and mine supervisors as usability and content testers
Development cycle restricted to academic year
Need for supplemental training, on or off-site
Barriers
“Creativity” of mine supervisors, reliance on prior knowledge
Miners showed preference for face-to-face training over online training
Ongoing MSHA administration and support of training LCMS and bulletin boards (new equipment, procedures, safety regulations)
Preliminary Data
Human Resources Stakeholder
Mr. Jeffrey Duncan, MSHA Wants a training solution with “…a
management/engineering perspective [that goes] beyond compliance to understanding”
Stressed creating online training for underground coal mine supervisors
Training to include development of six training modules for 2006-07 in Workforce Connections
MSHA will position the training as professional development for miners
Preliminary Data
Human Resources (contd…) SMEs
Formative evaluations of the 2005-06 training prototype
Interviews
Preliminary Data
Non Human Resources Hard Data Resources
MSHA Statement of Work Title 30 Code of Federal Regulations Multimedia Training Materials NIOSH Latent Imaging Exercises Colorado State Mining Exam Preparation DVD Commonwealth of Pennsylvania Mine Safety Multimedia Mine
Materials MSHA Informational Reports P&M Mine Job Task Analysis Section 508 Website
Online Resources http://www.msha.gov http://www.cdc.gov/niosh http://www.msha.gov/interactivetraining/tasktraining/index.html http://www.section508.gov
Task Analysis
Cognitive task analysis divided the twelve generic duties into two rule-using categories Procedural Principle
Further analysis of JTAs helped refine the task analyses for Pre-Shift Examination and Emergencies and Unusual Situations
Design Approach
Training Environment Proposal Visually stimulating and interactive
adaptive to the individual miner's level of experience
Customizable and flexible
Performance based
508 and Sharable Courseware Object Reference Model (SCORM) compliant
Rich with multiple views and guided scenarios
Design Approach
Web-based Electronic Performance Support System (EPSS)
Scenario-driven Strategy
Conclusion The performance analysis has provided:
An overview of the current state of the coal mining industry
A closer look at the coal mine supervisory workforce
A clearer understanding of the viability of the training prototype
Our challenge: bridging the gap between miners’ preference for “hands-on practice” and the cognitive-building advantages of computer-based training.
Next Steps
Continued Task Analysis
A continued review of extant data
A synthesis of the information collected
Work on the user interface presentation and functionality
Finalizing the instructional strategy for the entire training, as well as the multiple views and scenario based views.
Next Steps
Content Analysis
Synthesis of the information collected into applicable and appropriate training modules
Reviewing examples of MSHA courses in Workforce Connections
Selecting appropriate scenarios for the different lesson topics
Developing appropriate objectives and instructions to guide users through the modules
MSHA Performance Analysis
Briefing Report Presentation
Joe BreighnerAllison Czapracki
Tangie GrayRashmi JainAbi Jones