HLA/SCORM PROTOTYPEHLA/SCORM PROTOTYPE

FINAL REPORTFINAL REPORT

PROJECT REVIEWPROJECT REVIEW

BackgroundBackground5,100 active duty Marine Captains5,100 active duty Marine CaptainsReserve Captains and some SNCOsReserve Captains and some SNCOsEWS schoolhouse can only accommodate EWS schoolhouse can only accommodate

190 students each year190 students each yearRemaining students use Seminar or Individual Remaining students use Seminar or Individual

Guided Study (IGS) distance education Guided Study (IGS) distance education program (DEP)program (DEP)

PROJECT GOALPROJECT GOAL

Provide a richer, more robust learning Provide a richer, more robust learning environment to DEP studentenvironment to DEP student

PROJECT TEAMPROJECT TEAM

Anteon – SCORM 2004 contentAnteon – SCORM 2004 content

mGen – SCORM 2004 LMSmGen – SCORM 2004 LMS

MAK Technologies – MAGTF-XXIMAK Technologies – MAGTF-XXI

PROJECT COMPONENTSPROJECT COMPONENTS

SCORM 2004 conformant instruction SCORM 2004 conformant instruction

SCORM 2004 conformant LMSSCORM 2004 conformant LMS

HLA-compliant MAGTF-XXI simulation HLA-compliant MAGTF-XXI simulation

Distance LearningDistance Learning

ISD vs. Simulation ISD vs. Simulation ISD ISD andand Simulation SimulationThree SCOs excerpted from the Three SCOs excerpted from the

schoolhouse MCPP curriculumschoolhouse MCPP curriculumPractical exercises and AssessmentsPractical exercises and AssessmentsCooperative instructionCooperative instructionSCORM 2004 conformantSCORM 2004 conformant

DeliveryDelivery

Simulation dataSimulation dataHuge volumes of dataHuge volumes of dataProprietary encodingProprietary encoding

Runtime data availability to groups of Runtime data availability to groups of studentsstudents

Solution:Solution:Create a repository location with read/write Create a repository location with read/write

access for studentsaccess for studentsStore the location as a session variableStore the location as a session variable

SimulationSimulation

HLA-compliant MAGTF-XXI simulation HLA-compliant MAGTF-XXI simulation Virtual multi-player capabilityVirtual multi-player capability

Additional requirements:Additional requirements:Record parameters for game – Host vs. ClientRecord parameters for game – Host vs. ClientTransfer/download scenario filesTransfer/download scenario filesLaunch into a scenario from a web pageLaunch into a scenario from a web pageCollect data from gameCollect data from gameRead XML and ‘Save on Exit’ added to Read XML and ‘Save on Exit’ added to

MAGTF v2.8MAGTF v2.8

AchievementsAchievements

Launched simulation in multi-player Launched simulation in multi-player environment from a SCOenvironment from a SCO

Captured data from simulationCaptured data from simulationSequenced contentSequenced contentDemonstrated collaborative training using Demonstrated collaborative training using

simulationsimulationTransferred scenarios for a variety of PEsTransferred scenarios for a variety of PEs Implemented mGen’s SCORM 2004 LMS Implemented mGen’s SCORM 2004 LMS

with simulation capabilitywith simulation capability

DEMODEMO

mGen LMSmGen LMSContentContentSimulationSimulation

Next stepsNext steps

Develop paper for I/ITSEC 2006Develop paper for I/ITSEC 2006DemosDemos

I/ITSEC 2005I/ITSEC 2005Seminar EWS Distance Education ProgramSeminar EWS Distance Education Program Independent Guided StudyIndependent Guided Study

More researchMore researchStudent rolesStudent rolesUse of AARsUse of AARsUpload Log filesUpload Log files

Questions / Feedback / IdeasQuestions / Feedback / Ideas

IMPLEMENTATION PLANIMPLEMENTATION PLAN

IntroductionIntroduction Identification Identification System overviewSystem overviewDocument overviewDocument overview

Applicable DocumentsApplicable DocumentsVersion DescriptionVersion Description

InstallationInstallationRecommended EnvironmentRecommended EnvironmentLaunching Launching

REVIEW SOWREVIEW SOWPrototypePrototype Sharable Content ObjectsSharable Content Objects

Contractor shall repurpose portions of an existing course following the Instructional Systems Contractor shall repurpose portions of an existing course following the Instructional Systems Design model. Content shall be of sound instructional design and include engaging Design model. Content shall be of sound instructional design and include engaging multimedia. At a minimum, the development of a Sharable Content Object (SCO) that multimedia. At a minimum, the development of a Sharable Content Object (SCO) that conforms to the specifications of SCORM 1.2 is required. The use of draft SCORM 2004 is conforms to the specifications of SCORM 1.2 is required. The use of draft SCORM 2004 is encouraged if an LMS can be identified to support it.encouraged if an LMS can be identified to support it.

Deliverables: Instructional Design Plan, storyboards, source code and/or files for the Deliverables: Instructional Design Plan, storyboards, source code and/or files for the instructional content including SCORM content packaging manifest and support files.instructional content including SCORM content packaging manifest and support files.

Simulation/ScenarioSimulation/Scenario Contractor shall develop a scenario that emphasizes learning objectives taught in the SCOs. Contractor shall develop a scenario that emphasizes learning objectives taught in the SCOs.

The scenario shall allow students to practice and apply concepts and processes as an The scenario shall allow students to practice and apply concepts and processes as an extension of the training. Contractor shall employ an existing credible HLA-compliant extension of the training. Contractor shall employ an existing credible HLA-compliant simulation asset in the development of this prototype. simulation asset in the development of this prototype.

Deliverables: MAGTF-XXI executable with the associated scenario files.Deliverables: MAGTF-XXI executable with the associated scenario files.

Learning Management SystemLearning Management System Contractor shall employ an existing Learning Management System (LMS) that minimally Contractor shall employ an existing Learning Management System (LMS) that minimally

conforms to Sharable Content Object Reference Model (SCORM) version 2004 as conforms to Sharable Content Object Reference Model (SCORM) version 2004 as described in the appropriate documents at www.ADLnet.org. described in the appropriate documents at www.ADLnet.org.

Deliverables: Source code and/or files for any middleware or other software specifically Deliverables: Source code and/or files for any middleware or other software specifically developed for demonstration of the prototype.developed for demonstration of the prototype.

REVIEW SOWREVIEW SOWShared AssetsShared Assets Contractor shall design and develop shared assets to facilitate Contractor shall design and develop shared assets to facilitate

communication between the SCORM and HLA. The shared assets shall be communication between the SCORM and HLA. The shared assets shall be capable of initializing a simulation, launching a scenario, and returning capable of initializing a simulation, launching a scenario, and returning performance criteria on the student. This/these assets shall be capable of performance criteria on the student. This/these assets shall be capable of receiving and sending data in a format compatible with both HLA and receiving and sending data in a format compatible with both HLA and SCORM. SCORM.

Deliverables: Launcher and Collector applications and any required meta-Deliverables: Launcher and Collector applications and any required meta-data necessary for launching simulations or defining evaluation criteria.data necessary for launching simulations or defining evaluation criteria.

Implementation PlanImplementation Plan Contractor shall develop an implementation plan to capture installation Contractor shall develop an implementation plan to capture installation

instructions, the recommended training environment, and instructions on instructions, the recommended training environment, and instructions on launching the SCOs within an LMS. launching the SCOs within an LMS.

Deliverable: Implementation Plan Deliverable: Implementation Plan

REVIEW SOWREVIEW SOWPrototype DemonstrationPrototype Demonstration Contractor shall provide all licenses, software and hardware necessary to Contractor shall provide all licenses, software and hardware necessary to

establish the final prototype demonstration in the Joint ADL Co-Lab. establish the final prototype demonstration in the Joint ADL Co-Lab. Contractor shall document the actions and outcomes of the prototype Contractor shall document the actions and outcomes of the prototype demonstration.demonstration.

Deliverable: Meeting minutes within one week of prototype demonstrationDeliverable: Meeting minutes within one week of prototype demonstration

DocumentationDocumentation At the conclusion of the HLA/SCORM prototype development, delivery, and At the conclusion of the HLA/SCORM prototype development, delivery, and

testing, a final analysis document shall be provided which captures all testing, a final analysis document shall be provided which captures all relevant processes, decision points, considerations, and conclusions that relevant processes, decision points, considerations, and conclusions that resulted from this effort. Recommendations and lessons learned will be resulted from this effort. Recommendations and lessons learned will be described. This documentation is intended to provide insight and information described. This documentation is intended to provide insight and information to further the process of integrating HLA-compliant simulations with to further the process of integrating HLA-compliant simulations with SCORM-conformant courseware. SCORM-conformant courseware.

Deliverable: Final Technical Report Deliverable: Final Technical Report

TECHNICAL REPORTTECHNICAL REPORT

ADL/HLA Integration Research BlueprintADL/HLA Integration Research Blueprint ““The prospect of integrating ADL SCORM courseware The prospect of integrating ADL SCORM courseware

and HLA simulations raises a number of and HLA simulations raises a number of technological, instructional and programmatic issues:”technological, instructional and programmatic issues:”

Will a simple technical approach work for all cases?Will a simple technical approach work for all cases? Can the use case be supported from an instructional Can the use case be supported from an instructional

perspective without changing the SCORM or HLA perspective without changing the SCORM or HLA specification? specification?

If specifications changes are required, what are they and If specifications changes are required, what are they and how long will they take to vet through the standards how long will they take to vet through the standards communities? communities?

Are the use cases realistic?Are the use cases realistic?

TECHNICAL REPORTTECHNICAL REPORT Project SummaryProject Summary

PurposePurpose BackgroundBackground

Prototype Use CasePrototype Use Case Technical ReportTechnical Report

SCORM 2004 Conformant CoursewareSCORM 2004 Conformant Courseware Shared AssetsShared Assets Simulation and ScenariosSimulation and Scenarios SCORM 2004 Learning Management SystemSCORM 2004 Learning Management System

Lessons LearnedLessons Learned Future activitiesFuture activities ConclusionConclusion

LESSONS LEARNEDLESSONS LEARNED True R&D has known and unknown schedule risks.True R&D has known and unknown schedule risks.

Stay use case focusedStay use case focused Use Case needs to be referred at each stage of development. Use Case needs to be referred at each stage of development.

Keep the Warfighter in mindKeep the Warfighter in mind MAGTF-XXI instruction is a prerequisite to this course. MAGTF-XXI instruction is a prerequisite to this course. The learner environment and target audience must be The learner environment and target audience must be

considered when introducing this technology.considered when introducing this technology.

LESSONS LEARNEDLESSONS LEARNED Minimize collateral impactMinimize collateral impact

Extending the data model for this project would have Extending the data model for this project would have reduced the impact of the technical achievements.reduced the impact of the technical achievements.

Simulation data requirements need to be analyzed Simulation data requirements need to be analyzed using instructional design methodsusing instructional design methods

Several group instructional strategies exist. To focus Several group instructional strategies exist. To focus on extending the data model for cooperative-based on extending the data model for cooperative-based training only would be too narrow training only would be too narrow

FAILURESFAILURES

Future Requirement – Uploading the scenario Future Requirement – Uploading the scenario files after each practical exercise or after the files after each practical exercise or after the COA gameCOA game

FUTUREFUTURE

Group coordinationGroup coordination: : A future version of the prototype would investigate ways to A future version of the prototype would investigate ways to

manage and link the group members in a more coordinated manage and link the group members in a more coordinated fashion. LMS group assignment, a multi-player lobby, and fashion. LMS group assignment, a multi-player lobby, and coordinated launch of a simulation or SCOs would enrich coordinated launch of a simulation or SCOs would enrich and simplify the distance learning experience.and simplify the distance learning experience.

There needs to be more work performed in the area of There needs to be more work performed in the area of requesting a shared URL for a specific group of learners requesting a shared URL for a specific group of learners within a simulation. within a simulation. I.E. Request a shared URL repository for.I.E. Request a shared URL repository for. Section: HLA Simulation 101Section: HLA Simulation 101 Content: Red-Blue SimulationContent: Red-Blue Simulation Specific Users: Joe, Mary, Larry, MikeSpecific Users: Joe, Mary, Larry, Mike

FUTUREFUTURE

Simulation data variablesSimulation data variables. . The Launcher and Collector assets could be extended to The Launcher and Collector assets could be extended to

enable a variable set of objectives and measurements to enable a variable set of objectives and measurements to be sent to the simulation and more detailed assessment be sent to the simulation and more detailed assessment data to be returned. data to be returned.

Extended data model prototypeExtended data model prototype. . Establishing a prototype environment which included Establishing a prototype environment which included

extensions would allow prototype research and extensions would allow prototype research and development to more quickly discover benefits and development to more quickly discover benefits and limitations. limitations.

FUTUREFUTURE

Data model extensions:Data model extensions: Simulation dataSimulation data. Mapping HLA specifications to . Mapping HLA specifications to

instructional design methodologies may be a first step instructional design methodologies may be a first step toward a closer linking of the two standards. toward a closer linking of the two standards.

Performance metricsPerformance metrics. The SCORM standard needs to . The SCORM standard needs to have the capability to record performance metrics in a have the capability to record performance metrics in a more detailed cross learner nature. SCORM has no more detailed cross learner nature. SCORM has no support for comparing learner’s performance and content support for comparing learner’s performance and content effectiveness with a trending model.effectiveness with a trending model.

FUTUREFUTURE

Data model extensions:Data model extensions: Course evaluationCourse evaluation. Provide a way to evaluate the . Provide a way to evaluate the

learning activity as a whole unit of instruction and supply learning activity as a whole unit of instruction and supply valuable trending feedback to an evaluator. valuable trending feedback to an evaluator.

Content evaluationContent evaluation. This cluster could instruct the LMS . This cluster could instruct the LMS on what sections of the activity tree will record detailed on what sections of the activity tree will record detailed learner performance information: Pass, Fail, or Score.learner performance information: Pass, Fail, or Score.

Expected activity dataExpected activity data. Provide information about the . Provide information about the type of data produced by each activity, i.e. time, score, type of data produced by each activity, i.e. time, score, pass/fail, or none. pass/fail, or none.

FUTUREFUTURE

Data model extensions:Data model extensions: Extend SCORM Standards by adding API CallsExtend SCORM Standards by adding API Calls

The simulation required a repository for runtime data and The simulation required a repository for runtime data and common data between users.common data between users.

New API call to request a unique repository URL based upon “User-New API call to request a unique repository URL based upon “User-Content-Section” of learning Content-Section” of learning

New API call to request a shared repository URL based upon New API call to request a shared repository URL based upon “Content-Section” of learning“Content-Section” of learning

New API call to request a shared repository URL based upon New API call to request a shared repository URL based upon “Section” of learning“Section” of learning

Server response to the API would create a new folder on Server response to the API would create a new folder on the server and with permissions to allow for HTTP – the server and with permissions to allow for HTTP – PUT, WEB DAV writes and HTTP GETs to the folder. PUT, WEB DAV writes and HTTP GETs to the folder.