1 multichannel learning system (mls) collaboration working group ms janie glover deputy director,...
TRANSCRIPT
![Page 1: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/1.jpg)
1
Multichannel Learning System (MLS)Collaboration Working Group
Ms Janie GloverDeputy Director, Technical DirectorNaval Education & Training Security Assistance Field Activity (NETSAFA)MLS Project Manager
![Page 2: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/2.jpg)
AGENDA – DAY 1
2
![Page 3: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/3.jpg)
AGENDA – DAY 2
3
![Page 4: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/4.jpg)
MLS PROJECT US STAKEHOLDERS
4
![Page 5: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/5.jpg)
SECNAV
USMCMCSCG
USCG/IA
ASN RD&A
NAVY IPO
SECDEF
DSCA
INTERNATIONAL POLICY
MARITIME ENGAGEMENT MANAGEMENT
N E T S A F ANAVAL EDUCATION AND TRAINING SECURITY ASSISTANCE FIELD ACTIVITY
Develop, execute and manage the Department of Navy’s
Security Assistance and Security Cooperation training and
education programs that support the U.S. security strategy in
building partner capacity to build and strengthen enduring
international partnerships.
NETSAFA MISSION & RELATIONSHIPS
![Page 6: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/6.jpg)
N E T S A F ANAVAL EDUCATION AND TRAINING SECURITY ASSISTANCE FIELD ACTIVITY
Country Teams
CTFP/CD/I-MET/1206
COCOM / NCC
Material Cases
Req
uirem
ents / P
riorities
Mobile Teams
Flight Training
Mission Training
Technical Training
PME
NETSAFA’S ROLE
![Page 7: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/7.jpg)
DepartmentOf Defense (DoD)
Defense SecurityCooperation Agency
(DSCA)
Defense Instituteof Security AssistanceManagement (DISAM)
Defense Instituteof International
Legal Studies (DIILS)
DEFENSE INSTITUTE OF SECURITY ASSISTANCE MANAGEMENT (DISAM)
![Page 8: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/8.jpg)
DISAM MISSION STATEMENT
• The Defense Institute of Security Assistance Management provides professional education, research, and support to advance U.S. foreign policy through Security Assistance and Cooperation.
Tasks• Resident, non-resident, and online courses
• Seminars and tutorials
• Research, consultation, studies
• Information dissemination
![Page 9: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/9.jpg)
IMS PRE-DEPARTURE BRIEFING
International Military Student Pre-Departure Briefing (IMSPDB)
• For all International Military Student (IMS) selected to attend training in U.S.
• Security Cooperation Offices (SCOs) tasked with ensuring IMS are briefed
• Minimum content spelled out in Joint Security Cooperation Education and Training regulation (JSCET)
![Page 10: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/10.jpg)
JOINT KNOWLEDGE ONLINE (JKO)
On behalf of the Joint Staff J7, JKO develops and delivers online joint training to prepare and assist individuals to support joint and coalition operations.
• Provide 24/7 global access to JKO Portals to deliver cost effective, and efficient training using state-of-the-art technology.
• Develop and deliver Web-based joint training products, courses, tailored curricula, small group staff training and immersive mission scenario culture and language training per the requirements of the Secretary of Defense, the Joint Chiefs of Staff, the Combatant Commands, and other JKO Stakeholders.
• Track, document and report DoD-wide individual joint training completed in order to meet DoD/Combatant Command mandatory training requirements, and Service retirement / promotion or joint credit criteria.
10
![Page 11: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/11.jpg)
JKO TRAINING PLATFORM
11
Tier III – Expand Access
Tier II – Enhance Learning with Advanced Technology
Mobile Learning
Interactive D
esktop S
imulation
JKO Portals
Virtual Cultural Awareness Trainer Small Group Scenario Trainer
JKO
Co
ntent M
an
age
me
nt A
rchitecture
First Level Web-based
Courses
JKO Portals
Learning ContentManagement
System
Web-based Courseware Authoring
Tool
Tier I – Deliver Global, Distributed Learning Capability
![Page 12: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/12.jpg)
Continuous Learning (711HPW/RHAS)
• Develop mission relevant content for learning
• Measure training outcomes in complex mission environments
• Accelerate development of mission critical competencies
• Optimize training value of live, virtual, and constructive environments
Air Force Research Laboratory (AFMC)
711 Human Performance Wing Human Effectiveness (RH) Warfighter Readiness Research Division (RHA)
![Page 13: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/13.jpg)
Metrics and scenarios•Tailored needs assessment/gap analyses•Cross-domain readiness assessment•Proficiency tracking and feedback
Proficiency-based training•Evidence-based fidelity assessments•Cross domain after-action reviews•Team and team-of-teams assessment•Family of complementary trainers
Adaptive, distributed content and assessment•Scenario authoring, scripting, and metrics definition
standards•Common data exchange, control, management
•Managed learning/feedback across LVC contexts
Globally distributed learning•Seamless integration of LVC environments and players•Adaptive training and operational environments•Portable, personal learning and occupational records•Predictive performance models anticipate
gaps/refreshers
Where We Are Going: Game Changing Learning S&T
Near
Mid
Far
![Page 14: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/14.jpg)
Learning Opportunities
What/How to Measure
Data
FEEDBACK
AAR
Adaptation
Readiness/Proficiency Monitoring
Record Measure
Diagnosis
Warehousing What was
learned Where How much How often
Approach for Continuous Learning
Adapt Conditions Based on Performance
& Diagnosis
Competencies Knowledge Skills Experiences Gaps …
OBJECTIVES
CONDITIONS
ASSESSMENT
Match Opportunities to Objectives
Scenarios Instructional Events Structure & Triggers Strategies & Principles
Support resources
Match Measures to Objectives & Conditions
Individual/Team/Team of TeamsObjective and Subjective
![Page 15: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/15.jpg)
OTHER US ORGANIZATIONS
• ADL Co-Lab• Office of Naval Research Global (ONRG)• Office of Naval Research (ONR) Reserve Component
(RC)• U.S. Naval Space & Warfare Systems Command Pacific
(SPAWAR Pacific)
15
![Page 16: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/16.jpg)
MLS PROJECT GOALS, OBJECTIVES & DELIVERABLES
16
![Page 17: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/17.jpg)
MLS VISION
17
![Page 18: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/18.jpg)
MLS GOALS
• Evaluate the effectiveness of using multiple learning technologies (i.e., web-based e-learning, mobile apps, etc.) to support learning objectives
• Assess the interoperability between U.S. and foreign partners learning management systems and their ability to meet Joint Security Cooperation Education and Training regulation (JSCET) training, information sharing, collaboration and coalition interoperability requirements
18
![Page 19: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/19.jpg)
MLS OBJECTIVES
• Evaluate the learning effectiveness of using learning technologies (web-based e-Learning, mobile applications, etc.) to support joint, interagency, intergovernmental and multinational (JIIM) education and training requirements.
• Assess the interoperability of the US and foreign partners learning management systems to meet US/USG training, information sharing, and collaboration, and coalition interoperability requirements
• Ensure that international partners have access to courses via DoD e-learning systems in accordance with Security Cooperation requirements
19
![Page 20: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/20.jpg)
MLS DELIVERABLES
• Provide e-learning courses in both the web-based and mobile app formats
• The infrastructure to permit informed decision on the best delivery methodology for international partners
• The capability of tracking courseware related content via partner LMS’ will be available via web services from the existing Joint Knowledge Online (JKO) coalition training capability.
• A legally compliant and integrated tracking with partner Learning Management Systems (LMS) and JKO Mobile courses/content required to support US and its partners that comply with Security Cooperation requirements
20
![Page 21: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/21.jpg)
MLS WORKING GROUPS
21
![Page 22: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/22.jpg)
LEARNING CONTENT WORKING GROUP
• Ensure the learning courses are developed according to the optimum format (e.g., audio course, e-course, apps, etc.) to meet the learning objectives
• Identify the delivery formats to support just-in-time learning complements traditional training and education systems as well as more of a “personal assistance for learning” approach
22
![Page 23: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/23.jpg)
TECHNOLOGY & INTEROPERABILITY
• Develop content, based on US-customer needs, to support a multichannel learning approach (e.g., web-based, mobile applications, etc.) content.
• Demonstrate the capability to incorporated a multichannel, multinational distributed learning architecture that uses the Joint Knowledge Online Internet Public (JKO-IP) for both web-based and mobile learning applications.
• Make recommendations on how the lessons learned may be used to support future DoD and other USG International Military Student Predeparture Training Requirements.
23
![Page 24: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/24.jpg)
TESTING & EVALUATION
• Conduct an evaluation of a multichannel learning approach (e.g., web-based, mobile applications, etc.) to evaluate the effectiveness of providing a ‘personal assistance to learning (PAL)’ approach.
• Evaluate the interoperability between US/International Learning Management Systems to support training and education needs and requirements.
• Make recommendations on how the lessons learned may be used to support DoD and other USG International Military Student Predeparture Training Requirements.
24
![Page 25: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/25.jpg)
MLS RESEARCH PROTOCOL DISCUSSION
25
![Page 26: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/26.jpg)
HUMAN RESEARCH PROTOCOL GUIDING PRINCIPALS
26
• US Directives :• 32 CFR 219• DoD Directive 5400.11• DoD Directive 3216.2• DoD Instruction 3210.7• SECNAVINST 3900.39D
• UK Ministry of Defence (MoD) Ethics JSP 536
• EU Directives:• Ethical Review in Seventh Framework Programme (FP7)• EU Directive 95/46/EC• Guidance for Informed Consent
• Canada Tri-council Policy Ethical Conduct for Research involving Humans
![Page 27: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/27.jpg)
PRIVACY OF INDIVIDUALS
DoD Directive 5400.11 (DoD Privacy Program)
• The privacy of an individual is a personal and fundamental right that shall be respected and protected
DoD Directive 3216.2 (Protection of Human Subjects in DoD-Supported Research)
• …specifies authority for protecting the rights and welfare of human beings “used as subjects of study” in DoD-supported RDT&E
• …identifies the requirement that US DoD-support research efforts must also meet the requirements of other countries when the research is conducted outside the US
27
![Page 28: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/28.jpg)
PROTECTION OF HUMAN SUBJECTS
32 CFR 219 (Sec 219.101):
Unless otherwise required by department or agency heads, research activities in which the only involvement of human subjects will be in one or more of the following categories are exempt from this policy:
(1) Research conducted in established or commonly accepted educational settings, involving normal educational practices, such as (i) research on regular and special educational instructional strategies, or (ii) research on the effectiveness of or the comparison among instructional techniques, curricula, or classroom management methods
28
![Page 29: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/29.jpg)
“INFORMED CONSENT IS NOT JUST ABOUT PATIENTS”
EU Data Protection Requirements:
“From a data protection and privacy issues points of view, all study participants present in a research project need to be informed about the planned research use of the collected data independently of they type of data collected
If a survey is planned within a project, participant need not only to be informed of how their personal data is planned to be handled, but also provide appropriate authorization. The design of the survey must guarantee that only data specifically required for the purpose of the research project will be gathered (unless clearly stated otherwise).”
29
![Page 30: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/30.jpg)
PARTICIPANT TOTALS (MoLE PROJECT)
30
• Launched: 268• Started Proof of Concept: 177 (66.4%)• Completed Proof of Concept: 137 (51.12%)
• Original sample design: 30 per country• Minimum number per country: 28• Minimum sample design: 234
![Page 31: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/31.jpg)
PROJECT INTERACTION
31
![Page 33: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/33.jpg)
LINKEDIN COLLABORATION
33
![Page 34: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/34.jpg)
WORKSHOP EXPECTATIONS
34
![Page 35: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/35.jpg)
WORKSHOP EXPECTATIONS
• Ensure each participant understands the ‘new focus’ since it is no longer a CWP project
• Obtain each organization’s requirements/capabilities in lieu of the aforementioned change
• Collaboration on how to ‘effectively’ evaluate multichannel learning (i.e., web based and mobile apps)
• Develop a shared understanding of participant expectations for the MLS Proof of Concept (PoC)
• Determine if/how many partners will remain with the project to provide the best delivery methods/channels for the IMSPDB content
35
![Page 36: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/36.jpg)
PROJECTED MLS SCHEDULE
• May 2013: Requirements & Capabilities Workshop
• Oct/Nov 2013: MLS Kick-off Workshop
• Apr 2014: MLS Proof of Concept (PoC) Workshop
• May/Jun 2014: MLS Proof of Concept
• Aug 2014: MLS Final Presentation of Results
36
![Page 37: 1 Multichannel Learning System (MLS) Collaboration Working Group Ms Janie Glover Deputy Director, Technical Director Naval Education & Training Security](https://reader035.vdocument.in/reader035/viewer/2022062516/56649e115503460f94afd4d9/html5/thumbnails/37.jpg)
QUESTIONS/COMMENTS
37