adl ’ s motif project
DESCRIPTION
ADL ’ s MoTIF Project. mLearnCon , San Jose, CA, 18-20 June 2013. Mr. Jason Haag, Research Analyst, Mobile Learning Lead The Tolliver Group, Inc. SETA Support for ADL. Mr. Peter Berking , Principal Instructional Designer Serco, Inc. SETA Support for ADL. Background and Vision. - PowerPoint PPT PresentationTRANSCRIPT
Sponsored by the Office of the Under Secretary of Defense for Personnel and Readiness (OUSD P&R)
ADL’s MoTIF ProjectmLearnCon, San Jose, CA, 18-20 June 2013Mr. Jason Haag, Research Analyst, Mobile Learning LeadThe Tolliver Group, Inc. SETA Support for ADL
Mr. Peter Berking, Principal Instructional DesignerSerco, Inc. SETA Support for ADL
| Session #7082
‣ ADL Initiative was established in 1999 by Presidential Executive Order 13111. The first two ADL Co-Labs opened in Alexandria, VA and Orlando, FL that same year.
Advanced Distributed Learning
Background and Vision
3
“Provide access to the highest quality education and training, tailored to individual needs, delivered cost effectively, anywhere and anytime.”
- ADL Vision
| Session #7084
ADL Global Reach
Canada ADL Partnership LabKingston, ON, Canada
Norway ADL Partnership Lab
Oslo, Norway
United KingdomADL Partnership Lab
Buckinghamshire,United Kingdom
Korea ADL Partnership Lab
Seoul, KoreaRomania ADL
Partnership LabBucharest, Romania
Latin America and Caribbean Regions ADL Partnership LabMexico City, Mexico
NATO ACT ADL Partnership Lab
Norfolk, VA
ADL Co-Lab Orlando, FL
Academic ADL Co-LabMadison, WI
ADL Co-Lab Alexandria, VA
ADL Center for Intelligent Tutoring Systems Research
and DevelopmentMemphis, TN
Poland ADL Partnership LabWarsaw, Poland
| Session #708 5
What a difference 8 years makes. St. Peter’s Square
Photo Source: http://instagram.com/p/W2FCksR9-e/
| Session #708 6
App Store Turns Five in 2013
Happy Birthday!
| Session #708 7
What is Mobile Learning?
8
First…What is Learning?
| Session #708 9
“Learning is acquiring new, or modifying existing, knowledge, behaviors, skills, values, or preferences and may involve synthesizing different types of information.”
- Human learning may occur as part of education, personal development, schooling, or training.
10
Definitions
Formal Learning
“Situations where the goals and means of learning are determined for the learner in advance by an external authority. It involves preplanned, prepackaged, structured experiences that are specifically designed to be consumed and assessed as ‘learning’.”
- ADL Mobile Team
11
“Only 20% of what’s learned on the job actually comes from formal learning.”
Jay Cross
12
Definitions
Informal Learning
“Situations where the goals of learning may or may not be determined by an external authority, but the means of learning are determined by the learner. It generally involves experiences that are not specifically designed in advance, by others, to be consumed and assessed as ‘learning’.”
- ADL Mobile Team
Most of what people learn (or retain and put into use) is learned as part of doing their work,
not through formal training.
| Session #708 13
Formal vs Informal Learning
Categories
Formal
Informal Autonomous
Non-formal
Informal Directed
Need for Learning & Goals
Learning Means
Content generation and access
Assessment
Authority-controlled
x x x
Learner-controlled
x
Incidental learning (as opposed to deliberative learning) is unplanned learning – learning that happens spontaneously and serendipitously in the course of everyday activities. Often the learner is not conscious that learning has occurred. All four of the above paradigms are forms of deliberative learning. Incidental learning is out of scope for ADL, because it cannot be predicted or managed.
Need for Learning & Goals
Learning Means
Content generation and access
Assessment
Authority-controlled
x x x x
Learner-controlled
Need for Learning & Goals
Learning Means
Content generation and access
Assessment
Authority-controlled
x
Learner-controlled
x x x x
Need for Learning & Goals
Learning Means
Content generation and access
Assessment
Authority-controlled
x x x
Learner-controlled
x x
| Session #708 14
70: 20: 10 Learning Framework
Morgan McCall, Robert W. Eichinger, and Michael M. Lombardo at the Center for Creative Leadership
• 70% from real life and on-the-job experiences, tasks and problem solving (day-to-day activities)
• 20% from feedback and from observing and working with role models
• 10% from formal learning or training
| Session #708 15
What is Mobile Learning?
16
ADL Describes, Not Defines
ADL Mobile Learning Team
“Leveraging ubiquitous mobile technology for the adoption or augmentation of knowledge,
behaviors, or skills through education, training, or performance support while the mobility of
the learner may be independent of time, location, and space.”
17
Definitions
Learner-focus + Device-focus = Ubiquitous Learning
Mobile Learner Mobile Device
Learner-centric
Device-
centric
| Session #708 18
Definitions
Mobile Learning Evaluation Framework (MLEF)
‣ Delphi Forum to Develop a New Definition
‣ Conducted by University of Southern Queensland
‣ http://www.sci.usq.edu.au/projects/mlef2/
19
Mobile eLearning Is NOT Mobile Learning
http://ml.adlnet.gov
20
“Think Outside the Course”
Mobile Learning Opportunities
21
Opportunities
Performance Support
| Session #708 22
| Session #70823
Desktop to Mobile Conversion
Desktop Mobile
24
Touch Is Important….BUT
http://static.lukew.com/TouchGestureGuide.pdf
| Session #708 25
26
“Never tell people how to do things. Tell them what to do, and they will surprise you with their ingenuity..”
- General George S. Patton
| Session #708
Responsive Design
The Boston Globe (Desktop Browser)
27
| Session #708
Responsive Design
28
The Boston Globe (Tablet Browser)
Responsive Design: CSS Media Queries
The Boston Globe (Mobile Browser)
29
| Session #708 30
Content Size Impact
RESPONSIVE DESIGN RESPONSIBLE DESIGN ≠
| Session #708 31
“Mobile First” Strategy
Naturally Improves Information Architecture
| Session #708 32
• What about learning? instructional objectives?
• What about performance support?• What about informal learning? • What about mobile device affordances?• What about content strategy (subject matter)?
33
edundantROT
utdatedrivial
| Session #708
| Session #70834
Low Hanging Fruit: Mobile eLearning
Desktop Mobile
| Session #708 35
The Effectiveness of Mobile Course Delivery
Research Findings
2011 Research & I/ITSEC Paper• Converted DoD-wide eLearning course
(Trafficking in Persons) to a mobile format• Limited to mobile conversion only (no change
to subject matter)• Discovered SCORM doesn’t work on mobile
browsers• Led to new research questions regarding ID
models for mobile learning (e.g., will ADDIE and ID models work?)
| Session #708 36
Mobile Learning: Not Just Another Delivery Method
Research Focus
2012 Research & I/ITSEC Paper• Literature review on the topic of learning
theories and ID models for mobile learning• ID models should be agnostic of technology
(we proposed a framework; we don’t need another model!)
• Further research is necessary to determine the mobile-specific considerations during the learning design process
• Framework Approach: high-level; strong emphasis on considering performance support and constructivist approach
| Session #708
Mobile Learning
Microstrategy(ADL)
Learning Approach
(ADL)
- Formal - Informal - Incidental - Autonomous - Directed
Instructional Tactics(Dabbagh)
- Fading… - Outlining… - Exploration...
Learning Theory
(Dick & Carey)
Cognitive Level of
Objective (Bloom's Revised
Taxonomy)
- Behaviorist - Cognitivist - Constructivist
- Create - Evaluate - Analyze - Apply - Understand - Remember
?
Type of Instructional
Objective (Gagne, Dick & Carey)
- Verbal Info - Intellectual Skill - Affective - Psychomotor
39
Bloom’s Taxonomy
Rethinking Blooms Direction
40
Bloom’s Revised Taxonomy (Kathy Shrock)
Moving Away from Linear Thinking
The interlocking of the cognitive process
| Session #708
The MoTIF Projectmo·tif [moh-teef]noun
1.a recurring subject, theme, idea, etc.2.a distinctive and recurring form, shape, figure, etc., in a design3.a dominant idea or feature
Mobile Training Implementation Framework (MoTIF)
| Session #708
The MoTIF Project
What is the problem (gap)?
Many education and training professionals are creating new mobile content and converting existing eLearning courses without consideration of:
‣ supporting alternative learning methods (e.g. performance support, spaced repetition)
‣ leveraging the capabilities of the mobile platform (e.g. camera, sensors, GPS)
| Session #708
What’s the approach to the solution?Lead a collaborative project informed by data collected from the global education and training community to investigate & determine:
• Is there a need for a design process workflow or framework?
• Is there a need to better understand how to implement alternative learning approaches as part of a mobile learning strategy?
• Is there a need to better understand mobile device capabilities used for learning?
The MoTIF Project
| Session #708
Mobile Design Process Workflow or Framework?
The MoTIF Project
| Session #708
Alternative Learning Approaches?
• Performance Support• Team-based Learning• Spaced Repetition (spaced learning)• Constructivism (discovery / experiential learning)
• Connectivism (social learning / network of connections)
• Huetagogy (learning how to learn)
The MoTIF Project
46
“Humans more easily remember or learn items when they are studied a few times over a long period of time (spaced presentation),
rather than studied repeatedly in a short period time (massed presentation)”
Will Thalheimer, PhD
Opportunities
The Spacing Effect - Hermann Ebbinghaus
‣ Promotes maternal and child health
‣ Free SMS text messages each week, timed to their due date or baby’s date of birth
47
Spaced Learning Example
Text4Baby.org
48
Two studies evaluated text messaging interventions:
1. Small trial in liver transplant patients found that a text-message medication reminder system involving children and parents reduced rates of biopsy-proven rejection.
2. Large trial found that a simple text-message intervention in which parents received up to five weekly text messages increased influenza vaccination rates in a low-income population.
Text Messaging Interventions
Consumer Health Information Technology (CHIT)
| Session #708
Device Capabilities / Affordances
• Camera (capturing video and images, augmented reality, Quick Response (QR) Code reading)
• Document viewer (eBooks, PDFs• Geolocation (GPS, geo-fencing, maps)• Internal sensors (accelerometer, barometer, compass, gyroscope, proximity)
• Media viewer / playback (images, videos, audios, podcasts)
The MoTIF Project
| Session #708
Device Capabilities / Affordances (Cont’d)
• Messaging (Short Message Service (SMS), Multimedia Message Service (MMS)
• Microphone (voice recording, podcast)• Notification (alert, sound, vibrate)• Search (discovery, quick-reference, search engine)
• Short-range communication (Bluetooth, near field communications (NFC), radio-frequency identification (RFID))
The MoTIF Project
| Session #708
Current Status• Data Collection:
• Survey (March 26 – April 26, 2013)• Focus Group & Interviews (June 2013)• Needs Analysis Report (July 2013)
• IF report / data reveals the need:• Build project site for community / stakeholders • What are the interventions/solutions (e.g.
framework & catalog of mobile learning examples)• Would the target audience & stakeholders use
them?• Refine framework & catalog based on iterative
feedback• Continue with other phases of ILDF Research
Approach
The MoTIF Project
| Session #708
What is ILDF? • Integrative Learning Design Framework (ILDF)• Developed by Dr. Brenda Bannan (George Mason
University)• Incorporates process efficiencies from multiple
disciplines:• instructional design• object oriented software development• product development• and diffusion of innovations (Rogers)
• Aims to capture the research-based knowledge relating to learning context, culture, and technology within the design process
| Session #708
What is ILDF? • Iterative design research cycles to examine deeper
aspects of: • learning, cognition• expert and novice perspectives• stakeholder and organizational policy considerations
Consists of 4 Phases:1.Informed Exploration (needs analysis)2.Enactment (intervention development)3.Local Evaluation (road test & iterative feedback
loops)4.Broad Evaluation (diffusion of innovation)
| Session #708
What is DBR?• Design-based research addresses complex problems
in educational practice for which no clear guidelines or solutions are available (Plomp, R. and Nieveen, N., 2007).
• The interventions will include such things as strategies, materials, products, and systems – as solutions to the problems
• Outcomes will include: • Domain Theories - theories about the context and
outcomes within the instructional design domain and mobile learning paradigm.
• Design Framework - a workflow process and examples that will serve as a set of design guidelines for determining a mobile learning solution or strategy.
• Design Methodologies - guidelines for how to implement the framework and the expertise that is required.
| Session #708
Preliminary Survey Results• 831 respondents• Help from many professional organizations, including
The Elearning Guild (THANK YOU!)• Wide spectrum of countries, professions, roles
represented• Preliminary findings:
• Mobile learning is not elearning• Need for best practices and design approach
guidelines• Need for examples categorized by mobile capabilities• Just-in-time performance support is best use case• Learning strategy and instructional design should be re-
evaluated• Report on findings to appear in July 2013
• Data will be made available to the public
| Session #70856
Additional Focus Areas• Mobile Learning development guidelines (for
IDs, training developers, learning technologists)
• Experience API JavaScript wrapper and prototype
• Experience API design implications for mobile• Informal learning• Spaced learning• Leveraging sensors• What SCORM functionality is needed?
• Status, score, progress, time, bookmarking
• Global objectives to enable course completion sync / equivalent between desktop & mobile
| Session #708
To Participate:
‣ http://motif.adlnet.gov
58
Resources
http://mlhandbook.adlnet.gov
58
59
Resources
Newsletter & Archive – http://ml.adlnet.gov
| Session #708 60
ADL Resources
http://ml.adlnet.gov
‣ ADL Mobile Learning Handbook, Guide, and Newsletter (Ongoing)
‣ Mobile Learning Literature Review - TSWG (2012)
‣ Mobile Learning Vendors - TSWG (2012)
‣ Mobile Access to Supplemental Learning Objects (2012) – http://academiccolab.org/maslo/
61
ADL Mobile Learning Activities, Research, Deliverables
http://ml.adlnet.gov
• Mobile Decision Path – TSWG (2013)• ADL Lexicon of Learning Terminology (2013)• Mobile Learning xAPI Prototypes (2013)• Interagency Mobile Working Group (Monthly)• ADL Webinars (monthly at adlnet.gov)• Interagency Mobile Learning Webinar Series July
16-18• Mobile Learning App Challenge!
| Session #70862
Contact Us
@ADLmobile
Peter BerkingInstructional [email protected] @pberking
Jason HaagResearch [email protected] @mobilejson