human and automation integration considerations for uav systems prof. r. john hansman roland weibel...
TRANSCRIPT
![Page 1: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/1.jpg)
Human and Automation Integration Considerations for UAV Systems
Prof. R. John Hansman
Roland Weibel
MIT International Center for Air TransportationDepartment of Aeronautics & Astronautics
![Page 2: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/2.jpg)
Possible Commercial UAVApplications - Motivation
Remote Sensing Meteorology Scientific Research Aerial Photography/ Mapping Pipeline Spotting Disaster Monitoring Agriculture
Surveillance Border Patrol Homeland Security/ Law Enforcement Traffic Monitoring Search and Rescue
Data Delivery Communications Relay Multimedia Broadcast
Cargo Transport
![Page 3: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/3.jpg)
Possible Military UAVMissions - Motivation
Intelligence Reconnaissance Target Monitoring Forward Air Control Electronic Warfare Search and Rescue Battle Damage Assessment (BDA)
Offensive Operation Suppression of Enemy Air Defenses (SEAD) Close Air Support Deep Strike
Cargo Transport
![Page 4: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/4.jpg)
Current Unmanned Aerial Vehicles
![Page 5: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/5.jpg)
Ceiling
![Page 6: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/6.jpg)
Takeoff Method
Hand-launched: Aerovironment Pointer
Rocket-Assisted: Hunter UAV
Rail-Launched: Sperwar
Tilt-Rotor: Eagle Eye
Runway Takeoff: X-45 UCAV
![Page 7: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/7.jpg)
Basic Supervisory ControlArchitecture
![Page 8: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/8.jpg)
UAV Operation BasicFunctional Architecture
![Page 9: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/9.jpg)
Pointer UAV
Used for Short-Range Surveillance Battlefield commanders Law Enforcement
Vehicle Capabilities Manual Control Autopilo Sensor Integration and Display Loss of Link Return to Base
Bandwidth Requirements Transmission of Vehicle Commands Receipt of Sensor Intelligence, Vehicle State
![Page 10: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/10.jpg)
Pointer UAV Tasking & Control
![Page 11: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/11.jpg)
![Page 12: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/12.jpg)
![Page 13: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/13.jpg)
![Page 14: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/14.jpg)
Conventional HAE UAV(Tier II Plus) Concept
![Page 15: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/15.jpg)
Global Hawk Mission ControlElements
![Page 16: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/16.jpg)
Global Hawk MCE
![Page 17: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/17.jpg)
Boeing X-45 UCAV
![Page 18: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/18.jpg)
![Page 19: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/19.jpg)
![Page 20: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/20.jpg)
X-45A Block 1 Flight Demo SummaryCompleted 28 Feb 03
Air Vehicle 1 Total number of flights: 14 Total Flight Time: 11.6 hours Envelope expansion, 4D Nav,
loss-of-comm and C2 demos Air Vehicle2
Total number of flights: 2 Total AV2 Flight Time: 1.2 hours
48 of 48 ground and flight demonstrations complete Currently conducting check-out flight/ground tests for Block 2 de
monstrations
![Page 21: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/21.jpg)
X-47 Pegasus Flight SummaryConducted 23 Feb 03
X-47 First Flight Flight Time: 12 minutes Simulated a tailhook arrestment
point on a carrier flight desk bylanding near a predesignatedtouchdown point
Utilized shipboard-relativeglobal positioning satellite(SRGPS) system as the primarynavigation source for increasedlanding precision
![Page 22: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/22.jpg)
SurveillanceOperational System
![Page 23: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/23.jpg)
UAV-Related Human FactorsIssues - (Partial List)
Allocation/ Level of Autonomy Bandwidth/ Latency Situation Awareness Cognitive Complexity Limitations
Single & Multiple UAVs Information Saturation/ Boredom Simulator Sickness Operator Orientation Confusion Culture Resistance Judgment
Acceptable Risk Weapons Release Authorization
![Page 24: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/24.jpg)
UAV Task Analysis
Situation (Battlespace)Awareness
Perception Comprehension Projection
Diagnosis Environment Threat Targets
Strategic Planning/Re-planning
Goal Management Route planning
Tactical Decisions Weapons Authorization Avoidance of Hazards Systems Management
Control Navigation Aircraft Configuration Sensor Operation
Monitoring
Vehicle Health External Environment Risk Assessment Communications Link Sensor Data
Communication Current State Intent Intelligence Tasking
![Page 25: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/25.jpg)
AFRL Levels of Autonomy
1. Remotely Guided
2. Real Time Health Diagnosis
3. Adapt to Failures & FlightConditions
4. Onboard Route Replan
5. Group Coordination
6. Group Tactical Replan
7. Group Tactical Goals
8. Distributed Control
9. Group Strategic Goals
10. Fully Autonomous Swarms
![Page 26: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/26.jpg)
Level of Autonomy Trend
![Page 27: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/27.jpg)
Intelligent System Capability Development
![Page 28: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/28.jpg)
UAV Design Space - Military
![Page 29: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/29.jpg)
Diagnosis Procedure Role
![Page 30: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/30.jpg)
Endsley Situation Awareness Model
![Page 31: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/31.jpg)
Bandwidth Limits
![Page 32: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/32.jpg)
Bandwidth Limit
Voice ATC Comm, Comm to Ground
Manual Control Commands
Waypoint/ Tasking Commands
Video Forward View, Surveillance
Imagery Reconnaissance, Target Selection
Voice ATC Comm, Intelligence
Schematic Data System Health, Location
![Page 33: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/33.jpg)
Task Performance & Bandwidth
![Page 34: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/34.jpg)
Communications LatencyProblems
![Page 35: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/35.jpg)
Multiple Vehicle Control
Situation Awareness “Big Picture” Overview of Battlefield Orientation Confusion Multiple Reference Frames N Vehicle states N Vehicle status Kindergarten Model
Human/ Machine Allocation Level of Vehicle Autonomy Need for Higher Level of Abstraction (Macro vs Micro Management) Organizational vs Operator Model Directed vs Behavioral Automation Dynamic re-allocation
Cognitive Workload – Taskload How many vehicles can be reliably managed Cognitive Complexity Limitations ATC Analogy (Acceptable Level of Traffic)
![Page 36: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/36.jpg)
Complexity Concepts &Controller Process Model
![Page 37: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/37.jpg)
Human-System InterfaceIssues
Interface Comparison - UAV vs Commercial DARPA USAF Boeing X-45 Example Boeing B-777
Source: Build 2 Operational Simulation Overview Briefing Caveats:
Prototype not operational system Briefing may not reflect actual system PC based interface
![Page 38: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/38.jpg)
![Page 39: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/39.jpg)
X-45Primary Flight Display (PFD)
![Page 40: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/40.jpg)
Commercial B-777Primary Flight Display (PFD)
![Page 41: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/41.jpg)
Quiet Dark Philosophy
Reduction of Clutter No indications for
“normal” No “ON” indicators No indications for
“do nothing” Indicate limits, not
normal range
![Page 42: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/42.jpg)
![Page 43: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/43.jpg)
Example: Flight Automation
Mode Awareness is becoming a serious issues in Complex Automation Systems
automation executes an unexpected action (commission), or fails to execute an action (omission) that is anticipated or expected by one or more of the pilots
Multiple accidents and incidents Strasbourg A320 crash: incorrect vertical mode
selection Orly A310 violent pitchup: flap overspeed B757 speed violations: early leveloff conditions
Pilot needs to Identify current state of automation Understand implications of current state Predict future states of automation
![Page 44: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/44.jpg)
![Page 45: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/45.jpg)
Type of Intelligent Systems
Coaches try to make you better at what you do
Associates automatically help with tasks
Associates do what you ask them to do
Experts do what they know how to do
![Page 46: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/46.jpg)
Decision Aiding System (DAS)Functionality Overview
![Page 47: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/47.jpg)
Decision Aiding Notional Software Architecture
![Page 48: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/48.jpg)
Knowledge Engineering Process
![Page 49: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/49.jpg)
Domain Ontology (Knowledge Categories)
![Page 50: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/50.jpg)
Relational Database Organizes Domain Ontology
![Page 51: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/51.jpg)
Plan-Goal Graphs Describe System Purpose
![Page 52: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/52.jpg)
Concept Graphs Describe the Situation
![Page 53: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/53.jpg)
Task Network Node Type
Task Network Similar to Management PERT Chart Represents computer tasks (1– 100 mseconds) Represents computer tasks (1– 60 mseconds) Network Topology represent task dependencies Task parameters include task importance and deadline
![Page 54: Human and Automation Integration Considerations for UAV Systems Prof. R. John Hansman Roland Weibel MIT International Center for Air Transportation Department](https://reader035.vdocument.in/reader035/viewer/2022062618/5515023d55034693478b65be/html5/thumbnails/54.jpg)
Monitors Link the Concept Graph and PGG