![Page 2: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/2.jpg)
TEAMWORK
To be truly useful, robotic systems must be designed with their human users in mind; conversely, humans must be educated and trained with their robotic collaborators in mind.
Michael A. Gennert
2
users
collaborators
Machines must become much better at recognizing and communicating anomalies if they are to avoid becoming vulnerable to both tragic accidents and intentional misdirection and "spoofing."
![Page 3: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/3.jpg)
REQUIREMENTS
•Competence • Machine must be in predictive control of itself & its environment
•Coordination • Machine’s actions must be able to be predicted by teammates
The same requirements must be true of the humans as well.
3
![Page 4: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/4.jpg)
YOUR FATHER’S AI
December 6, 1999 - A Global Hawk UAV "accelerated to an excessive taxi speed after a successful, full-stop landing. The air vehicle departed the paved surface and received extensive damage” (over $5.3 million) when the nose gear collapsed.
Causes:
• hidden dependencies introduced during software updates
• limits on software testing
4
![Page 5: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/5.jpg)
9 MAY 2014
'KILLER ROBOTS' TO BE DEBATED AT UN
Vs.
5
![Page 6: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/6.jpg)
INTERNATIONAL COMMITTEE FOR ROBOT ARMS CONTROL
THE SCIENTISTS’ CALL
… To Ban Autonomous Lethal Robots
As Computer Scientists, Engineers, Artificial Intelligence experts, Roboticists and professionals from related disciplines, we call for a ban on the development and deployment of weapon systems in which the decision to apply violent force is made autonomously.
Decisions about the application of violent force must not be delegated to machines.
6
![Page 7: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/7.jpg)
INTERNATIONAL COMMITTEE FOR ROBOT ARMS CONTROL
THE SCIENTISTS’ CALL
… To Ban Autonomous Lethal Robots
As Computer Scientists, Engineers, Artificial Intelligence experts, Roboticists and professionals from related disciplines, we call for a ban on the development and deployment of weapon systems in which the decision to apply violent force is made autonomously.
Decisions about the application of violent force must not be delegated to machines.
7
![Page 8: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/8.jpg)
BAN LAR’S POSTER CHILD
8
![Page 9: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/9.jpg)
AGENCY SPECTRUM
Simple Tools
9
low-level
(physical)
predictability
high-level
(intentional)
predictability
Allied Competent
Entities
![Page 10: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/10.jpg)
AUTONOMY SPECTRUM
Allied Competent
Entities
10
Reflective (Mental)
Autonomy
Soldiers Dogs , Dolphins
Simple Tools
Reflexive (Physical) Autonomy
![Page 11: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/11.jpg)
BIG DOG
TOOL OR ENTITY?
11
![Page 12: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/12.jpg)
POTENTIAL SCENARIOS
• Stupid Algorithm
• Really Smart Algorithm
• Comprehensible
• Black Box (Big Data)
• Evolutionary (Big Dog)
• Stupid Entity (including savants)
• Really Smart Entity
• Benevolent
• Indifferent to Evil
12
![Page 13: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/13.jpg)
IN THE NEAR FUTURE . . .
New York SWAT teams receive “smart rifles”
• Friendly fire , successful outcomes
• “Shoot everything & let the gun sort it out”
• The rifle is the arbiter of who lives/dies
• Safety feature turned executioner
13
![Page 14: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/14.jpg)
IN THE NEAR FUTURE . . .
LA SWAT teams introduce “armed telepresence”
• Minorly modified DARPA disaster-relief robots
• Pre-targeting + aim correction = inhuman speed/accuracy
• In training exercises, friendly fire , good outcomes
• ADD the “smart rifles”?
14
![Page 15: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/15.jpg)
RESPONSIBILITY
•Competence • Predictive control
•Communication • Alerts & explanations
•Comprehension • Anomaly handling
•Freedom
15
![Page 16: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/16.jpg)
IN
• Purely symbolic reasoning
• Programming
• Embodied
• Constructed
• Agents
• Blame
16
• Connectionist/symbolic hybrid architectures
• Learning
• Intentional
• Autopoietic
• Selves
• Responsibility
EVOLUTION
OUT
![Page 17: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/17.jpg)
DEVELOPMENTAL ROBOTICS
https://www.youtube.com/watch?v=bkv83GKYpkI
Pierre-Yves Oudeyer, Flowers Lab, France (https://flowers.inria.fr/)
17
![Page 18: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/18.jpg)
HYBRID ETHICS (TOP-DOWN & BOTTOM-UP)
Singular goal/restriction
suppress or regulate selfishness make cooperative social life possible
Principles of Just Warfare
rules of thumb drive attention and a sensory/emotional “moral sense”
18
![Page 19: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/19.jpg)
STRATEGIC / ETHICAL
POINTS
• Entities can protect themselves against errors, spoofing, misuse & hijacking (in a way tools cannot)
• Never delegate responsibility until recipient is an entity *and* known capable of fulfilling it
• Don’t worry about killer robots exterminating humanity – we will always have equal abilities and they will have less of a “killer instinct”
• Diversity (differentiation) is *critically* needed & human centrism is selfish, unethical and dangerous
19
![Page 20: MACHINE EXECUTION OF HUMAN INTENTIONSc4i.gmu.edu/eventsInfo/reviews/2014/pdfs/AFCEA2014-Waser.pdfThe air vehicle departed the paved surface and received extensive damage” (over $5.3](https://reader033.vdocument.in/reader033/viewer/2022052009/601ef617d909a761815d0d76/html5/thumbnails/20.jpg)
The Digital Wisdom Institute is a non-profit think tank focused on the promise and challenges of ethics,
artificial intelligence & advanced computing solutions.
We believe that the development of ethics and artificial intelligence
and equal co-existence with ethical machines is
humanity's best hope
http://DigitalWisdomInstitute.org
20