minds, agents, senses, actionsccrg.cs.memphis.edu/tutorial/pdfs/mindsagentssensesactions.pdf ·...
TRANSCRIPT
![Page 1: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/1.jpg)
1
How Minds Work Minds, Agents, Senses, Actions
Stan Franklin Computer Science Division & Institute for Intelligent Systems The University of Memphis
![Page 2: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/2.jpg)
HMW: Minds, Agents, Senses, Actions 2
Two Burning Questions for Me • How do minds work?
– Human minds – Animal minds – Artificial Minds
• How to make smart software agents? – Copy them after humans
![Page 3: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/3.jpg)
HMW: Minds, Agents, Senses, Actions 3
Question: How do minds work? What would an answer be like?
A framework within which to understand the various mental processes about which one might become curious.
My answer will take most of the semester.
![Page 4: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/4.jpg)
HMW: Minds, Agents, Senses, Actions 4
What is a mind?
A mind is a control structure for an autonomous agent.
![Page 5: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/5.jpg)
HMW: Minds, Agents, Senses, Actions 5
What is an autonomous agent? A system embedded in, and part of, an environment, that – Senses its environment – Acts on it – Over time – In pursuit of its own agenda – So that its actions affect its future sensing
![Page 6: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/6.jpg)
HMW: Minds, Agents, Senses, Actions 6
Examples of Autonomous Agents
• We humans • Most (all?) animals • Computer viruses • Some mobile robots • Autonomous software agents • Some organizations
![Page 7: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/7.jpg)
HMW: Minds, Agents, Senses, Actions 7
Environment?
• Physicalist assumption: There’s a real world out there
• Cyberspace is part of the real world • Artificial environments also exist • Causality assumption: Causality operates, i.e., the universe is lawful
![Page 8: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/8.jpg)
HMW: Minds, Agents, Senses, Actions 8
Sense the environment? • Humans: sight, hearing, touch, smell • Other animals:
– Bats, dolphins — echolocation – Sharks — electroreception
• Photo, mechano, chemo, electro, magneto reception
• Artificial senses, e.g. strings of characters
![Page 9: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/9.jpg)
HMW: Minds, Agents, Senses, Actions 9
Spatially Sensitive Senses
• Sense organ movement produces apparent motion at its surface
• E.g. human vision—press eyeball • Bacterium nutrient gradient sensing is not spatially sensitive
• Temperature sensing by a thermostat is not spatially sensitive
![Page 10: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/10.jpg)
HMW: Minds, Agents, Senses, Actions 10
Illusory Motion
![Page 11: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/11.jpg)
HMW: Minds, Agents, Senses, Actions 11
Illusory Woman The apparent woman is produced by – A potted plant – A shelf – A cat – A wine glass – A plate – A clothesline – A pair of stockings
![Page 12: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/12.jpg)
HMW: Minds, Agents, Senses, Actions 12
We each create our own world
• There is no RED out there, only wavelengths of light
• There is no sound when the unattended tree falls in the forest, only vibrations in the air
• The smell of smoke is an inference drawn from molecules in the air
![Page 13: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/13.jpg)
HMW: Minds, Agents, Senses, Actions 13
Illusions of the senses tell us the truth about perception
For a website devoted to this proposition, go to
http://www.michaelbach.de/ot/index.html
![Page 14: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/14.jpg)
HMW: Minds, Agents, Senses, Actions 14
The only question there is! What do I do next?
For any autonomous agent Cognition is in the service of action selection
Everything else is a side effect
![Page 15: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/15.jpg)
HMW: Minds, Agents, Senses, Actions 15
Its own agenda? • Motivation must be built in • Either by evolution or a designer • Can be causally implemented as in a thermostat
• Implemented by feelings and emotions in humans and other animals
![Page 16: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/16.jpg)
HMW: Minds, Agents, Senses, Actions 16
Actions affect sensing?
• Structural coupling to its environment • Sensors must be appropriate to needs • Effectors must be appropriate to needs • Effectors must change the environment • Sensors must record those changes
![Page 17: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/17.jpg)
HMW: Minds, Agents, Senses, Actions 17
Reactive Agents à la Sloman
![Page 18: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/18.jpg)
HMW: Minds, Agents, Senses, Actions 18
Add Deliberation
![Page 19: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/19.jpg)
HMW: Minds, Agents, Senses, Actions 19
Add MetaManagement
![Page 20: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/20.jpg)
HMW: Minds, Agents, Senses, Actions 20
Primitives • Every autonomous agent must come equipped with – Primitive sensors—sensory receptors – Primitive effectors—motor output – Primitive motivators—of some sort
• These primitives put fundamental limits on what the agent can sense and do
![Page 21: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/21.jpg)
HMW: Minds, Agents, Senses, Actions 21
Action Selection Paradigm of Mind
• Best viewed as degreed rather than as Boolean • Aggregate rather than monolithic • Enabled by disparate mechanisms • Overriding task to produce the next action • Operates on sensations to create information • Reconstructs memories (prior information) • Is implementable on machines
![Page 22: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/22.jpg)
HMW: Minds, Agents, Senses, Actions 22
A Cognitive “Theory of Everything”
• Sensation • Perception • Feeling & Emotion • Working memory • Episodic memory • Consciousness • Learning
• Deliberation • Volition • Automization • Action Selection • Problem solving • Self • Metacognition
![Page 23: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/23.jpg)
HMW: Minds, Agents, Senses, Actions 23
Readings in Artificial Minds Action Selection Paradigm pp. 1718
Pandemonium Theory pp. 234244
Copycat Architecture pp. 347362
Schema Mechanism pp. 314324
Sparse Distributed Memory pp. 330344
Behavior Networks pp. 244258
MIT Press, 1995
![Page 24: Minds, Agents, Senses, Actionsccrg.cs.memphis.edu/tutorial/PDFs/MindsAgentsSensesActions.pdf · Minds, Agents, Senses, Actions ... world out there • Cyberspace is part of the real](https://reader033.vdocument.in/reader033/viewer/2022050612/5fb331258a872d051d299af0/html5/thumbnails/24.jpg)
HMW: Minds, Agents, Senses, Actions 24
Email and Web Addresses
• Stan Franklin – [email protected] – www.cs.memphis.edu/~franklin
• “Conscious” Software Research Group – www. csrg.memphis.edu/