artificial intelligence - intranet deibhome.deib.polimi.it/amigoni/teaching/aihistory.pdf · –...

29
Artificial Intelligence What and When Viola Schiaffonati [email protected] Politecnico di Milano Artificial Intelligence

Upload: trinhkiet

Post on 06-Feb-2018

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Artificial IntelligenceWhat and When

Viola Schiaffonati

[email protected]

Politecnico di Milano

Artificial Intelligence

Page 2: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

What is artificial intelligence?

Page 3: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

When has been AI created?

Page 4: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Are there problems?

• The problem of the definition

– What is the “correct” definition?

• The problem of the origin

– Precursors

– Long research tradition

• Artificial Intelligence: 1956-today

4

Page 5: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

The definition problem

• Lack of a unique and universally accepted

definition

• Several and different definitions

• Definitions organized according to two

dimensions

– Thought processes vs. behaviors

– Human performances vs. rational performances

5

Page 6: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Artificial Intelligence: definitions

Systems that think Systems that think Systems that think Systems that think like humanslike humanslike humanslike humans

Systems that think Systems that think Systems that think Systems that think rationally rationally rationally rationally

Systems that act Systems that act Systems that act Systems that act like humanslike humanslike humanslike humans

Systems that act Systems that act Systems that act Systems that act rationallyrationallyrationallyrationally

6

Page 7: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Thinking humanly

• The cognitive modeling approach

– Intelligence: how humans think

– Introspection or psychological experiments to

determine human cognitive processes

• Psychological tradition (cognitive science)

• GPS (A. Newell, H. Simon)

– Human processes simulation

7

Page 8: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Acting humanly

• The conventional approach

– Intelligence: realization of a determined

performance (previously defined)

• Turing test (1950)

– Operational definition

of intelligence

• Extension of the notion of intelligence

– Not just to think, but also to act

8

Page 9: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Thinking rationally

• The “laws of thought” approach

– Intelligence: ability to think “in the right way”

• Rationality as an ideal concept of intelligence

– Intelligence without errors

– Exact definition of rationality

• Logical tradition

– Programs able to solve any solvable problem

described in logical notation

9

Page 10: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Acting rationally

• The rational agent approach

– Intelligence: acting to achieve the best possible

outcome

• Rational agent

– Physical system operating in an environment

• Limited rationality

– Acting appropriately (even with short time and

insufficient information)

10

Page 11: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Artificial Intelligence

• Conventional definition of intelligence

• Constant extension of its boundaries

(depending on scientific and technological

achievements)

• Science and engineering

– Understanding intelligence

– Building intelligence

11

Page 12: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

The problem of the origin

• Official date of birth (1956)

• Role of precursors

– Computer engineering

– Cybernetics

• Research tradition

– Tendency of humans to represent themselves

– Formalistic tradition of enquiry on the mind

12

Page 13: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Research tradition:the ancient world

• Heron of Alexandria (150 AD)

– Semiautomatic machines (autòmatha): water-

powered and steam-powered

13

Page 14: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Research tradition:the ancient and medieval world

• Ramon Lull (1235-1315)

– Ars Magna: general

principles of human

knowledge represented

by numbers and

symbols composed to

obtain further knowledge

– Ars inveniendi veritatem

14

Page 15: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Research tradition:the scientific revolution

• Descartes (1596-1650)

– Rational actions and mechanical actions

• La Mettrie (1709-1751)

– L’Homme Machine

• Pascal (1623-1662)

– Mechanical calculator

• Leibniz (1646-1716)

– Project of mechanizing rationality (calculus ratiocinator)

– Axiomatic-deductive system15

Page 16: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Research tradition:

Charles Babbage (1791-1871)

• Numerical tables for calculation

• Difference Engine

– Automatic calculation of logarithmic tables

• Analytical Machine

– Memory warehouse

– Control system

16

Page 17: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Research tradition:the birth of modern logic

• Boole (1854): algebrization of logic

• Laws constituting the ‘mathematics’ of

human cognition

• Frege

• Formal system (first order logic),

notion of proof

17

Page 18: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Research tradition:Alan Turing (1912-1954)

• Computability theory

– Universal machine

• Capable of expressing any definite procedure

by a finite number of actions

– Algorithm

• Sequence of operations that can be performed

by the universal machine

18

Page 19: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

The precursors

• Computer engineering

– Z3, Eniac

• Cybernetics

– Study of the communication and control of regulatory

feedback both in living beings and machines

– McCulloch, Pitts (1943)

• First model of artificial neurons

19

Page 20: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

The birth of Artificial Intelligence

• Workshop at Dartmouth (summer 1956)

• J. McCarthy, M. Minsky, C. Shannon, N.

Rochester

“The study is to proceed on the basis of the conjecture that every

aspect of learning or any other feature of intelligence can in

principle be so precisely described that a machine can be made

to simulate it.”

(McCarthy 1955)

20

Page 21: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Great expectations (1956-1969)

• General search strategies (applications to

games)

– GPS (Simon, Newell)

• Progressively restricted notion of intelligence

– Microworlds (Minsky)

• Lisp (McCarthy)

• Temporal decline of neural network models

21

Page 22: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

First problems (1966-1973)

• More complex problems

• Intractability of many problems

– No theory of computational complexity

• Crisis in the field of machine translations

– Cancellation of government funding

– Extension of the crisis to the whole field

22

Page 23: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Knowledge-based systems(1969-1979)

• Narrow areas of expertise

• Expert systems– Centrality of domain

knowledge and its adequate

description

– Systems supporting human experts

• Natural language processing– Syntax + semantics

23

Page 24: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

AI becoming an industry (1980-today)

• Commercial expert systems

• Chip design

• Human-computer interfaces

24

Page 25: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

The revival of neural networks (1986-today)

• Back-propagation learning algorithm

reinvented by four different research groups

• Connectionist models of intelligent systems

25

Page 26: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

AI becoming a science(1987-today)

• Revolution in content and methods

– Experiments

– Rigorous theorems

• Probabilistic approach

– Bayesian networks: efficient representation and

rigorous reasoning with uncertain knowledge

26

Page 27: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

The emergence of intelligent agents (1995-today)

• From a single agent: “whole agent” problem

– Robotics, artificial vision, learning

• To groups of agents: systems of interacting

agents (MAS)

– Positive interaction: cooperation

– Negative interaction: competition

27

Page 28: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

Rational agent

• Rationality: reasons to act

– Economic tradition: utility function

– Qualitative rationality: beliefs, desires, intentions

• Autonomy: relatively to other agents

• Adaptability: individual learning

28

Page 29: Artificial Intelligence - Intranet DEIBhome.deib.polimi.it/amigoni/teaching/AIhistory.pdf · – Introspection or psychological experiments to ... • First model of artificial neurons

References

• Davies, M. (2012) The Universal Computer: The

Road from Leibniz to Turing, Taylor & Francis

Group

• McCorduck, P. (1979) Machines Who Think, A K

Peters, Ltd.

• Russell, S., Norvig, P. (2009) Artificial

Intelligence: A Modern Approach, Prentice Hall

29