intelligent machines - microsoft.com · intelligent machines hermann hauser cambridge july 2018...

39
Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design

Upload: others

Post on 18-Oct-2020

7 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Intelligent MachinesHermann Hauser Cambridge July 2018

Evolution Design

Page 2: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Biological Machines

Neurons

Think: Brains

Hear: Ears

See: Eyes

Move: Legs

Learn: Schools

Disruption

Evolution

Human Goals

Artificial Machines

Transistors

Computers

Microphones

Cameras

Robots

Machine Learning

Cars, Healthcare

Design

Contents

Page 3: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Neurons vs. Transistors

Size: 20um

Speed: 1kHz

Brain: 100bn

Connections: 100tr

20nm 1000x

1GHZ 1,000,000x

10bn 1/10x

Internet: 1bn hosts

20bn IOT connected

Page 4: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Soma

Dendrites

Axons with myelin sheaths

Synapses

Voltage gated Ion channels

Hodgekin-Huxley model

Neurons

Page 5: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

• Source, Gate, Drain

• Simple, uniform

• Universal building block:

• NAND GATE

Transistors

Page 6: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Think

Page 7: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Capacity:

10 to 100TB

Processing power:

10Peta-1ExaFLOPS

Power consumption:

20W

Connections: 100tr

500TB 5x

10TeraFLOPS:

1000x

200kW 10,000x

Memory 512GB

1g

Brains vs. Computers

GPU Graphical Processing

Unit

Page 8: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Neural Networks

Page 9: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

• MRI picture from Oxford

• 200 different brain regions

• 461 people

Human Connectome

Page 10: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Graphcore IPU

(Intelligent Processing Unit)

• Graphcore

• 7,000 processors

• 350MB RAM

• largest chip in the world: inch a side

• BSP: Bulk Synchronisation Protocol

Page 11: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Hear

Page 12: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Frequency:

20-20kHz

Loudness:

0 to 120dB

Sound localisation:

5deg

20- GHz Ultrasound

10 to 220dB SaturnV

much finer

Ears vs Microphones

Hear

https://youtu.be/-7xvqQeoA8c

Page 13: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

• Amazon Echo

• Software from EVI

• Xmos working on best HW solution

• Hearing people across a crowded room

• Voice recognition across a room

Beam forming Microphone

Page 14: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

See

Page 15: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Resolution:

0.1mm

Speed:

1/100 sec

Frequency

430-770THz

Number: 2

Angstrom: 1,000,000x

psec: 10^10x

3Hz-300EHz

100,000

Eyes

Camera

Page 16: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:
Page 17: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

• At least 100k webcams

• Autonomous vehicles will need 6 to 16

• Connected cars will get info from cars in

front and CCTV

Many Cameras

Page 18: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Self-driving car

Page 19: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Millenials

• Transport as a service

• No interest in driving

• Live in cities

• Get their information on the web

Page 20: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Move

Page 21: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

• Boston Dynamics

• Handle

Legs vs. Robots

Page 22: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Learn

Page 23: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

What is Machine Learning?

Systems that learn from data rather then following

pre-programmed rules

(Royal Society ML Report)

Page 24: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Branches of ML

• SUPERVISED ML: trained on LABELED DATA

• UNSUPERVISED ML: without labels

• REINFORCEMENT ML: learning from experience, reward

function (winning game)

• INVERSE REINFORCEMENT ML: system has to deduce

reward function buy observation (driving a car)

Page 25: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

ML Examples

• Speech recognition: Google, Siri, Alexa

• Object / Face recognition: Google Photo

• Recommender systems: Amazon, Netflix

Page 26: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Probablility and ML

• NOT 0s and 1s but P for Probability

• NOT deterministic but STATISTICAL

• NOT programming but TEACHING

• Needs Big Data

• Needs (Human) GOALS

• Genie Problem

Page 27: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Artificial Intelligence

Page 28: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

AI Risks

“Success in creating AI would be the

biggest event in human history.

Unfortunately, it might also be the last,

unless we learn how to avoid the risks.”

“Hope we’re not just the biological boot

loader for digital superintelligence.

Unfortunately, that is increasingly

probable.” 28

Page 29: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Life 3.0

Page 30: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Evonetix

The GeneSynthesis

Company

Pixelflo

w

Page 31: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

AlphaGo

Move 37

in game 2

Move 78

in game 4

Page 32: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Disruption

Page 33: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

ARM Business model

Intel ARM

Customer Dell,HP Samsung,Apple

Chipfab Intel TSMC+450

Design Intel ARM

Intellectual

PropertyIntel ARM

Page 34: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

ARM

• 100bn shipped >10x population of earth

• $30bn sale to Softbank

• >95% market share in phones

• ARM:Intel = 20:1

• ARMs 450 licensees: ARM $ > Intel Revenue

• Licensing model

• Low power

Page 35: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

ML effect on Car industry

Today With ML

Customer Showroom Uber

Autonomous SW BMW, Tesla Uber, FiveAI

Car BMW,Tesla BYD, KIA

Components Bosch China

Page 36: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Trillion $ Opportunity

• US spends $3tr on Healthcare

• Treating ill people: 70%

• Keeping them healthy: 30%

• Expected to change to 50:50 in 5 yrs

Page 37: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

ML effect on Pharma

Today With ML

Customer Patient Healthy person

Provider Doctor/hospital e-Health

Supplier PharmaPersonalised

Advice

Components Drugs Data

Page 38: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

Evolution vs DesignEvolution vs. Design

Page 39: Intelligent Machines - microsoft.com · Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design . Biological Machines Neurons Think: Brains Hear: Ears See: Eyes Move:

• Humanity has a new partner:

• Intelligent Machines

• How to co-evolve with them?

Conclusion