easy 9 march 2005activate.d workshop1 activate.d workshop homeostasis and dynamical representations...

77
9 March 2005 activate.d worksh op 1 EAS y activate.d Workshop activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group EASy, Dept. of Informatics University of Sussex [email protected]

Post on 15-Jan-2016

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 1

EASy

activate.d Workshopactivate.d Workshopactivate.d Workshopactivate.d Workshop

Homeostasis and Dynamical Representations

Inman Harvey

Evolutionary and Adaptive Systems Group

EASy, Dept. of Informatics

University of Sussex

[email protected]

Page 2: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 2

EASy

Two PartsTwo PartsTwo PartsTwo Parts

A talk in 2 disjoint parts:-

1. (90%) Homeostasis and the Dynamics of Daisyworld, based on Harvey 2004

2. (10%) The Dynamics of Representations – comments and open questions

Page 3: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 3

EASy

Alife 9 Talk Title:Alife 9 Talk Title:Alife 9 Talk Title:Alife 9 Talk Title:

Homeostasis and Rein Control:

From Daisyworld to Active Perception

Note on Motivation: most people looking at Daisyworld are using ideas of homeostasis drawn from organisms as a way of understanding global climate issues – “geophysiology” …. My interest is the reverse!

Page 4: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 4

EASy

Talk PlanTalk PlanTalk PlanTalk Plan

1. 4-page Quick Summary, defining all the words in the Title.

2. Original Daisyworld.

3. New Kindergarten Daisyworld.

4. Rein Control, general principles that can … ....

5. Extend to phototaxis in a Dalek-like simulated robot.

6. Conclude.

Page 5: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 5

EASy

HomeostasisHomeostasisHomeostasisHomeostasis

Organisms have feedback control mechanisms for maintaining conditions vital to their comfort and survival.

Too cold? Shiver, warm clothes, go to Florida.

Sweat, strip off, air-conditioningToo hot?

Many would argue that such homeostasis is central to the very concept of life.

E.g. Autopoesis is homeostasis of ones identity as an organisation.

Page 6: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 6

EASy

Rein ControlRein ControlRein ControlRein Control

Little-known principle in physiology, put forward by Manfred Clynes (musician, neuroscientist, coiner of the term ‘Cyborg’, … …)

“When a physiological variable is regulated against being both too high and too low, different mechanisms are used for each direction”.

You need two reins to control a horse, one rein can only pull but not push.

Page 7: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 7

EASy

DaisyworldDaisyworldDaisyworldDaisyworld

Gaia Hypothesis, Lovelock 1974 :- "the biosphere - atmosphere, oceans, climate, Earth's crust and biota, living organisms, is regulated as a homeostatic system in conditions comfortable for the living organisms"

How? Why? Teleology? Magic?

Daisyworld model, Lovelock 1983 :- Simple Artificial Life model presenting a possible Gaian mechanism, for e.g. temperature regulation.

This paper :- a new simplification of the Daisyworld model, showing how Rein Control leads to homeostasis. Confirming Lovelock, opening up new generalisations.

Page 8: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 8

EASy

Active PerceptionActive PerceptionActive PerceptionActive Perception

One generalisation will be the use of Rein Control and Homeostatic principles in a simple example of Active Perception in a light-seeking Animat (simulated robot)

Active Perception :- use of active movement of sensors in order to perceive

In Daisyworld, feedback and Rein Control keeps critical variable such as temperature within a viability range … … In the Animat it keeps active sensors focussed on a light - phototaxis

Page 9: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 9

EASy

Talk PlanTalk PlanTalk PlanTalk Plan

1. 4-page Quick Summary, defining all the words in the Title.

2. Original Daisyworld.

3. New Kindergarten Daisyworld.

4. Rein Control, general principles that can … ....

5. Extend to phototaxis in a Dalek-like simulated robot.

6. Conclude.

Page 10: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 10

EASy

Context of the Original Daisyworld modelContext of the Original Daisyworld modelContext of the Original Daisyworld modelContext of the Original Daisyworld model

Gaia Hypothesis, Lovelock 1974 :- "the biosphere - atmosphere, oceans, climate, Earth's crust and biota, living organisms, is regulated as a homeostatic system in conditions comfortable for the living organisms"

One example :- Our Sun is heating up, it was say 30% less luminous 3.8bn years ago. By rights, it should have been far too cold for life then, and far too hot now (e.g. 2900C)

But it seems the Earth’s surface temperature has been maintained at around 200 C for aeons. A nice temperature!

HOW ?

Page 11: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 11

EASy

Interactions between Planet Temperature and LifeInteractions between Planet Temperature and LifeInteractions between Planet Temperature and LifeInteractions between Planet Temperature and Life

Gaian Hypothesis :- somehow interactions between living organisms and the rocks / oceans / climate produce this homeostasis -- “let’s model this”

-0.2

0

0.2

0.4

0.6

0.8

1

1.2

0 10 20 30 40 50

Temperature

Gro

wth

rat

e

response

Firstly, as temperature varies, Life has a preferred temp and a viability zone, such as this :- Similar to :-

Too hot

Too cold

Page 12: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 12

EASy

Interactions between Life and Planet TemperatureInteractions between Life and Planet TemperatureInteractions between Life and Planet TemperatureInteractions between Life and Planet Temperature

Secondly, the existence of biota, of living things, affects the planet temperature.

E.g. on earth, phytoplankton in oceans generate a gas (DMS) which affects cloud cover which affects solar input.

Some of these interactions give positive, some negative feedback-components

( -- in fact both will give homeostasis! )

Page 13: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 13

EASy

Terminology Alert !Terminology Alert !Terminology Alert !Terminology Alert !

Control theorists often use “positive (or negative) feedback” as shorthand for “positive (or negative) feedback circuit”

+ leads to runaway increase/decrease

─ leads to stability and homeostasis

But here I refer to +ve or –ve feedback as just one component of a two-part circuit

+/-

Page 14: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 14

EASy

-0.2

0

0.2

0.4

0.6

0.8

1

1.2

0 10 20 30 40 50

Temperature

Gro

wth

rat

e

response

Original Daisyworld (Lovelock 1983)Original Daisyworld (Lovelock 1983)Original Daisyworld (Lovelock 1983)Original Daisyworld (Lovelock 1983)

To model this, we assume a grey planet can support Black and/or White Daisies if their local temperature is right.

E.g. viable between 50C and 400C with preferred temp 22.50C

B and W have different albedos (reflectivity) and increase / decrease the local temperature (+ve or –ve feedback)

Page 15: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 15

EASy

Homeostasis in the modelHomeostasis in the modelHomeostasis in the modelHomeostasis in the model

Consider what would happenas Solar luminosity increases

In the absence of feedback,one expects planet temperature to increase smoothly, and Daisies to increase then die away

But, if you factor in the feedbacks, the result is very different!

Page 16: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 16

EASy

Temperature HomeostasisTemperature HomeostasisTemperature HomeostasisTemperature Homeostasis

The planet temperature is maintained within the viability range as luminosity increases over a wide range – indeed it decreases slightly !

Black flourish at low luminosity, so increasing temperature

White flourish at high luminosity, so decreasing temperature

Page 17: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 17

EASy

Underlying Maths of the modelUnderlying Maths of the modelUnderlying Maths of the modelUnderlying Maths of the model

The Lovelock Daisyworld model calculates heat flows according to Solar luminosity and the albedos of Black/White Daisies and Grey planet, using the Stefan-Boltzmann law for radiation absorption/emission.

The Black/White Daisies are also competing for space – in fact it is all rather complex to visualise.

So I have simplified like crazy, and produced my own new kindergarten version … … …

Page 18: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 18

EASy

Talk PlanTalk PlanTalk PlanTalk Plan

1. 4-page Quick Summary, defining all the words in the Title.

2. Original Daisyworld.

3. New Kindergarten Daisyworld.

4. Rein Control, general principles that can … ....

5. Extend to phototaxis in a Dalek-like simulated robot.

6. Conclude.

Page 19: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 19

EASy

New Kindergarten DaisyworldNew Kindergarten DaisyworldNew Kindergarten DaisyworldNew Kindergarten Daisyworld

“Let’s model the Black Daisies as in one Grey daisybed, the White in another, no longer competing for space”

S = Temp of Sun

Temp deep space = 0

T

“Let’s assume heat flows depend linearly on temp diff (S-T), modulated by Daisybed albedo, and on temp diff (T-0) to deep space”

Page 20: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 20

EASy

Hat FunctionsHat FunctionsHat FunctionsHat Functions

“Any Hat function will do”

Homeostasis goes with viability

-0.2

0

0.2

0.4

0.6

0.8

1

1.2

0 10 20 30 40 50

Temperature

Gro

wth

rat

e

response“The Daisy viability function, as temperature varies, is a Hat-shaped function.”

TEMPERATURE

GR

OW

TH R

ATE

OF

DA

ISIE

S“Let’s use a Witch’s Hat, directly for the number of Daisies, not Growth Rate”

NU

M O

F D

AIS

IES

TEMPERATURE

Page 21: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 21

EASy

Consider just the Black DaisybedConsider just the Black DaisybedConsider just the Black DaisybedConsider just the Black Daisybed

TB

S

0

DB

Positive feedback

Hat Function

+

DB = Number of Black Daisies

TB = Temp ofBlack Daisybed

Page 22: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 22

EASy

Just one DaisybedJust one DaisybedJust one DaisybedJust one Daisybed

)(.))(1( THuTTSdt

dT

Rate of change of Temp = albedo * (Suntemp – Temp) –Temp + Feedback-term * Hat-function(Temp)

Page 23: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 23

EASy

Equilibrium when …Equilibrium when …Equilibrium when …Equilibrium when …

)(.))(1( THuTTSdt

dT

LHS = 0 when a Linear function in T intersects a Hat-function of T

Page 24: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 24

EASy

The Maths says Temperature settles at … …The Maths says Temperature settles at … …The Maths says Temperature settles at … …The Maths says Temperature settles at … …

Where the Hat function is crossed by …

TEMPERATURE

NU

M O

F D

AIS

IES

… a Feedback straight line, whose slope is given by sign/strength of feedbackM

OR

E M

EAN

S …

… MORE +VE FEEDBACK ON T

WHAT TEMPWOULD BEWITH NO

FEEDBACK

SLOPE

Page 25: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 25

EASy

NU

M O

F D

AIS

IES

TEMPERATURE

So Possible Temperatures are … …So Possible Temperatures are … …So Possible Temperatures are … …So Possible Temperatures are … …

A

A is a low temperature, with no Black Daisies alive

B

B turns out to be an unstable equilibrium

C

C is a stable equilibrium, the +ve feedback from Black Daisies brings Daisybed temperature within the viable range

The Interesting One

Page 26: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 26

EASy

This extends the Zone of ViabilityThis extends the Zone of ViabilityThis extends the Zone of ViabilityThis extends the Zone of Viability

Viable zone with no feedback

Viable zone with the positive feedback

There is a bigger range of sun luminosities (extended left) that can support viable daisy temperatures, because of the positive feedback from Black Daisies absorbing extra heat.

Shifting this slope left or right corresponds to changes in the external forcing of the Sun’s luminosity – let’s see how far it can shift and still intersect RHS of Hat Function … …

Page 27: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 27

EASy

White Daisies give Negative FeedbackWhite Daisies give Negative FeedbackWhite Daisies give Negative FeedbackWhite Daisies give Negative Feedback

All Grey Black Daisies

Similarly, on a White Daisybed, the more White against the Grey background, the more negative feedback.

This gives a line with a negative slope, but similarly extends (now to the right) the range of viability of a White Daisybed.

White Daisies

Page 28: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 28

EASy

So both Positive and Negative Feedback worksSo both Positive and Negative Feedback worksSo both Positive and Negative Feedback worksSo both Positive and Negative Feedback works

There is no need to suppose God, or Evolution (in the real world), or some Trickery (in the Daisyworld model) has cunningly put in the “right kind of feedback” to make this homeostasis work.

Because ANY kind of feedback-response, positive or negative, combined with a Viability Hat-function, gives this type of homeostasis :- extends the range of viability beyond what it would be without any feedback.

Page 29: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 29

EASy

Terminology: “Positive and Negative Terminology: “Positive and Negative Feedback”Feedback”

Terminology: “Positive and Negative Terminology: “Positive and Negative Feedback”Feedback”

Within each Daisybed, temperature T affects Daisy quantity D via a Hat-function. In turn, there is an effect feeding back from D to T that is either +ve (Black) or –ve (White daisies)

+ or -

TD

But this doesn’t mean that this circuit as a whole is a (+ve or –ve) feedback control circuit – because the Hat-function is a crucial part !

Page 30: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 30

EASy

Daisyworld ≠ Negative Feedback CircuitDaisyworld ≠ Negative Feedback CircuitDaisyworld ≠ Negative Feedback CircuitDaisyworld ≠ Negative Feedback Circuit

Conventionally you need a “Negative feedback control circuit” for homeostasis – using a Set Point (eg “desired temp”) and Negative Feedback to compensate for any Error …

This Daisyworld homeostasis is very different – for a start, there is no Set Point, only a viability range !

-

+ … and Positive feedback leads to instability

+/- And both “Hat plus Positive feedback” and “Hat plus Negative feedback” work, to give regulation.

Page 31: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 31

EASy

Talk PlanTalk PlanTalk PlanTalk Plan

1. 4-page Quick Summary, defining all the words in the Title.

2. Original Daisyworld.

3. New Kindergarten Daisyworld.

4. Rein Control, general principles that can … ....

5. Extend to phototaxis in a Dalek-like simulated robot.

6. Conclude.

Page 32: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 32

EASy

Rein ControlRein ControlRein ControlRein Control

As the Sun (or other external perturbing factor) threatens to push the Temperature (or other critical variable) too high or too low, this mechanism (Hat+feedback) automatically resists – homeostasis.

But note :- one mechanism counters the threat of being too hot (White Daisies), a different one the threat of being too cold (Black Daisies)

Two “reins” of Rein Control (Clynes 1969) – each can pull but not push, you need both for regulation in both directions.

Page 33: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 33

EASy

How do Black and White Daisies interact?How do Black and White Daisies interact?How do Black and White Daisies interact?How do Black and White Daisies interact?

So far, we have just been looking at an isolated Black Daisybed or White Daisybed.

What happens if we have both together, with some transfer of heat or “Leakage” = L between them ?

And in particular, what happens as we vary L from zero, no leakage, through intermediate values to maximum – where B and W daisybeds will have the same temperature ?

Page 34: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 34

EASy

Two DaisybedsTwo DaisybedsTwo DaisybedsTwo Daisybeds

TB

TW

DB

DW

NU

MB

ERS

OF

DA

ISIE

S

TEM

PS O

F D

AIS

YBED

S-VE

+VE SL =

Leakage

Page 35: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 35

EASy

What Happens as we vary Leakage?What Happens as we vary Leakage?What Happens as we vary Leakage?What Happens as we vary Leakage?

ZERO MAX

Suppose we can adjust the Leakage between Zero and Max?

It will turn out that it is Intermediate values that give the interesting results – loose coupling between Daisybeds

But let’s look at the extreme values of Leakage first

Page 36: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 36

EASy

Suppose Maximum LeakageSuppose Maximum LeakageSuppose Maximum LeakageSuppose Maximum Leakage

Then both Daisybeds equalise at the same temperature, hence equal numbers of B and W daisies … …

… but B + W = GREY

ZERO MAX

Page 37: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 37

EASy

Suppose Maximum LeakageSuppose Maximum LeakageSuppose Maximum LeakageSuppose Maximum Leakage

ZERO MAX

Page 38: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 38

EASy

Suppose Maximum LeakageSuppose Maximum LeakageSuppose Maximum LeakageSuppose Maximum Leakage

So it is equivalent to a planet of uniform grey, regardless of how many B and W daisies – which means ZERO heat regulation or homeostasis

Full Conductance

0

20

40

60

80

100

120

140

75 80 85 90 95 100 105 110 115 120 125

%ag

e D

aisi

es

Tem

per

atu

re

T_B

T_W

Avge Temp

D_B

D_W

SOLAR LUMINOSITY INCREASES

ZERO MAX

In this model, 90-110 is the viablerange, with 100 as the optimum

Page 39: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 39

EASy

Suppose ZERO LeakageSuppose ZERO LeakageSuppose ZERO LeakageSuppose ZERO Leakage

Effectively two separate, independent planets

0

50

100

150

200

250

50 70 90 110 130 150 170 190 210

T_B

T_W

Avge Temp

D_B

D_W

No “crossover effects”SOLAR LUMINOSITY INCREASES

ZERO MAX

Page 40: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 40

EASy

Suppose Intermediate Leakage Suppose Intermediate Leakage Suppose Intermediate Leakage Suppose Intermediate Leakage

“LOOSELY COUPLED”, the B daisybed warms up the W daisybed a bit

THEN we start to get global regulation or homeostasis in both directions 0

20

40

60

80

100

120

140

160

50 60 70 80 90 100 110 120 130 140 150

T_B

T_W

Avge Temp

D_B

D_W

Wide range of homeostasis

ZERO MAX

Page 41: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 41

EASy

Rein Control and Loose CouplingRein Control and Loose CouplingRein Control and Loose CouplingRein Control and Loose Coupling

So the lessons are:-

1. Hat-function plus any feedback-response gives homeostasis, regulation against perturbation in one direction

2. To get regulation in both directions, you need feedback-repsonses in both directions – Rein Control

3. For the different regulations to interact for greater common benefit, you need Loose Coupling

Page 42: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 42

EASy

Daisyworld SummaryDaisyworld SummaryDaisyworld SummaryDaisyworld Summary

This is a parable, where temperature stands for any critical parameter affecting viability, and the Sun for a perturbing external influence that threatens to take this parameter outside the viable range.

“Viable range” must imply some kind of Hat Function

Combining this with any kind of feedback-response leads to some degree of homeostasis, and the stronger the feedback-response the more the viability range is extended.

Page 43: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 43

EASy

New Kindergarten DaisyworldNew Kindergarten DaisyworldNew Kindergarten DaisyworldNew Kindergarten Daisyworld

This new simplified Daisyworld, presented for the first time here, just looks at the overall shapes of Hat functions, and the signs of feedback-responses, ignoring any complexities of the underlying physics.

And it emphasises for the first time the significance of Rein Control in the Daisyworld model (cf Saunders’ work), and the significance of loose coupling

Page 44: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 44

EASy

Daisyworld and Rein Control SummaryDaisyworld and Rein Control SummaryDaisyworld and Rein Control SummaryDaisyworld and Rein Control Summary

To get regulation in both directions, you need both reins for Rein Control – and they need to be loosely coupled

Current work, not yet published, investigates how much coupling (here ‘leakage’) maximises range of homeostasis

This phenomenon, of individual interactions between Hat Functions and Feedback-responses of any direction (the stronger the better), loosely coupled with other such interactions, is simple and can be expected to be widespread.

Page 45: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 45

EASy

Maximum Entropy Production PrincipleMaximum Entropy Production PrincipleMaximum Entropy Production PrincipleMaximum Entropy Production Principle

1. Paltridge (1975) noted that if one hypothesised a demon who manipulated the climate to adjust the heat flow between the equator and the poles in such a fashion as to Maximise the Rate of Entropy Production (MEP),.......... then this constrained the heat flow equations so as to reproduce actual earth temperatures remarkably

2. Dewar (2003) gives a theoretical basis for why an open system, given enough degrees of freedom, can be expected to MEP, ……4th Law of Thermodynamics

Page 46: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 46

EASy

MEP and the Daisyworld modelMEP and the Daisyworld modelMEP and the Daisyworld modelMEP and the Daisyworld model

Dyke, using Harvey’s Daisyworld model, showed (2004) that if one applied the same principles here, the same heat flows that maximised EP also had the property of maximising the range of (solar) perturbations under which the daisies remain viable.

MEP implies Maximum Homeostasis

Support Pujol 2002

Page 47: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 47

EASy

GeneralisationGeneralisationGeneralisationGeneralisation

Let’s give just one example of how these principles can be generalised – here to a very different domain of Active Perception

It’s going to look very different, but trust me, the underlying principles are the same!

Page 48: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 48

EASy

Talk PlanTalk PlanTalk PlanTalk Plan

1. 4-page Quick Summary, defining all the words in the Title.

2. Original Daisyworld.

3. New Kindergarten Daisyworld.

4. Rein Control, general principles that can … ....

5. Extend to phototaxis in a Dalek-like simulated robot.

6. Conclude.

Page 49: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 49

EASy

An Animat – a Simulated AgentAn Animat – a Simulated AgentAn Animat – a Simulated AgentAn Animat – a Simulated Agent

View from above – nose shows which way it is facing, all it can do is rotate about its centre.

Page 50: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 50

EASy

… and a spring restraining the tentacle to the nose

… with a photosensor with an ‘angle of acceptance’

An Animat – a Simulated AgentAn Animat – a Simulated AgentAn Animat – a Simulated AgentAn Animat – a Simulated Agent

Add a tentacle, that can also rotate around the centre.

… and a jet that converts light input into sideways force

Page 51: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 51

EASy

Tentacle Responds Actively to LightTentacle Responds Actively to LightTentacle Responds Actively to LightTentacle Responds Actively to Light

The photosensor responds with a Hat Function to light, maximum sensitivity when the tentacle points directly at a light

So a light off-centre means a medium jet force

Page 52: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 52

EASy

Light central in the photoreceptor produces maximum jet force, extending the spring

Page 53: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 53

EASy

But if the photoreceptor can see no light, there is zero jet force, and the tentacle springs back over the nose

Page 54: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 54

EASy

Now let’s have Now let’s have LOTSLOTS of these tentacles of these tentaclesNow let’s have Now let’s have LOTSLOTS of these tentacles of these tentacles

Some have jets pointing clockwise, some anti-clockwise, at random. All are connected by springs to the nose, but are otherwise independent of each other.

Page 55: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 55

EASy

Parallels with Daisyworld?Parallels with Daisyworld?Parallels with Daisyworld?Parallels with Daisyworld?

The angles correspond to temperatures

The photoreceptors’ range of sensitivity corresponds to Daisies’ range of viability – Hat Functions

The jets, one direction or other, correspond to temperature feedbacks from B and W daisies, +ve or –ve responses

The springs, all coupled to the nose, correspond to the loose coupling between Daisybeds.

Page 56: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 56

EASy

What Happens?What Happens?What Happens?What Happens?

Let the balance of forces on the nose, from the randomly connected tentacles, rotate the robot around its centre (corresponds to the average planetary temperature)

Just as in Daisyworld, the effect is as if the Daisybeds were ‘trying’ to stay within their zones of viability …

… so here, the effect is as if the tentacles are ‘trying’ to stay within their zones of sensitivity, i.e. pointing near to the light.

So with a moving light, we get PHOTOTAXIS

Page 57: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 57

EASy

PhototaxisPhototaxisPhototaxisPhototaxis

Test with a light that comes in from one side and oscillates in front of the Animat

-0.6

-0.4

-0.2

0

0.2

0.4

0.6

1 10000Rad

ian

s

Target Orientation

Robot Orientation

It picks up the light and tracks it …

Page 58: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 58

EASy

Successful TranslationSuccessful TranslationSuccessful TranslationSuccessful Translation

So we have translated the simple mechanisms underlying homeostasis in Daisyworld

into Active Perception in an Animat – the underlying Maths is the same

Simple mechanisms, randomly wired up, loosely coupled

Page 59: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 59

EASy

Talk PlanTalk PlanTalk PlanTalk Plan

1. 4-page Quick Summary, defining all the words in the Title.

2. Original Daisyworld.

3. New Kindergarten Daisyworld.

4. Rein Control, general principles that can … ....

5. Extend to phototaxis in a Dalek-like simulated robot.

6. Conclude.

Page 60: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 60

EASy

HomeostasisHomeostasisHomeostasisHomeostasis

Organisms have feedback control mechanisms for maintaining conditions vital to their comfort and survival.

Many would argue that such homeostasis is central to the very concept of life.

E.g. Autopoesis is homeostasis of ones identity as an organisation.

An understanding of basic mechanisms of homeostasis is crucial both for Biology and for Artificial Life.

Page 61: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 61

EASy

Rein ControlRein ControlRein ControlRein Control

Little-known principle in physiology, put forward by Manfred Clynes (musician, neuroscientist, coiner of the term ‘Cyborg’, … …)

“When a physiological variable is regulated against being both too high and too low, different mechanisms are used for each direction”.

You need two reins to control a horse, one rein can only pull but not push.

Page 62: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 62

EASy

DaisyworldDaisyworldDaisyworldDaisyworld

Gaia Hypothesis, Lovelock 1974 :- "the biosphere - atmosphere, oceans, climate, Earth's crust and biota, living organisms, is regulated as a homeostatic system in conditions comfortable for the living organisms"

Daisyworld model, Lovelock 1983 :- Simple Artificial Life model presenting a possible Gaian mechanism, for e.g. temperature regulation.

This paper :- a new simplification of the Daisyworld model, showing how Rein Control leads to homeostasis. Confirming Lovelock, opening up new generalisations.

Page 63: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 63

EASy

Active PerceptionActive PerceptionActive PerceptionActive Perception

One generalisation is the use of Rein Control and Homeostatic principles in a simple example of Active Perception in a light-seeking Animat (simulated robot)

In Daisyworld, feedback and Rein Control keeps critical variable such as temperature within a viability range … … In the Animat it keeps active sensors focussed on a light - phototaxis

New principles – many opportunities for further research!

Page 64: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 64

EASy

Two PartsTwo PartsTwo PartsTwo Parts

A talk in 2 disjoint parts:-

1. (90%) Homeostasis and the Dynamics of Daisyworld, based on Harvey 2004

2. (10%) The Dynamics of Representations – comments and open questions

Page 65: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 65

EASy

The Dynamical Systems Approach to The Dynamical Systems Approach to RepresentationsRepresentations

The Dynamical Systems Approach to The Dynamical Systems Approach to RepresentationsRepresentations

The Dalek example shows how an agent can home in on, and then track a target, without making any comparison between “direction target is” and “direction I am facing”

Likewise, van Gelder’s discussion of the Watt Governor shows how it regulates speed without making any comparison between “current speed of steam engine” and “desired speed of steam engine”

The regulation arises from the dynamics, “without Int Reps”

Page 66: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 66

EASy

So is a DS approach Anti-Representationalist?So is a DS approach Anti-Representationalist?So is a DS approach Anti-Representationalist?So is a DS approach Anti-Representationalist?

Absolutely not! We should reject this misleading term.

We should be clarifying unambiguous usage of the term representation, and in particular distinguishing between

1. Internal representations as posited mechanisms within cognitive systems

2. Representation-using as something we humans do all the time

(1) Mechanism (2) Behaviour

Page 67: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 67

EASy

Representations as MechanismsRepresentations as MechanismsRepresentations as MechanismsRepresentations as Mechanisms

Many explanations of mechanisms use a homuncular metaphor: “the wire carries the signal from the thermostat to the central heating boiler”

This is a legitimate metaphor where it is useful. It draws on the metaphor of: thermostat and boiler are ‘people’, current level in the wire is like a ‘letter’ or ‘telegram passing info’

‘Representations’ are the ‘Billiard Balls’ of GOFAI Cognitive Science

Page 68: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 68

EASy

The Grounding of this MetaphorThe Grounding of this MetaphorThe Grounding of this MetaphorThe Grounding of this Metaphor

But this metaphor draws on the common understanding of how we use representations, letters, words, signs in the real world (the external!?! World) every day.

We are so familiar with this that we see no mystery in it.

Representations as explanans rather than explanandum

‘Representations’ are the ‘Billiard Balls’ of GOFAI Cognitive Science

Page 69: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 69

EASy

Two ConsequencesTwo ConsequencesTwo ConsequencesTwo Consequences

1. People who use ‘internal representations’ as explanations for mechanisms are extremely reluctant to define what they mean by the term

2. They often find DS explanations disturbing, because they rarely fit neatly into this homuncular metaphor.

Page 70: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 70

EASy

The Representation Wars IThe Representation Wars IThe Representation Wars IThe Representation Wars I

One strategy: List the dozens of different incompatible ways in which the term (internal) representation is used, and ask for clarity and unambiguity

Typical problem met: unwillingness to define – Billiard Ball problem

Page 71: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 71

EASy

Working usages of “Representation”Working usages of “Representation”Working usages of “Representation”Working usages of “Representation”

1. Everyday usage re-presentation: a picture of a cat is a re-presentation of a real cat.

2. A stand-in: A Member of Parliament represents his/her constituents.

3. The act of representing (as opposed to the image/picture etc)

4. A variable that correlates with another variable.

5. As 4, but also needing also some causal correlation.

6. As 5, but also implicitly using homunculi.

7. A representation needs a consumer.

8. A representation does not need a consumer.

Page 72: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 72

EASy

… … more …more …… … more …more …

9. Representations are in the brain.

10. Representations are in the mind.

11. Internal representations = mental representations

12. Representations are in the head, and I reserve the right to use head=brain or head=mind at will.

13. Reps are in the head when you imagine a cat, not when you see it

14. Reps are in the head both when you see and imagine a cat

15. To try and define representations is a mistake.

16. No need to define our usage of the term, because it is obvious.

17. … … …

Page 73: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 73

EASy

The Representation Wars IIThe Representation Wars IIThe Representation Wars IIThe Representation Wars II

One DS strategy has been to ask Cognitivists for examples of what they think are representation-hungry problems, and get characterisations in operational terms

Then design a ‘minimal cognition’ experiment that fits the bill, evolve a CTRNN to do it, and see whether this challenges the preconceptions.

Typical problem met:- moving goal posts

Page 74: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 74

EASy

The Representation Wars IIIThe Representation Wars IIIThe Representation Wars IIIThe Representation Wars III

Another strategy: just ignore those who deal in internal representations – there are enough sensible people around to talk to

Problem: newcomers to the field are likely to be misled by the orthodox camp

Page 75: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 75

EASy

The Representation Wars IVThe Representation Wars IVThe Representation Wars IVThe Representation Wars IV

My current preferred strategy: to reclaim the term Representation, to reject the label anti-representationalist, to make it clear that understanding how we humans use representations is one core goal of Cognitive Science that a DS approach aims at tackling.

However a DS explanation goes, I expect it to be of the form that representing (in words, in images on paper…) is something we do, rather than representations are something we have.

Page 76: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 76

EASy

To concludeTo concludeTo concludeTo conclude

I used to be genuinely puzzled at being called an anti-representationalist; now I am very much annoyed by the term.

The use of representations is something to be explained. Using representations as an explanans is OK with the homuncular metaphor -- but the one place where the homuncular metaphor is completely illegitimate is in the project to understand what it is to be an agent, an organism, a human – or a homunculus!

Page 77: EASy 9 March 2005activate.d workshop1 activate.d Workshop Homeostasis and Dynamical Representations Inman Harvey Evolutionary and Adaptive Systems Group

9 March 2005activate.d workshop 77

EASy