beyond the asymmetric turing test · prologue beyond the asymmetric turing test a dialectical...
TRANSCRIPT
Prologue Beyond the Asymmetric Turing Test
Beyond the Asymmetric Turing Test
Fintan Mallory
Rethinking, Reworking and Revolutionising The Turing Test
August 1, 2019
Prologue Beyond the Asymmetric Turing Test
Prologue
Wittgenstein: Turing thinks that he and I are using the word‘experiment’ in two different ways. But I want to show that this iswrong. That is to say, I think that if I could make myself quiteclear, then Turing would give up saying that in mathematics wemake experiments. If I could arrange in their proper order certainwell- known facts, then it would become clear that Turing and Iare not using the word ‘experiment’ differently.
Turing: I see your point
Wittgenstein: I have no point.
If you want to interpret the word ‘experiment’ in a wider sense,then by all means do so. And let us see whether what I have beensaying may not be false.
Prologue Beyond the Asymmetric Turing Test
Prologue
Wittgenstein: Turing thinks that he and I are using the word‘experiment’ in two different ways. But I want to show that this iswrong. That is to say, I think that if I could make myself quiteclear, then Turing would give up saying that in mathematics wemake experiments. If I could arrange in their proper order certainwell- known facts, then it would become clear that Turing and Iare not using the word ‘experiment’ differently.
Turing: I see your point
Wittgenstein: I have no point.
If you want to interpret the word ‘experiment’ in a wider sense,then by all means do so. And let us see whether what I have beensaying may not be false.
Prologue Beyond the Asymmetric Turing Test
Prologue
Wittgenstein: Turing thinks that he and I are using the word‘experiment’ in two different ways. But I want to show that this iswrong. That is to say, I think that if I could make myself quiteclear, then Turing would give up saying that in mathematics wemake experiments. If I could arrange in their proper order certainwell- known facts, then it would become clear that Turing and Iare not using the word ‘experiment’ differently.
Turing: I see your point
Wittgenstein: I have no point.
If you want to interpret the word ‘experiment’ in a wider sense,then by all means do so. And let us see whether what I have beensaying may not be false.
Prologue Beyond the Asymmetric Turing Test
Types of Test
Litmus Test
Identify the presence or absence of a property
Shibboleth Test
Identify if the candidate is one of us
Prologue Beyond the Asymmetric Turing Test
Turing’s Paradigm
Not a litmus test
‘The original question ’Can machines think?’ I believe to be toomeaningless to deserve discussion.’
Prediction about usage
‘I believe that at the end of the century the use of words andgeneral educated opinion will have altered so much that one will beable to speak of machines thinking without expecting to becontradicted.’
Prologue Beyond the Asymmetric Turing Test
What is Tested?
The Standard Turing Test doesn’t test for mindedness butlike-mindedness
The recognition of like-mindedness
This isn’t a simple response-dependent property
Prologue Beyond the Asymmetric Turing Test
What is Tested?
The Standard Turing Test doesn’t test for mindedness butlike-mindedness
The recognition of like-mindedness
This isn’t a simple response-dependent property
Prologue Beyond the Asymmetric Turing Test
What is Tested?
The Standard Turing Test doesn’t test for mindedness butlike-mindedness
The recognition of like-mindedness
This isn’t a simple response-dependent property
Prologue Beyond the Asymmetric Turing Test
A dialectical tension in the Turing paradigm
Working assumption: Intelligence manifests itself in the ability todistinguish participants
Working method: Test for intelligence measures ability to presentoneself as intelligent rather than assess intelligence
Classic objection: Test cannot identify reflexive intelligence(self-consciousness)
Proposal: Take Like-Mindedness seriously! Like-mindedness is anequivalence relation., i.e. it is symmetric, transitive and reflexive
Prologue Beyond the Asymmetric Turing Test
A dialectical tension in the Turing paradigm
Working assumption: Intelligence manifests itself in the ability todistinguish participants
Working method: Test for intelligence measures ability to presentoneself as intelligent rather than assess intelligence
Classic objection: Test cannot identify reflexive intelligence(self-consciousness)
Proposal: Take Like-Mindedness seriously! Like-mindedness is anequivalence relation., i.e. it is symmetric, transitive and reflexive
Prologue Beyond the Asymmetric Turing Test
A dialectical tension in the Turing paradigm
Working assumption: Intelligence manifests itself in the ability todistinguish participants
Working method: Test for intelligence measures ability to presentoneself as intelligent rather than assess intelligence
Classic objection: Test cannot identify reflexive intelligence(self-consciousness)
Proposal: Take Like-Mindedness seriously! Like-mindedness is anequivalence relation., i.e. it is symmetric, transitive and reflexive
Prologue Beyond the Asymmetric Turing Test
A dialectical tension in the Turing paradigm
Working assumption: Intelligence manifests itself in the ability todistinguish participants
Working method: Test for intelligence measures ability to presentoneself as intelligent rather than assess intelligence
Classic objection: Test cannot identify reflexive intelligence(self-consciousness)
Proposal: Take Like-Mindedness seriously! Like-mindedness is anequivalence relation., i.e. it is symmetric, transitive and reflexive
Prologue Beyond the Asymmetric Turing Test
Symmetry
Symmetry
Rxy → Ryx
CAPTCHAS
’Completely Automated Public Turing test to tell Computers andHumans Apart’ are unintelligent (and discriminatory in thepejorative sense)
Why this matters: Pride condition
If you can’t recognise me as intelligent, I won’t recognise you asintelligent
Prologue Beyond the Asymmetric Turing Test
Symmetry
Symmetry
Rxy → Ryx
CAPTCHAS
’Completely Automated Public Turing test to tell Computers andHumans Apart’ are unintelligent (and discriminatory in thepejorative sense)
Why this matters: Pride condition
If you can’t recognise me as intelligent, I won’t recognise you asintelligent
Prologue Beyond the Asymmetric Turing Test
Symmetry
Symmetry
Rxy → Ryx
CAPTCHAS
’Completely Automated Public Turing test to tell Computers andHumans Apart’ are unintelligent (and discriminatory in thepejorative sense)
Why this matters: Pride condition
If you can’t recognise me as intelligent, I won’t recognise you asintelligent
Prologue Beyond the Asymmetric Turing Test
Transitivity
Transitivity
Rxy ∧ Ryz → Rxz
CATS
Cats are dumb. Cute - yes - but very stupid
Why this matters: Trust condition
If I recognise you as intelligent, then I recognise your ability torecognise others as intelligent
Prologue Beyond the Asymmetric Turing Test
Transitivity
Transitivity
Rxy ∧ Ryz → Rxz
CATS
Cats are dumb. Cute - yes - but very stupid
Why this matters: Trust condition
If I recognise you as intelligent, then I recognise your ability torecognise others as intelligent
Prologue Beyond the Asymmetric Turing Test
Transitivity
Transitivity
Rxy ∧ Ryz → Rxz
CATS
Cats are dumb. Cute - yes - but very stupid
Why this matters: Trust condition
If I recognise you as intelligent, then I recognise your ability torecognise others as intelligent
Prologue Beyond the Asymmetric Turing Test
Reflexivity
Reflexivity
Rxx
The rabbit in the hat
If a relation over a set is transitive and symmetric, then it isreflexive
Issues
1. Shift-reflexivity: Rxy → Ryy2. ‘Self-consciousness exists in itself and for itself, in that, and bythe fact that it exists for another self-consciousness; that is to say,it is only by being acknowledged or recognized.’3. Self-consciousness is an advantage in the Turing Test anyway
Prologue Beyond the Asymmetric Turing Test
Reflexivity
Reflexivity
Rxx
The rabbit in the hat
If a relation over a set is transitive and symmetric, then it isreflexive
Issues
1. Shift-reflexivity: Rxy → Ryy2. ‘Self-consciousness exists in itself and for itself, in that, and bythe fact that it exists for another self-consciousness; that is to say,it is only by being acknowledged or recognized.’3. Self-consciousness is an advantage in the Turing Test anyway
Prologue Beyond the Asymmetric Turing Test
Reflexivity
Reflexivity
Rxx
The rabbit in the hat
If a relation over a set is transitive and symmetric, then it isreflexive
Issues
1. Shift-reflexivity: Rxy → Ryy2. ‘Self-consciousness exists in itself and for itself, in that, and bythe fact that it exists for another self-consciousness; that is to say,it is only by being acknowledged or recognized.’3. Self-consciousness is an advantage in the Turing Test anyway
Prologue Beyond the Asymmetric Turing Test
The Turing Games
1 Judges compete
2 Round-Robin format
3 Two conversations per pairing
4 Private-Individual conversations
5 Chicanery and deception encouraged
6 Graph of recognition produced
Prologue Beyond the Asymmetric Turing Test
The Turing Games
1 Judges compete
2 Round-Robin format
3 Two conversations per pairing
4 Private-Individual conversations
5 Chicanery and deception encouraged
6 Graph of recognition produced
Prologue Beyond the Asymmetric Turing Test
The Turing Games
1 Judges compete
2 Round-Robin format
3 Two conversations per pairing
4 Private-Individual conversations
5 Chicanery and deception encouraged
6 Graph of recognition produced
Prologue Beyond the Asymmetric Turing Test
The Turing Games
1 Judges compete
2 Round-Robin format
3 Two conversations per pairing
4 Private-Individual conversations
5 Chicanery and deception encouraged
6 Graph of recognition produced
Prologue Beyond the Asymmetric Turing Test
The Turing Games
1 Judges compete
2 Round-Robin format
3 Two conversations per pairing
4 Private-Individual conversations
5 Chicanery and deception encouraged
6 Graph of recognition produced
Prologue Beyond the Asymmetric Turing Test
The Turing Games
1 Judges compete
2 Round-Robin format
3 Two conversations per pairing
4 Private-Individual conversations
5 Chicanery and deception encouraged
6 Graph of recognition produced
Prologue Beyond the Asymmetric Turing Test
Failure cases
Symmetry
A judges B as human but B does not judge A as human
Transitivity
A judges B as human, B judges C as human but A does not judgeC as human
Prologue Beyond the Asymmetric Turing Test
Virtues
A stronger but tractable test for A.I. research
It integrates several areas of current research
A better thought experiment
A machine that passed this would be de facto one of us
Connection to the evolution of intelligence
Human intelligence evolved in a social context of shifting andsignalling affiliation (see Searcy & Nowicki, 2005, McNally &Jackson, 2013)
Prologue Beyond the Asymmetric Turing Test
Virtues
A stronger but tractable test for A.I. research
It integrates several areas of current research
A better thought experiment
A machine that passed this would be de facto one of us
Connection to the evolution of intelligence
Human intelligence evolved in a social context of shifting andsignalling affiliation (see Searcy & Nowicki, 2005, McNally &Jackson, 2013)
Prologue Beyond the Asymmetric Turing Test
Virtues
A stronger but tractable test for A.I. research
It integrates several areas of current research
A better thought experiment
A machine that passed this would be de facto one of us
Connection to the evolution of intelligence
Human intelligence evolved in a social context of shifting andsignalling affiliation (see Searcy & Nowicki, 2005, McNally &Jackson, 2013)
Prologue Beyond the Asymmetric Turing Test
Vices
Too hard?
The test is difficult to pass but easier than the Total Turing Test
Recognition is not an equivalence relation
The algebra of human interaction is a complex structure
Reflexivity 6= self-consciousness
There may be other pre-linguistic recognition relations [Le regard]
The logocentrism charge
The test is still too focussed on language processing and overlooksother traits of intelligence
Prologue Beyond the Asymmetric Turing Test
Vices
Too hard?
The test is difficult to pass but easier than the Total Turing Test
Recognition is not an equivalence relation
The algebra of human interaction is a complex structure
Reflexivity 6= self-consciousness
There may be other pre-linguistic recognition relations [Le regard]
The logocentrism charge
The test is still too focussed on language processing and overlooksother traits of intelligence
Prologue Beyond the Asymmetric Turing Test
Vices
Too hard?
The test is difficult to pass but easier than the Total Turing Test
Recognition is not an equivalence relation
The algebra of human interaction is a complex structure
Reflexivity 6= self-consciousness
There may be other pre-linguistic recognition relations [Le regard]
The logocentrism charge
The test is still too focussed on language processing and overlooksother traits of intelligence
Prologue Beyond the Asymmetric Turing Test
Vices
Too hard?
The test is difficult to pass but easier than the Total Turing Test
Recognition is not an equivalence relation
The algebra of human interaction is a complex structure
Reflexivity 6= self-consciousness
There may be other pre-linguistic recognition relations [Le regard]
The logocentrism charge
The test is still too focussed on language processing and overlooksother traits of intelligence
Prologue Beyond the Asymmetric Turing Test
Where next?
Prediction: Within 5 years a machine-coined neologism will haveentered human usage
’They will make mistakes at times, and at times they may makenew and very interesting statements, and on the whole the outputof them will be worth attention to the same sort of extent as theoutput of a human mind.’ Turing, 1948
‘The second model is fixed as we found that updating theparameters of both agents led to divergence from humanlanguage.’ Lewis et. al. 2017 [Facebook Research Lab]
Prologue Beyond the Asymmetric Turing Test
Where next?
Prediction: Within 5 years a machine-coined neologism will haveentered human usage
’They will make mistakes at times, and at times they may makenew and very interesting statements, and on the whole the outputof them will be worth attention to the same sort of extent as theoutput of a human mind.’ Turing, 1948
‘The second model is fixed as we found that updating theparameters of both agents led to divergence from humanlanguage.’ Lewis et. al. 2017 [Facebook Research Lab]
Prologue Beyond the Asymmetric Turing Test
Where next?
Prediction: Within 5 years a machine-coined neologism will haveentered human usage
’They will make mistakes at times, and at times they may makenew and very interesting statements, and on the whole the outputof them will be worth attention to the same sort of extent as theoutput of a human mind.’ Turing, 1948
‘The second model is fixed as we found that updating theparameters of both agents led to divergence from humanlanguage.’ Lewis et. al. 2017 [Facebook Research Lab]
Prologue Beyond the Asymmetric Turing Test
Tapadh leibh
Thank you
Prologue Beyond the Asymmetric Turing Test
Bibliography
Deal or No Deal? End-to-End Learning for Negotiation DialoguesMike Lewis, Denis Yarats, Yann N. Dauphin, Devi Parikh andDhruv BatraTuring, ‘Intelligent Machinery,? National Physical LaboratoryReport (1948). Reproduced in Copeland, ed., The Essential Turing(New York: Oxford, 2004), pp. 410?32.Turing, ‘Computing Machinery and Intelligence’