linguistics association of great britain, annual meeting...

192
Introduction to the Rational Speech Acts Model Christopher Potts Stanford Linguistics Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Upload: others

Post on 28-Sep-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Introduction to the Rational Speech Acts Model

Christopher PottsStanford Linguistics

Linguistics Association of Great Britain, Annual MeetingSeptember 9, 2019

Page 2: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Overview

Page 3: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

OverviewA companion to Goodman and Frank 2016, ‘Pragmatic language interpretation as probabilistic inference’

Page 4: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

OverviewA companion to Goodman and Frank 2016, ‘Pragmatic language interpretation as probabilistic inference’

1. A bit of history

Page 5: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

OverviewA companion to Goodman and Frank 2016, ‘Pragmatic language interpretation as probabilistic inference’

1. A bit of history2. Conceptual motivation for the Rational Speech Acts model (RSA)

Page 6: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

OverviewA companion to Goodman and Frank 2016, ‘Pragmatic language interpretation as probabilistic inference’

1. A bit of history2. Conceptual motivation for the Rational Speech Acts model (RSA)3. Example calculations using the model:

a. Basic scalar implicatureb. The role of message costsc. The role of the alpha parameterd. The role of the referent prior

Page 7: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

OverviewA companion to Goodman and Frank 2016, ‘Pragmatic language interpretation as probabilistic inference’

1. A bit of history2. Conceptual motivation for the Rational Speech Acts model (RSA)3. Example calculations using the model:

a. Basic scalar implicatureb. The role of message costsc. The role of the alpha parameterd. The role of the referent prior

4. A simple Python implementation

Page 8: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

OverviewA companion to Goodman and Frank 2016, ‘Pragmatic language interpretation as probabilistic inference’

1. A bit of history2. Conceptual motivation for the Rational Speech Acts model (RSA)3. Example calculations using the model:

a. Basic scalar implicatureb. The role of message costsc. The role of the alpha parameterd. The role of the referent prior

4. A simple Python implementation5. Extensions: joint inference over utterance and context

Page 9: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Origin story

Page 10: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Origin story1. Rosenberg and Cohen 1964 (Science): early Bayesian model of production

and comprehension

Page 11: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Origin story1. Rosenberg and Cohen 1964 (Science): early Bayesian model of production

and comprehension

2. Lewis 1969: signaling systems in his thesis/book Convention

Page 12: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Origin story1. Rosenberg and Cohen 1964 (Science): early Bayesian model of production

and comprehension

2. Lewis 1969: signaling systems in his thesis/book Convention

3. Rabin 1990: recursive signaling in ‘Communication between rational agents’

Page 13: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Origin story1. Rosenberg and Cohen 1964 (Science): early Bayesian model of production

and comprehension

2. Lewis 1969: signaling systems in his thesis/book Convention

3. Rabin 1990: recursive signaling in ‘Communication between rational agents’

4. Camerer and Ho 2004: ‘A cognitive hierarchy models for games’ of conflict and coordination

Page 14: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Origin story1. Rosenberg and Cohen 1964 (Science): early Bayesian model of production

and comprehension

2. Lewis 1969: signaling systems in his thesis/book Convention

3. Rabin 1990: recursive signaling in ‘Communication between rational agents’

4. Camerer and Ho 2004: ‘A cognitive hierarchy models for games’ of conflict and coordination

5. Michael Franke and Gerhard Jäger: iterated best response (IBR)

Page 15: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Origin story1. Rosenberg and Cohen 1964 (Science): early Bayesian model of production

and comprehension

2. Lewis 1969: signaling systems in his thesis/book Convention

3. Rabin 1990: recursive signaling in ‘Communication between rational agents’

4. Camerer and Ho 2004: ‘A cognitive hierarchy models for games’ of conflict and coordination

5. Michael Franke and Gerhard Jäger: iterated best response (IBR)

6. Frank and Goodman 2012 (Science): very sophisticated pragmatic agents and a new Bayesian foundation

Page 16: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Major achievementsIncremental implicatures Cohn-Gordon, Goodman, Potts, ‘A incremental, iterated response model of

pragmatics’

Manner implicatures Bergen, Levy, Goodman, ‘Pragmatic reasoning through semantic inference’

I-implicatures and implicature blocking Potts & Levy, ‘Negotiating lexical uncertainty and speaker expertise with disjunction’

Embedded implicatures Potts, Lassiter, Levy, Frank, ‘Embedded implicatures as pragmatic inferences under compositional lexical uncertainty’

Hyperbole Kao, Wu, Bergen, Goodman, ‘Nonliteral understanding of number words’

Metaphor Kao, Bergen, Goodman, ‘Formalizing the pragmatics of metaphor understanding’

Politeness Yoon, Tessler, Goodman, Frank, ‘Polite speech emerges from competing social goals’

Irony Cohn-Gordon and Bergen, ‘Verbal irony, pretense, and the common ground’

Social meaning Work by E. Allyn Smith, Heather Burnett, Eric Acton, and others

Large-scale machine learning problems Work by Will Monroe, Jacob Andreas, Reuben Cohn-Gordon, and others

Page 17: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Pursuing a Gricean ideal

Page 18: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Pursuing a Gricean idealThe cooperative principle: Make your contribution as is required, when it is required, by the conversation in which you are engaged.

Page 19: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Pursuing a Gricean idealThe cooperative principle: Make your contribution as is required, when it is required, by the conversation in which you are engaged.

1. Quality: Contribute only what you know to be true. Do not say false things. Do not say things for which you lack evidence.

2. Quantity: Make your contribution as informative as is required. Do not say more than is required.

3. Relation (Relevance): Make your contribution relevant.

4. Manner: (i) Avoid obscurity; (ii) avoid ambiguity; (iii) be brief; (iv) be orderly.

5. ...

Page 20: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Pursuing a Gricean idealThe cooperative principle: Make your contribution as is required, when it is required, by the conversation in which you are engaged.

1. Quality: Contribute only what you know to be true. Do not say false things. Do not say things for which you lack evidence.

2. Quantity: Make your contribution as informative as is required. Do not say more than is required.

3. Relation (Relevance): Make your contribution relevant.

4. Manner: (i) Avoid obscurity; (ii) avoid ambiguity; (iii) be brief; (iv) be orderly.

5. ...

Page 21: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Pursuing a Gricean idealThe cooperative principle: Make your contribution as is required, when it is required, by the conversation in which you are engaged.

1. Quality: Contribute only what you know to be true. Do not say false things. Do not say things for which you lack evidence.

2. Quantity: Make your contribution as informative as is required. Do not say more than is required.

3. Relation (Relevance): Make your contribution relevant.

4. Manner: (i) Avoid obscurity; (ii) avoid ambiguity; (iii) be brief; (iv) be orderly.

5. ...

Page 22: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Pursuing a Gricean idealThe cooperative principle: Make your contribution as is required, when it is required, by the conversation in which you are engaged.

1. Quality: Contribute only what you know to be true. Do not say false things. Do not say things for which you lack evidence.

2. Quantity: Make your contribution as informative as is required. Do not say more than is required.

3. Relation (Relevance): Make your contribution relevant.

4. Manner: (i) Avoid obscurity; (ii) avoid ambiguity; (iii) be brief; (iv) be orderly.

5. ...

Page 23: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Pursuing a Gricean idealThe cooperative principle: Make your contribution as is required, when it is required, by the conversation in which you are engaged.

1. Quality: Contribute only what you know to be true. Do not say false things. Do not say things for which you lack evidence.

2. Quantity: Make your contribution as informative as is required. Do not say more than is required.

3. Relation (Relevance): Make your contribution relevant.

4. Manner: (i) Avoid obscurity; (ii) avoid ambiguity; (iii) be brief; (iv) be orderly.

5. ...

Page 24: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Pursuing a Gricean idealThe cooperative principle: Make your contribution as is required, when it is required, by the conversation in which you are engaged.

1. Quality: Contribute only what you know to be true. Do not say false things. Do not say things for which you lack evidence.

2. Quantity: Make your contribution as informative as is required. Do not say more than is required.

3. Relation (Relevance): Make your contribution relevant.

4. Manner: (i) Avoid obscurity; (ii) avoid ambiguity; (iii) be brief; (iv) be orderly.

5. ...

Page 25: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Pursuing a Gricean idealThe cooperative principle: Make your contribution as is required, when it is required, by the conversation in which you are engaged.

1. Quality: Contribute only what you know to be true. Do not say false things. Do not say things for which you lack evidence.

2. Quantity: Make your contribution as informative as is required. Do not say more than is required.

3. Relation (Relevance): Make your contribution relevant.

4. Manner: (i) Avoid obscurity; (ii) avoid ambiguity; (iii) be brief; (iv) be orderly.

5. ...

Page 26: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicature

Page 27: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicatureProposition q is a conversational implicature of an utterance U if and only if

Page 28: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicatureProposition q is a conversational implicature of an utterance U if and only if

1. The speaker S believes it is mutual, public knowledge of all discourse participants that S is obeying the cooperative principle.

Page 29: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicatureProposition q is a conversational implicature of an utterance U if and only if

1. The speaker S believes it is mutual, public knowledge of all discourse participants that S is obeying the cooperative principle.

2. S believes that, to maintain (1) given U, the discourse participants will assume S believes q.

Page 30: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicatureProposition q is a conversational implicature of an utterance U if and only if

1. The speaker S believes it is mutual, public knowledge of all discourse participants that S is obeying the cooperative principle.

2. S believes that, to maintain (1) given U, the discourse participants will assume S believes q.

3. S believes it is mutual, public knowledge of all discourse participants that (2) holds.

Page 31: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicatureProposition q is a conversational implicature of an utterance U if and only if

1. The speaker S believes it is mutual, public knowledge of all discourse participants that S is obeying the cooperative principle.

2. S believes that, to maintain (1) given U, the discourse participants will assume S believes q.

3. S believes it is mutual, public knowledge of all discourse participants that (2) holds.

Alex: What city does Paul live in?

Ryan: Hmm, he lives in California.

Page 32: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicatureProposition q is a conversational implicature of an utterance U if and only if

1. The speaker S believes it is mutual, public knowledge of all discourse participants that S is obeying the cooperative principle.

2. S believes that, to maintain (1) given U, the discourse participants will assume S believes q.

3. S believes it is mutual, public knowledge of all discourse participants that (2) holds.

Alex: What city does Paul live in?

Ryan: Hmm, he lives in California.

A. Assume Ryan is cooperative.B. Ryan supplied less information that was required,

seemingly contradicting (A).C. Assume Ryan doesn’t know what city Paul lives in = q.D. Then Ryan’s answer is optimal given this evidence.

Page 33: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicature

Page 34: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicature

Page 35: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicature

Page 36: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicature

My friend has glasses.

Page 37: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicature

My friend has glasses.

My listener knows I’m cooperative in the Gricean sense.

Page 38: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicature

My friend has glasses.

My listener knows I’m cooperative in the Gricean sense.

So they will be able to work out that I mean “not hat” as well.

Page 39: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicature

My friend has glasses.

My listener knows I’m cooperative in the Gricean sense.

The speaker’s utterance seems ambiguous or under-informative.

So they will be able to work out that I mean “not hat” as well.

Page 40: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicature

My friend has glasses.

My listener knows I’m cooperative in the Gricean sense.

The speaker’s utterance seems ambiguous or under-informative.

But I’m assuming the speaker is cooperative in the Gricean sense!

So they will be able to work out that I mean “not hat” as well.

Page 41: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicature

My friend has glasses.

My listener knows I’m cooperative in the Gricean sense.

The speaker’s utterance seems ambiguous or under-informative.

But I’m assuming the speaker is cooperative in the Gricean sense!

Ah, but if I assume they mean to convey “not hat” too, then all’s well!

So they will be able to work out that I mean “not hat” as well.

Page 42: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Conversational implicature

My friend has glasses.

My listener knows I’m cooperative in the Gricean sense.

The speaker’s utterance seems ambiguous or under-informative.

But I’m assuming the speaker is cooperative in the Gricean sense!

Ah, but if I assume they mean to convey “not hat” too, then all’s well!

So they will be able to work out that I mean “not hat” as well.

Page 43: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The Rational Speech Acts Model (RSA)

Page 44: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The Rational Speech Acts Model (RSA)

Page 45: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A simple reference game

Page 46: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A simple reference game

r1 r2

Page 47: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A simple reference game

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

r1 r2 ⟦⟧

Page 48: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A simple reference game

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

r1 0.5

r2 0.5

r1 r2 ⟦⟧ P

Page 49: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A simple reference game

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

r1 0.5

r2 0.5

‘hat’ 0

‘glasses’ 0

r1 r2 ⟦⟧ P C

Page 50: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A simple reference game

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

r1 0.5

r2 0.5

‘hat’ 0

‘glasses’ 0

r1 r2 ⟦⟧ P C

𝜶 = 1

Page 51: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A simple reference game

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

r1 0.5

r2 0.5

‘hat’ 0

‘glasses’ 0

r1 r2 ⟦⟧ P C

𝜶 = 1 r1 r2 C

‘hat’ 0 1 0

‘glasses’ 1 1 0

P 0.5 0.5

𝜶 = 1

Page 52: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicature 𝜶 = 1 r1 r2 C

‘hat’ 0 1 0

‘glasses’ 1 1 0

P 0.5 0.5

Page 53: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1

Page 54: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

Page 55: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

referents r given messages m

Page 56: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

truth value of message m for referent r

referents r given messages m

Page 57: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

sum of all truth values of message m over all referents r′

truth value of message m for referent r

referents r given messages m

Page 58: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

⟦‘hat’⟧(r1)

⟦‘hat’⟧(r1) + ⟦‘hat’⟧(r2)

Page 59: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

⟦‘hat’⟧(r1)

⟦‘hat’⟧(r1) + ⟦‘hat’⟧(r2)

Page 60: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

⟦‘hat’⟧(r1)

⟦‘hat’⟧(r1) + ⟦‘hat’⟧(r2)

Page 61: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

⟦‘hat’⟧(r1)

⟦‘hat’⟧(r1) + ⟦‘hat’⟧(r2)

0

0 + 1 =

Page 62: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

⟦‘hat’⟧(r1)

⟦‘hat’⟧(r1) + ⟦‘hat’⟧(r2)

0

0 + 1 = = 0

Page 63: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

⟦‘glasses’⟧(r2)

⟦‘glasses’⟧(r1) + ⟦‘glasses’⟧(r2)

Page 64: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

⟦‘glasses’⟧(r2)

⟦‘glasses’⟧(r1) + ⟦‘glasses’⟧(r2)

Page 65: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

⟦‘glasses’⟧(r2)

⟦‘glasses’⟧(r1) + ⟦‘glasses’⟧(r2)

Page 66: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

1

1 + 1 =

⟦‘glasses’⟧(r2)

⟦‘glasses’⟧(r1) + ⟦‘glasses’⟧(r2)

Page 67: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

1

1 + 1 = = 0.5

⟦‘glasses’⟧(r2)

⟦‘glasses’⟧(r1) + ⟦‘glasses’⟧(r2)

Page 68: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

Page 69: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

Page 70: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

r1

Page 71: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

r1

r2

Page 72: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’

r1

r2

Page 73: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1

r2

Page 74: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

Page 75: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

Page 76: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

messages m given referents r

Page 77: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

messages m given referents r

literal listener, rather than truth conditions

Page 78: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

PLit(r2 | ‘hat’)

PLit(r2 | ‘hat’) + PLit(r2 | ‘glasses’)

Page 79: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

PLit(r2 | ‘hat’)

PLit(r2 | ‘hat’) + PLit(r2 | ‘glasses’)

Page 80: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

PLit(r2 | ‘hat’)

PLit(r2 | ‘hat’) + PLit(r2 | ‘glasses’)

Page 81: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

PLit(r2 | ‘hat’)

PLit(r2 | ‘hat’) + PLit(r2 | ‘glasses’)

1

1 + 0.5 =

Page 82: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

PLit(r2 | ‘hat’)

PLit(r2 | ‘hat’) + PLit(r2 | ‘glasses’)

1

1 + 0.5 = = 0.67

Page 83: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

Page 84: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

Page 85: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

Page 86: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

‘hat’

Page 87: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

‘hat’

‘glasses’

Page 88: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

r1

‘hat’

‘glasses’

Page 89: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

r1 r2

‘hat’

‘glasses’

Page 90: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

r1 r2

‘hat’ 0 0.67

‘glasses’ 1 0.33

Page 91: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.75 0.25

Page 92: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.75 0.25

Page 93: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.75 0.25

Page 94: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.75 0.25

Page 95: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A scalar implicaturer1 r2

‘hat’ 0 1

‘glasses’ 1 1PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.75 0.25

Page 96: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation in more detail

Page 97: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

Page 98: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

Normalize the rows

Page 99: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

Normalize the rowsTranspose

Page 100: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

Normalize the rowsTranspose

Normalize the rows

Page 101: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

r1 r2

‘hat’ 0 0.67

‘glasses’ 1 0.33

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

Normalize the rowsTranspose Transpose

Normalize the rows

Page 102: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

r1 r2

‘hat’ 0 0.67

‘glasses’ 1 0.33

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.75 0.25

Normalize the rowsTranspose Transpose

Normalize the rows Normalize the rows

Page 103: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costs𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

Page 104: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

Page 105: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

Page 106: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

= 1 so we can ignore it for now

Page 107: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

from probabilities to scores

Page 108: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

from probabilities to scores

so we can bring in real-valued costs

Page 109: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

from probabilities to scores

so we can bring in real-valued costs

returns us normalizable values

Page 110: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

from probabilities to scores

so we can bring in real-valued costs

often written e𝜶(log PLit(r|m) + C(m))

returns us normalizable values

Page 111: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

from probabilities to scores

so we can bring in real-valued costs

Note: exp(log(x)) = x, which is why we could leave this out when we didn’t have costs and 𝜶 = 1

often written e𝜶(log PLit(r|m) + C(m))

returns us normalizable values

Page 112: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

exp(log(PLit(r2 | ‘hat’) + C(‘hat’)))

exp(log(PLit(r2 | ‘hat’) + C(‘hat’))) + exp(log(PLit(r2 | ‘glasses’) + C(‘glasses’)))

Page 113: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

exp(log(PLit(r2 | ‘hat’) + C(‘hat’)))

exp(log(PLit(r2 | ‘hat’) + C(‘hat’))) + exp(log(PLit(r2 | ‘glasses’) + C(‘glasses’)))

Page 114: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

exp(log(PLit(r2 | ‘hat’) + C(‘hat’)))

exp(log(PLit(r2 | ‘hat’) + C(‘hat’))) + exp(log(PLit(r2 | ‘glasses’) + C(‘glasses’)))

Page 115: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

exp(log(PLit(r2 | ‘hat’) + C(‘hat’)))

exp(log(PLit(r2 | ‘hat’) + C(‘hat’))) + exp(log(PLit(r2 | ‘glasses’) + C(‘glasses’)))

Page 116: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

exp(log(PLit(r2 | ‘hat’) + C(‘hat’)))

exp(log(PLit(r2 | ‘hat’) + C(‘hat’))) + exp(log(PLit(r2 | ‘glasses’) + C(‘glasses’)))

Page 117: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

exp(log(1) – 6)

exp(log(1) – 6) + exp(log(0.5) – 0)=

exp(log(PLit(r2 | ‘hat’) + C(‘hat’)))

exp(log(PLit(r2 | ‘hat’) + C(‘hat’))) + exp(log(PLit(r2 | ‘glasses’) + C(‘glasses’)))

Page 118: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of message costsPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.5012 0.4988

𝜶 = 1 r1 r2 C

‘hat’ 0 1 –6

‘glasses’ 1 1 0

Page 119: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with costs in more detail

Page 120: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with costs in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

Page 121: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with costs in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

Normalize

Page 122: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with costs in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

Transpose

Page 123: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with costs in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

‘hat’ ‘glasses’

r1 exp(log(0) – 6) exp(log(0.5) – 0)

r2 exp(log(1) – 6) exp(log(0.5) – 0)

Add costs

Page 124: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with costs in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

‘hat’ ‘glasses’

r1 exp(log(0) – 6) exp(log(0.5) – 0)

r2 exp(log(1) – 6) exp(log(0.5) – 0)

‘hat’ ‘glasses’

r1 0 0.5

r2 0.0025 0.5

Page 125: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with costs in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 0.0025 0.5

Page 126: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with costs in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

‘hat’ ‘glasses’

r1 0 0.5

r2 0.0025 0.5

Normalize

Page 127: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with costs in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

‘hat’ ‘glasses’

r1 0 0.5

r2 0.0025 0.5

r1 r2

‘hat’ 0 0.0049

‘glasses’ 1 0.9951

Transpose

Page 128: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with costs in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

‘hat’ ‘glasses’

r1 0 0.5

r2 0.0025 0.5

r1 r2

‘hat’ 0 0.0049

‘glasses’ 1 0.9951

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.5012 0.4988

Normalize

Page 129: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with costs in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

‘hat’ ‘glasses’

r1 0 0.5

r2 1 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.0049 0.9951

‘hat’ ‘glasses’

r1 0 0.5

r2 0.0025 0.5

r1 r2

‘hat’ 0 0.0049

‘glasses’ 1 0.9951

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.5012 0.4988

Page 130: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of the alpha parameter

Page 131: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of the alpha parameterPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

Page 132: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of the alpha parameterPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

𝜶 = 1.0

Page 133: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of the alpha parameterPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.94 0.06

𝜶 = 1.0

𝜶 = 4.0

Page 134: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of the alpha parameterPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.94 0.06

𝜶 = 1.0

𝜶 = 4.0

exp(1 * log(0.75)) = 3 * exp(1 * log(0.25))

Page 135: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of the alpha parameterPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.94 0.06

𝜶 = 1.0

𝜶 = 4.0

exp(1 * log(0.75)) = 3 * exp(1 * log(0.25))

exp(4 * log(0.75)) = 81 * exp(4 * log(0.25))

Page 136: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of the alpha parameterPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.5 0.5

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.67 0.33

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.94 0.06

𝜶 = 1.0

𝜶 = 4.0 Higher 𝜶 means stronger pragmatic inferences

exp(1 * log(0.75)) = 3 * exp(1 * log(0.25))

exp(4 * log(0.75)) = 81 * exp(4 * log(0.25))

Page 137: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorr1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

Page 138: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

Page 139: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

Page 140: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

Page 141: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

⟦‘glasses’⟧(r2) * P(r2)

⟦‘glasses’⟧(r1) * P(r1) + ⟦‘glasses’⟧(r2) * P(r2)

Page 142: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

⟦‘glasses’⟧(r2) * P(r2)

⟦‘glasses’⟧(r1) * P(r1) + ⟦‘glasses’⟧(r2) * P(r2)

Page 143: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

⟦‘glasses’⟧(r2) * P(r2)

⟦‘glasses’⟧(r1) * P(r1) + ⟦‘glasses’⟧(r2) * P(r2)

Page 144: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

1*0.7

1*0.3 + 1*0.7 = = 0.7

⟦‘glasses’⟧(r2) * P(r2)

⟦‘glasses’⟧(r1) * P(r1) + ⟦‘glasses’⟧(r2) * P(r2)

Page 145: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

Page 146: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

Page 147: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.59 0.41

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

Page 148: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.59 0.41

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.51 0.49

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

Page 149: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The role of referent priorPLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.59 0.41

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.51 0.49

r1 r2

‘hat’ 0 1

‘glasses’ 1 1

P 0.3 0.7

Page 150: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detail

Page 151: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

Page 152: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

r1 r2

‘hat’ 0*0.3 1*0.7

‘glasses’ 1*0.3 1*0.7

Incorporate priors

Page 153: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

r1 r2

‘hat’ 0*0.3 1*0.7

‘glasses’ 1*0.3 1*0.7

r1 r2

‘hat’ 0 0.7

‘glasses’ 0.3 0.7

Page 154: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

r1 r2

‘hat’ 0 0.7

‘glasses’ 0.3 0.7

Page 155: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 0.7

‘glasses’ 0.3 0.7

Normalize

Page 156: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

‘hat’ ‘glasses’

r1 0 0.3

r2 1 0.7

r1 r2

‘hat’ 0 0.7

‘glasses’ 0.3 0.7 Transpose

Page 157: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

‘hat’ ‘glasses’

r1 0 0.3

r2 1 0.7

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.59 0.41

r1 r2

‘hat’ 0 0.7

‘glasses’ 0.3 0.7

Normalize

Page 158: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

‘hat’ ‘glasses’

r1 0 0.3

r2 1 0.7

r1 r2

‘hat’ 0 0.59

‘glasses’ 1 0.41

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.59 0.41

r1 r2

‘hat’ 0 0.7

‘glasses’ 0.3 0.7 Transpose

Page 159: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

‘hat’ ‘glasses’

r1 0 0.3

r2 1 0.7

r1 r2

‘hat’ 0 0.59

‘glasses’ 1 0.41

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.59 0.41

r1 r2

‘hat’ 0 0.7

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0*0.3 0.59*0.7

‘glasses’ 1*0.3 0.41*0.7

Incorporate priors

Page 160: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

‘hat’ ‘glasses’

r1 0 0.3

r2 1 0.7

r1 r2

‘hat’ 0 0.59

‘glasses’ 1 0.41

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.59 0.41

r1 r2

‘hat’ 0 0.7

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 0.413

‘glasses’ 0.3 0.287

Page 161: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

‘hat’ ‘glasses’

r1 0 0.3

r2 1 0.7

r1 r2

‘hat’ 0 0.59

‘glasses’ 1 0.41

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.59 0.41

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.51 0.49

r1 r2

‘hat’ 0 0.7

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 0.413

‘glasses’ 0.3 0.287

Normalize

Page 162: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

The calculation with referent prior in more detailr1 r2

‘hat’ 0 1

‘glasses’ 1 1

PLit r1 r2

‘hat’ 0 1

‘glasses’ 0.3 0.7

‘hat’ ‘glasses’

r1 0 0.3

r2 1 0.7

r1 r2

‘hat’ 0 0.59

‘glasses’ 1 0.41

PS ‘hat’ ‘glasses’

r1 0 1

r2 0.59 0.41

PL r1 r2

‘hat’ 0 1

‘glasses’ 0.51 0.49

r1 r2

‘hat’ 0 0.7

‘glasses’ 0.3 0.7

r1 r2

‘hat’ 0 0.413

‘glasses’ 0.3 0.287

Page 163: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

A simple Python implementation

http://web.stanford.edu/class/linguist130a/

Page 164: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Major achievementsIncremental implicatures Cohn-Gordon, Goodman, Potts, ‘A incremental, iterated response model of

pragmatics’

Manner implicatures Bergen, Levy, Goodman, ‘Pragmatic reasoning through semantic inference’

I-implicatures and implicature blocking Potts & Levy, ‘Negotiating lexical uncertainty and speaker expertise with disjunction’

Embedded implicatures Potts, Lassiter, Levy, Frank, ‘Embedded implicatures as pragmatic inferences under compositional lexical uncertainty’

Hyperbole Kao, Wu, Bergen, Goodman, ‘Nonliteral understanding of number words’

Metaphor Kao, Bergen, Goodman, ‘Formalizing the pragmatics of metaphor understanding’

Politeness Yoon, Tessler, Goodman, Frank, ‘Polite speech emerges from competing social goals’

Irony Cohn-Gordon and Bergen, ‘Verbal irony, pretense, and the common ground’

Social meaning Work by E. Allyn Smith, Heather Burnett, Eric Acton, and others

Large-scale machine learning problems Work by Will Monroe, Jacob Andreas, Reuben Cohn-Gordon, and others

Page 165: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Major achievementsIncremental implicatures Cohn-Gordon, Goodman, Potts, ‘A incremental, iterated response model of

pragmatics’

Manner implicatures Bergen, Levy, Goodman, ‘Pragmatic reasoning through semantic inference’

I-implicatures and implicature blocking Potts & Levy, ‘Negotiating lexical uncertainty and speaker expertise with disjunction’

Embedded implicatures Potts, Lassiter, Levy, Frank, ‘Embedded implicatures as pragmatic inferences under compositional lexical uncertainty’

Hyperbole Kao, Wu, Bergen, Goodman, ‘Nonliteral understanding of number words’

Metaphor Kao, Bergen, Goodman, ‘Formalizing the pragmatics of metaphor understanding’

Politeness Yoon, Tessler, Goodman, Frank, ‘Polite speech emerges from competing social goals’

Irony Cohn-Gordon and Bergen, ‘Verbal irony, pretense, and the common ground’

Social meaning Work by E. Allyn Smith, Heather Burnett, Eric Acton, and others

Large-scale machine learning problems Work by Will Monroe, Jacob Andreas, Reuben Cohn-Gordon, and others

Page 166: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Manner implicatures Stop the car tends to signal a normal event.

Cause the car to stop tends to signal an unusual event.

Page 167: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Manner implicatures Stop the car tends to signal a normal event.

Cause the car to stop tends to signal an unusual event.

Page 168: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Manner implicatures Stop the car tends to signal a normal event.

Cause the car to stop tends to signal an unusual event.

Page 169: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Manner implicatures Stop the car tends to signal a normal event.

Cause the car to stop tends to signal an unusual event.

Page 170: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Manner implicatures Stop the car tends to signal a normal event.

Cause the car to stop tends to signal an unusual event.

Page 171: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Manner implicatures Stop the car tends to signal a normal event.

Cause the car to stop tends to signal an unusual event.

Page 172: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Manner implicatures Stop the car tends to signal a normal event.

Cause the car to stop tends to signal an unusual event.

Page 173: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Joint inference over utterance and lexicon

Page 174: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Joint inference over utterance and lexicon

Page 175: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Our uncertain lexicons1. synagogues and other churches

Page 176: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Our uncertain lexicons1. synagogues and other churches2. synagogues or churches

Page 177: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Our uncertain lexicons1. synagogues and other churches2. synagogues or churches3. You may need angioplasty or surgery.

Page 178: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Our uncertain lexicons1. synagogues and other churches2. synagogues or churches3. You may need angioplasty or surgery.4. He’s a wine lover, or oenophile.

Page 179: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Our uncertain lexicons1. synagogues and other churches2. synagogues or churches3. You may need angioplasty or surgery.4. He’s a wine lover, or oenophile.5. superb but not outstanding

Page 180: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Our uncertain lexicons1. synagogues and other churches2. synagogues or churches3. You may need angioplasty or surgery.4. He’s a wine lover, or oenophile.5. superb but not outstanding6. outstanding but not superb

Page 181: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Our uncertain lexicons1. synagogues and other churches2. synagogues or churches3. You may need angioplasty or surgery.4. He’s a wine lover, or oenophile.5. superb but not outstanding6. outstanding but not superb7. It’s a couch, not a sofa.

Page 182: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Our uncertain lexicons1. synagogues and other churches2. synagogues or churches3. You may need angioplasty or surgery.4. He’s a wine lover, or oenophile.5. superb but not outstanding6. outstanding but not superb7. It’s a couch, not a sofa.8. Does between 5 and 10 include 5 and 10?

Page 183: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Our uncertain lexicons1. synagogues and other churches2. synagogues or churches3. You may need angioplasty or surgery.4. He’s a wine lover, or oenophile.5. superb but not outstanding6. outstanding but not superb7. It’s a couch, not a sofa.8. Does between 5 and 10 include 5 and 10?9. Is a barbecue a machine?

Page 184: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Our uncertain lexicons1. synagogues and other churches2. synagogues or churches3. You may need angioplasty or surgery.4. He’s a wine lover, or oenophile.5. superb but not outstanding6. outstanding but not superb7. It’s a couch, not a sofa.8. Does between 5 and 10 include 5 and 10?9. Is a barbecue a machine?

10. Can a horse be an athlete?

Page 185: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Joint inference over utterance and something else

Page 186: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Joint inference over utterance and something else

Page 187: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Joint inference over utterance and something elseIncremental implicatures Cohn-Gordon, Goodman, Potts, ‘A incremental, iterated response model of

pragmatics’

Manner implicatures Listener inference over the lexicon

I-implicatures and implicature blocking Listener inference over the lexicon; speaker communication about the lexicon

Embedded implicatures Listener inference over the lexicon

Hyperbole Listener inference over a social/emotional goal

Metaphor Listener inference over the question under discussion

Politeness Speaker pursuing social and presentational goals

Irony Speaker communicating about the presumed common ground

Social meaning Work by E. Allyn Smith, Heather Burnett, Eric Acton, and others

Large-scale machine learning problems Work by Will Monroe, Jacob Andreas, Reuben Cohn-Gordon, and others

Page 188: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Wrapping up

Page 189: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Wrapping up1. My primary goal was to motivate RSA and walk you through some example

calculations.

Page 190: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Wrapping up1. My primary goal was to motivate RSA and walk you through some example

calculations.

2. My hope is that this leads you to think about joint inference versions of RSA that can model intricate pragmatic phenomena.

Page 191: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Wrapping up1. My primary goal was to motivate RSA and walk you through some example

calculations.

2. My hope is that this leads you to think about joint inference versions of RSA that can model intricate pragmatic phenomena.

3. Additional materials:

a. YouTube video of the core calculations: https://youtu.be/bPd6CNy5UqA

b. Python implementation: https://web.stanford.edu/class/linguist130a/materials/rsa130a.py

c. https://probmods.org

Page 192: Linguistics Association of Great Britain, Annual Meeting ...cgpotts/temp/potts-lagb2019-rsa-tutorial.pdf · Linguistics Association of Great Britain, Annual Meeting September 9, 2019

Wrapping up1. My primary goal was to motivate RSA and walk you through some example

calculations.

2. My hope is that this leads you to think about joint inference versions of RSA that can model intricate pragmatic phenomena.

3. Additional materials:

a. YouTube video of the core calculations: https://youtu.be/bPd6CNy5UqA

b. Python implementation: https://web.stanford.edu/class/linguist130a/materials/rsa130a.py

c. https://probmods.org

Thanks!