msr visit talk 2016 - i.konstas · joint generator temperature time min mean max 06:00-21:00 9 15...
TRANSCRIPT
![Page 1: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/1.jpg)
NEUGEN !
Text Generation from Meaning Representations
Yannis Konstas!!
Joint work with Mark Yatskar, Luke Zettlemoyer and Yejin Choi (UW)
~ Yonatan Bisk and Daniel Marcu (ISI)
![Page 2: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/2.jpg)
Motivation
![Page 3: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/3.jpg)
Motivation
Machine-generated Representation
![Page 4: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/4.jpg)
Motivation
Machine-generated Representation
![Page 5: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/5.jpg)
Motivation
Machine-generated Representation
![Page 6: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/6.jpg)
Motivation
Machine-generated Representation
source block: hk
target block: ms
pos RP: W scale: small
![Page 7: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/7.jpg)
Motivation
Machine-generated Representation
source block: hk
target block: ms
pos RP: W scale: small
Place the heineken block west of the mercedes block.
![Page 8: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/8.jpg)
Motivation
Machine-generated Representation
source block: hk
target block: ups
pos RP: W scale: big
![Page 9: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/9.jpg)
Motivation
Machine-generated Representation
source block: hk
target block: ups
pos RP: W scale: big
Place the heineken block in the first open space to the left of ups block.
![Page 10: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/10.jpg)
Motivation
![Page 11: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/11.jpg)
Motivation
Machine-generated Representation
![Page 12: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/12.jpg)
Motivation
Machine-generated Representation
Sentence Compression
![Page 13: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/13.jpg)
Motivation
Machine-generated Representation
Sentence Compression
Sentence Fusion
![Page 14: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/14.jpg)
Motivation
Machine-generated Representation
Sentence Compression
Sentence FusionParaphrasing
![Page 15: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/15.jpg)
NLG Pipeline
Content Selection
Document Planning
Surface Realisation
Sentence Planning
Text
Communicative Goal
Content Planning
A A A A
mInput
Reordering/Linearization
Splitting/Aggregation
Lexicalization
Framework
![Page 16: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/16.jpg)
NLG Pipeline
Content Selection
Document Planning
Surface Realisation
Sentence Planning
Text
Communicative Goal
Content Planning
A A A A
mInput
Reordering/Linearization
Splitting/Aggregation
Lexicalization
Framework
![Page 17: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/17.jpg)
NLG Pipeline
Content Selection
Document Planning
Surface Realisation
Sentence Planning
Text
Communicative Goal
Content Planning
A A A A
mInput
Reordering/Linearization
Splitting/Aggregation
Lexicalization- Neural Encoder - RNN Decoder - Graph Alignment
Framework
![Page 18: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/18.jpg)
Joint Generator Temperature
Time Min Mean Max
06:00-21:00 9 15 21
Wind Speed
Time Min Mean Max
06:00-21:00 15 20 30
Cloud Sky Cover
Time Percent (%)
06:00-09:00 25-5009:00-12:00 50-75
Wind Direction
Time Mode
06:00-21:00 S
S
...
S
...
S
...
S
...S
...
?? ?
Cloudy, with temperaturesbetween 10 and 20 degrees.South wind around 20 mph.
Training
S ! R(start)R(ri.t)!FS(rj , start)R(rj .t)R(ri.t)!FS(rj , start)FS(r, r.fi)!F(r, r.fj)FS(r, r.fj)FS(r, r.fi)!F(r, r.fj)F(r, r.f)!W(r, r.f)F(r, r.f)F(r, r.f)!W(r, r.f)W(r, r.f)!↵W(r, r.f)!g(f.v)
FS0,1(temp1,start)
FS0,2(temp1,start)
F0,1(temp1,min)
F0,1(temp1,max)
F0,2(temp1,min)
F0,2(temp1,max)
FS1,2(temp1,start)
(2) HypergraphRepresentation
FS0,5(skyCover1.t,start)
0
BB@
mostly cloudy ? the morning
mostly cloudy ? after 11am
mostly cloudy ? then becoming
· · ·
1
CCA
F0,2(skyCover1.t,%)
0
BB@
mostly cloudy
mostly clouds
cloudy ,
· · ·
1
CCAW4,5(skyCover1.t,time)
0
BB@
morning
11am
after
· · ·
1
CCAW0,1(skyCover1.t,%)
0
BB@
mostly
cloudy
sunny
· · ·
1
CCA
W1,2(skyCover1.t,%)
0
BB@
mostly
cloudy
sunny
· · ·
1
CCA
(3) k-best decodingvia integration
Testing
(1) PCFG Grammar
Konstas and Lapata, 2012, 2013
![Page 19: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/19.jpg)
Joint Generator Temperature
Time Min Mean Max
06:00-21:00 9 15 21
Wind Speed
Time Min Mean Max
06:00-21:00 15 20 30
Cloud Sky Cover
Time Percent (%)
06:00-09:00 25-5009:00-12:00 50-75
Wind Direction
Time Mode
06:00-21:00 S
S
...
S
...
S
...
S
...S
...
?? ?
Cloudy, with temperaturesbetween 10 and 20 degrees.South wind around 20 mph.
Training
S ! R(start)R(ri.t)!FS(rj , start)R(rj .t)R(ri.t)!FS(rj , start)FS(r, r.fi)!F(r, r.fj)FS(r, r.fj)FS(r, r.fi)!F(r, r.fj)F(r, r.f)!W(r, r.f)F(r, r.f)F(r, r.f)!W(r, r.f)W(r, r.f)!↵W(r, r.f)!g(f.v)
FS0,1(temp1,start)
FS0,2(temp1,start)
F0,1(temp1,min)
F0,1(temp1,max)
F0,2(temp1,min)
F0,2(temp1,max)
FS1,2(temp1,start)
(2) HypergraphRepresentation
FS0,5(skyCover1.t,start)
0
BB@
mostly cloudy ? the morning
mostly cloudy ? after 11am
mostly cloudy ? then becoming
· · ·
1
CCA
F0,2(skyCover1.t,%)
0
BB@
mostly cloudy
mostly clouds
cloudy ,
· · ·
1
CCAW4,5(skyCover1.t,time)
0
BB@
morning
11am
after
· · ·
1
CCAW0,1(skyCover1.t,%)
0
BB@
mostly
cloudy
sunny
· · ·
1
CCA
W1,2(skyCover1.t,%)
0
BB@
mostly
cloudy
sunny
· · ·
1
CCA
(3) k-best decodingvia integration
Testing
(1) PCFG Grammar
Konstas and Lapata, 2012, 2013
![Page 20: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/20.jpg)
Joint Generator Temperature
Time Min Mean Max
06:00-21:00 9 15 21
Wind Speed
Time Min Mean Max
06:00-21:00 15 20 30
Cloud Sky Cover
Time Percent (%)
06:00-09:00 25-5009:00-12:00 50-75
Wind Direction
Time Mode
06:00-21:00 S
S
...
S
...
S
...
S
...S
...
?? ?
Cloudy, with temperaturesbetween 10 and 20 degrees.South wind around 20 mph.
Training
S ! R(start)R(ri.t)!FS(rj , start)R(rj .t)R(ri.t)!FS(rj , start)FS(r, r.fi)!F(r, r.fj)FS(r, r.fj)FS(r, r.fi)!F(r, r.fj)F(r, r.f)!W(r, r.f)F(r, r.f)F(r, r.f)!W(r, r.f)W(r, r.f)!↵W(r, r.f)!g(f.v)
FS0,1(temp1,start)
FS0,2(temp1,start)
F0,1(temp1,min)
F0,1(temp1,max)
F0,2(temp1,min)
F0,2(temp1,max)
FS1,2(temp1,start)
(2) HypergraphRepresentation
FS0,5(skyCover1.t,start)
0
BB@
mostly cloudy ? the morning
mostly cloudy ? after 11am
mostly cloudy ? then becoming
· · ·
1
CCA
F0,2(skyCover1.t,%)
0
BB@
mostly cloudy
mostly clouds
cloudy ,
· · ·
1
CCAW4,5(skyCover1.t,time)
0
BB@
morning
11am
after
· · ·
1
CCAW0,1(skyCover1.t,%)
0
BB@
mostly
cloudy
sunny
· · ·
1
CCA
W1,2(skyCover1.t,%)
0
BB@
mostly
cloudy
sunny
· · ·
1
CCA
(3) k-best decodingvia integration
Testing
(1) PCFG Grammar
Konstas and Lapata, 2012, 2013
![Page 21: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/21.jpg)
More Complex Structure
![Page 22: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/22.jpg)
More Complex Structure
know-01
I planet
lazy
ARG0 ARG1
inhabit-01
man
ARG1-of
ARG0
mod
Input (Graph or Tree)
![Page 23: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/23.jpg)
More Complex Structure
know-01
I planet
lazy
ARG0 ARG1
inhabit-01
man
ARG1-of
ARG0
mod
Input (Graph or Tree)
AMR DAG
![Page 24: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/24.jpg)
More Complex Structure
know-01
I planet
lazy
ARG0 ARG1
inhabit-01
man
ARG1-of
ARG0
mod
Input (Graph or Tree)
AMR DAG
λ-calculus Expression Tree
![Page 25: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/25.jpg)
More Complex Structure
know-01
I planet
lazy
ARG0 ARG1
inhabit-01
man
ARG1-of
ARG0
mod
Input (Graph or Tree)
AMR DAG
λ-calculus Expression Tree
ECIs Tree
![Page 26: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/26.jpg)
More Complex Structure
know-01
I planet
lazy
ARG0 ARG1
inhabit-01
man
ARG1-of
ARG0
mod
Input (Graph or Tree)
I know a planet that is inhabited by a lazy man.
Output (Text)
AMR DAG
λ-calculus Expression Tree
ECIs Tree
![Page 27: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/27.jpg)
More Complex Structure
I knew a planet that was inhabited by a lazy man. (lpp_1943.249)
I have known a planet that was inhabited by a lazy man.
know-01
I planet
lazy
ARG0 ARG1
inhabit-01
man
ARG1-of
ARG0
mod
Input (Graph or Tree)
I know a planet that is inhabited by a lazy man.
Output (Text)
AMR DAG
λ-calculus Expression Tree
ECIs Tree
![Page 28: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/28.jpg)
More Complex Structure
I knew a planet that was inhabited by a lazy man. (lpp_1943.249)
I have known a planet that was inhabited by a lazy man.
I know about a planet. It is inhabited by a lazy man.
know-01
I planet
lazy
ARG0 ARG1
inhabit-01
man
ARG1-of
ARG0
mod
Input (Graph or Tree)
I know a planet that is inhabited by a lazy man.
Output (Text)
AMR DAG
λ-calculus Expression Tree
ECIs Tree
![Page 29: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/29.jpg)
NEUGEN Framework
ARG1-of
![Page 30: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/30.jpg)
NEUGEN Framework
ARG1-of
Encoder DecoderG w
![Page 31: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/31.jpg)
NEUGEN Framework
Encoder- Bag of Words: Concepts and roles- Attention mechanism
ARG1-of
Encoder DecoderG w
![Page 32: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/32.jpg)
NEUGEN Framework
Encoder- Bag of Words: Concepts and roles- Attention mechanism
Decoder- Left-to-right word LSTM - Greedy beam search
ARG1-of
Encoder DecoderG w
![Page 33: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/33.jpg)
NEUGEN Framework
Encoder- Bag of Words: Concepts and roles- Attention mechanism
Decoder- Left-to-right word LSTM - Greedy beam search
ARG1-of
Encoder DecoderG wReranker
![Page 34: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/34.jpg)
NEUGEN Framework
Encoder- Bag of Words: Concepts and roles- Attention mechanism
Decoder- Left-to-right word LSTM - Greedy beam search
Reranker
ARG1-of
Encoder DecoderG wReranker
![Page 35: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/35.jpg)
NEUGEN Framework
Encoder- Bag of Words: Concepts and roles- Attention mechanism
Decoder- Left-to-right word LSTM - Greedy beam search
Reranker- CCG parser -> semantics
ARG1-of
Encoder DecoderG wReranker
![Page 36: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/36.jpg)
NEUGEN Framework
Encoder- Bag of Words: Concepts and roles- Attention mechanism
Decoder- Left-to-right word LSTM - Greedy beam search
Reranker- CCG parser -> semantics- Partial propositions graph Eincr
ARG1-of
Encoder DecoderG wReranker
![Page 37: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/37.jpg)
NEUGEN Framework
Encoder- Bag of Words: Concepts and roles- Attention mechanism
Decoder- Left-to-right word LSTM - Greedy beam search
Reranker- CCG parser -> semantics- Partial propositions graph Eincr
ARG1-of
Aligner
Encoder DecoderG w
Eincr
G
Aligner- Feed-forward NN with attention
Reranker
![Page 38: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/38.jpg)
NEUGEN Framework
Encoder- Bag of Words: Concepts and roles- Attention mechanism
Decoder- Left-to-right word LSTM - Greedy beam search
Reranker- CCG parser -> semantics- Partial propositions graph Eincr
ARG1-of
Aligner
Encoder DecoderG w
Eincr
G salign
Aligner- Feed-forward NN with attention- salign = fit(G, Eincr)
Reranker
![Page 39: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/39.jpg)
Alignment
![Page 40: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/40.jpg)
Alignment
w: A man inhabited a planet
![Page 41: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/41.jpg)
Alignment
w: A man inhabited a planet
man
inhabit
agent
planet
patient
Eincr
![Page 42: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/42.jpg)
Alignment
know-01
I planet
lazy
ARG0 ARG1
inhabit-01
man
ARG1-of
ARG0
mod
G
w: A man inhabited a planet
man
inhabit
agent
planet
patient
Eincr
![Page 43: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/43.jpg)
Alignment
know-01
I planet
lazy
ARG0 ARG1
inhabit-01
man
ARG1-of
ARG0
mod
G
w: A man inhabited a planet
man
inhabit
agent
planet
patient
Eincr
fit(G, Eincr)
![Page 44: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/44.jpg)
Alignment
know-01
I planet
lazy
ARG0 ARG1
inhabit-01
man
ARG1-of
ARG0
mod
G
w: A man inhabited a planet
man
inhabit
agent
planet
patient
Eincr
fit(G, Eincr)
<inhabit, man, agent>!<inhabit, planet, patient>
<know-01, I, A0>!<know-01, planet, A1>!<planet, inhabit-01, A1-of>!<inhabit-01, man, A0>!<man, lazy, mod>
![Page 45: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/45.jpg)
Alignment <know, I, A0>!
!<know, planet, A1>!
!<planet, inhabit, A1-of>!
!<inhabit, man, A0>!
!<man, lazy, mod>
G
[0..1]
fitness score
<inhabit, man, agent>!!!!
<inhabit, planet, patient>
Eincr
E1:
. attention weights
+
max
![Page 46: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/46.jpg)
Alignment
<inhabit, planet, patient>!!!!
<inhabit, man, agent>
<know, I, A0>!!
<know, planet, A1>!!
<planet, inhabit, A1-of>!!
<inhabit, man, A0>!!
<man, lazy, mod>
Eincr
G
E2:
fit(G,Eincr) =1
n
nX
i=0
fit(G,Ei)
[0..1]
fitness score
attention weights
+
max
.
![Page 47: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/47.jpg)
Decoding
encoder(G)
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
G
![Page 48: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/48.jpg)
Decoding
encoder(G)
;know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
G
![Page 49: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/49.jpg)
Decoding
encoder(G)
;
I The A …
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
G
![Page 50: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/50.jpg)
Decoding
encoder(G)
;
I The A …
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
…
w11: I
Thew12:
Manw13:
Treew14:G
![Page 51: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/51.jpg)
Decoding
encoder(G)
;
I The A …
re-score:
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
…
w11: I
Thew12:
Manw13:
Treew14:G
sLSTM
![Page 52: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/52.jpg)
Decoding
encoder(G)
;
I The A …
know knew planet …
re-score:
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
…
w11: I
Thew12:
Manw13:
Treew14:G
sLSTM
![Page 53: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/53.jpg)
Decoding
encoder(G)
;
I The A …
know knew planet …
re-score:
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
…
w11: I
Thew12:
Manw13:
Treew14:
…
I know
agent
w21:
I knew
agent
w22:
The planetw23:
Man planetw24:G
sLSTM + salign
![Page 54: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/54.jpg)
Decoding
encoder(G)
;
I The A …
know knew planet …
re-score:
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
…
w11: I
Thew12:
Manw13:
Treew14:
…
I know
agent
w21:
I knew
agent
w22:
The planetw23:
Man planetw24:G
sLSTM + salign
![Page 55: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/55.jpg)
Decoding
encoder(G)
;
I The A …
know knew planet …
a planet man …
re-score:
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
…
…
w11: I
Thew12:
Manw13:
Treew14:
…
I know
agent
w21:
I knew
agent
w22:
The planetw23:
Man planetw24:G
sLSTM + salign
![Page 56: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/56.jpg)
Decoding
encoder(G)
;
I The A …
know knew planet …
a planet man …
re-score:
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
…
…
w11: I
Thew12:
Manw13:
Treew14:
…
I know
agent
w21:
I knew
agent
w22:
The planetw23:
Man planetw24:
w41: I know
agent
a planet
patient
w42: I knew
agent
planets that
patient
w43: The planet I knewagentpatient
w44: Man know
agent
a planet
patient
that
…G
sLSTM + salign
![Page 57: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/57.jpg)
Decoding
encoder(G)
;
I The A …
know knew planet …
a planet man …
re-score:
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
…
…
w11: I
Thew12:
Manw13:
Treew14:
…
I know
agent
w21:
I knew
agent
w22:
The planetw23:
Man planetw24:
w41: I know
agent
a planet
patient
w42: I knew
agent
planets that
patient
w43: The planet I knewagentpatient
w44: Man know
agent
a planet
patient
that
…G
sLSTM + salign
![Page 58: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/58.jpg)
?
Decoding
encoder(G)
;
I The A …
know knew planet …
a planet man …
re-score:
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
…
…
w11: I
Thew12:
Manw13:
Treew14:
…
I know
agent
w21:
I knew
agent
w22:
The planetw23:
Man planetw24:
w41: I know
agent
a planet
patient
w42: I knew
agent
planets that
patient
w43: The planet I knewagentpatient
w44: Man know
agent
a planet
patient
that
…G
sLSTM + salign
![Page 59: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/59.jpg)
?
Decoding
encoder(G)
;
I The A …
know knew planet …
a planet man …
re-score:
know
I planet
lazy
ARG0 ARG1
inhabit
man
ARG1-of
ARG0
mod
…
…
w11: I
Thew12:
Manw13:
Treew14:
…
I know
agent
w21:
I knew
agent
w22:
The planetw23:
Man planetw24:
w41: I know
agent
a planet
patient
w42: I knew
agent
planets that
patient
w43: The planet I knewagentpatient
w44: Man know
agent
a planet
patient
that
…
inhabit inhabited was …
G
sLSTM + salign
![Page 60: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/60.jpg)
Preliminary Results
![Page 61: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/61.jpg)
Preliminary Results Experimental Setup
![Page 62: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/62.jpg)
Preliminary Results Experimental Setup- Baseline RNN w/o alignment- NeuGen
![Page 63: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/63.jpg)
Preliminary Results Experimental Setup- Baseline RNN w/o alignment- NeuGen
Dataset
![Page 64: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/64.jpg)
Preliminary Results Experimental Setup- Baseline RNN w/o alignment- NeuGen
Dataset- AMR LDC2015E86- Train: 15k, Dev: 1.2k, Test: 1.2k
![Page 65: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/65.jpg)
Preliminary Results Experimental Setup- Baseline RNN w/o alignment- NeuGen
Dataset- AMR LDC2015E86- Train: 15k, Dev: 1.2k, Test: 1.2k
0
5.5
11
16.5
22
BLEU-4 METEOR
BaselineNeuGen
![Page 66: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/66.jpg)
Example Output
![Page 67: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/67.jpg)
Example Output person
Gallardo found-01
domain ARG0-of
Tijuana Drug Cartel
ARG1
Gflee-01
ARG0-of
![Page 68: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/68.jpg)
Example Output Gold: Gallardo is the fugitive founder of Tijuana Drug Cartel.!!Baseline: Gallardo is the founder of Tijuana Drug Cartel.!!NeuGen: Tijunana Drug Cartel is the founder of Gallardo.
person
Gallardo found-01
domain ARG0-of
Tijuana Drug Cartel
ARG1
Gflee-01
ARG0-of
![Page 69: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/69.jpg)
Example Output Gold: Gallardo is the fugitive founder of Tijuana Drug Cartel.!!Baseline: Gallardo is the founder of Tijuana Drug Cartel.!!NeuGen: Tijunana Drug Cartel is the founder of Gallardo.
person
Gallardo found-01
domain ARG0-of
Tijuana Drug Cartel
ARG1
Gflee-01
ARG0-of
Gallardo !Tijuana Drug Cartel !State !Country !…
![Page 70: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/70.jpg)
Example Output Gold: Gallardo is the fugitive founder of Tijuana Drug Cartel.!!Baseline: Gallardo is the founder of Tijuana Drug Cartel.!!NeuGen: Tijunana Drug Cartel is the founder of Gallardo.
person
Gallardo found-01
domain ARG0-of
Tijuana Drug Cartel
ARG1
Gflee-01
ARG0-of
Gallardo !Tijuana Drug Cartel !State !Country !…
Gallardo is the founder of !!Gallardo ’s Tijuana Drug Cartel is the !…
patient
agent
-19.82
-17.79
Tijuana Drug Cartel is the founder of !!!Tijuana Drug Cartel was the founder of !…
patient
patient
-18.67
-20.24
![Page 71: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/71.jpg)
Example Output Gold: Gallardo is the fugitive founder of Tijuana Drug Cartel.!!Baseline: Gallardo is the founder of Tijuana Drug Cartel.!!NeuGen: Tijunana Drug Cartel is the founder of Gallardo.
person
Gallardo found-01
domain ARG0-of
Tijuana Drug Cartel
ARG1
Gflee-01
ARG0-of
Gallardo !Tijuana Drug Cartel !State !Country !…
Gallardo is the founder of !!Gallardo ’s Tijuana Drug Cartel is the !…
patient
agent
-19.82
-17.79
Tijuana Drug Cartel is the founder of !!!Tijuana Drug Cartel was the founder of !…
patient
patient
-18.67
-20.24
Gallardo is the founder of Tijuana Drug Cartel.
agentpatient -19.59
Tijuana Drug Cartel is the founder of Gallardo.
agentpatient -17.84
![Page 72: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/72.jpg)
Next Steps
![Page 73: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/73.jpg)
Next Steps
- “Machine-generated” representations - λ-calculus (ATIS) - Blocks World complex descriptions (from ISI)
![Page 74: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/74.jpg)
Next Steps
- “Machine-generated” representations - λ-calculus (ATIS) - Blocks World complex descriptions (from ISI)
![Page 75: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/75.jpg)
Next Steps
- “Machine-generated” representations - λ-calculus (ATIS) - Blocks World complex descriptions (from ISI)
- Downstream Text-to-Text Applications
![Page 76: MSR Visit Talk 2016 - i.konstas · Joint Generator Temperature Time Min Mean Max 06:00-21:00 9 15 21 Wind Speed Time Min Mean Max 06:00-21:0015 20 30 Cloud Sky Cover Time Percent](https://reader033.vdocument.in/reader033/viewer/2022060315/5f0bbb137e708231d431efe3/html5/thumbnails/76.jpg)
THANK You