table-to-text generation by structure-aware seq2seq learning · neural text generation from...
TRANSCRIPT
|
Table-to-text Generation by Structure-aware Seq2seq Learning
1
Authors:Tianyu Liu,KexiangWang,LeiSha,BaobaoChangandZhifang SuiAffiliation:KeyLaboratoryofComputationalLinguistics(ICL),PekingUniversity,Beijing,ChinaSpeaker:Tianyu LiuE-mail:[email protected]
|
Knowledge Modeling
2
Machine ReadingUnstructured text Structured data
MachineWritingStructured data Unstructured text
| 3
Knowledge Modeling
Machine ReadingUnstructured text Structured data
MachineWritingStructured data Unstructured text
|
Data-to-text
4
WisemanS,Shieber SM,RushAM.Challengesindata-to-documentgeneration EMNLP 2017
|
Data-to-text
5
MeiH,BansalM,WalterMR.Whattotalkaboutandhow?selectivegenerationusinglstms withcoarse-to-finealignment NAACL2016.
|
Data-to-text
6
DušekO,Jurčíček F. Sequence-to-sequence generationforspoken dialogueviadeepsyntaxtreesandstrings. ACL 2016.
|
Data-to-text
7
GeorgeMikell (born Jurgis Mikelaitis;4April1929)isaLithuanian-Australianactorandwriterbestknown forhisperformances in TheGunsofNavarone (1961)and TheGreatEscape (1963).
Our work !
|
How to represent a table ?
8
1. Key-value map(Name, George Mikell); (Nationality, Lithuanian Australian); (Years Active, 1957--present) ….
|
How to represent a table ?
9
1. Key-value map
2. Triple(George Mikell, FullName, George Mikell);(George Mikell, Nationality, Lithuanian Australian);(George Mikell, Known for, The Guns of Navarone); (The Guns of Navarone, Directed by, J.Lee Thompson) ….
(Name, George Mikell); (Nationality, Lithuanian Australian); (Years Active, 1957--present) ….
|
How to represent a table ?
10
1. Key-value map
2. Triple(George Mikell, FullName, George Mikell);(George Mikell, Nationality, Lithuanian Australian);(George Mikell, Known for, The Guns of Navarone); (The Guns of Navarone, Directed by, J.Lee Thompson) ….
(Name, George Mikell); (Nationality, Lithuanian Australian); (Years Active, 1957--present) ….
3. Multi-element Tuple
|
How to represent a table ?
11
1. Key-value map
2. Triple(George Mikell, FullName, George Mikell);(George Mikell, Nationality, Lithuanian Australian);(George Mikell, Known for, The Guns of Navarone); (The Guns of Navarone, Directed by, J.Lee Thompson) ….
(Name, George Mikell); (Nationality, Lithuanian Australian); (Years Active, 1957--present) ….
3. Multi-element Tuple
|12
Table Encoder
ℎ#
George Mikell
(name,1,2)
(name,2,1)
ℎ$ ℎ%
Jurgis
(birthname,1,2)
……
……
The
ℎ$&
Great
ℎ$' ℎ%(
Escape
(known for,5,3)
(known for,6,2)
(known for,7,1)
Field-gating Tableencoder
𝑧# 𝑧$ 𝑧% 𝑧$& 𝑧$' 𝑧%(
𝑠%
George Mikell is
𝑠+ 𝑠,
an Australian<sos>
George Mikell is an Australian actor
𝑠-𝑠$𝑠#
Description Decoder
Word
Field & Pos
|13
(name, George Mikell)Word embedding + Structure embedding
Table Encoder
|14
(name, George Mikell)Word embedding + Field embedding
Table Encoder
|15
(name, George Mikell)Structure embedding (Field type embedding + Position embedding)
Table Encoder
|16
(name, George Mikell)
Lebret R,Grangier D,Auli M.Neuraltextgenerationfromstructureddatawithapplicationtothebiographydomain. EMNLP 2016
Table EncoderStructure embedding (Field type embedding + Position embedding)
|17
Field-gating Encoder
ℎ#
George Mikell
(name,1,2)
(name,2,1)
ℎ$ ℎ%
Jurgis
(birthname,1,2)
……
……
The
ℎ$&
Great
ℎ$' ℎ%(
Escape
(known for,5,3)
(known for,6,2)
(known for,7,1)
Field-gating Tableencoder
𝑧# 𝑧$ 𝑧% 𝑧$& 𝑧$' 𝑧%(
Vanilla LSTM
Undate cell state
|
Human-like Generation
18
GeorgeMikell (born Jurgis Mikelaitis;4April1929)isaLithuanian-Australianactorandwriterbestknown forhisperformances in The Guns ofNavarone (1961)and The Great Escape(1963).
name GeorgeMikell
birthname Jurgis Mikelaitis
birthdate 4April1929 (age 88)
birthplace Bildeniai, Lithuania
nationality Lithuanian,Australian
occupation Actor,writer
years active 1957–present
known for The Guns of NavaroneThe Great Escape
|
Human-like Generation
19
GeorgeMikell (born Jurgis Mikelaitis;4April1929)isaLithuanian-Australianactorandwriterbestknown forhisperformances in The Guns ofNavarone (1961)and The Great Escape(1963).
name GeorgeMikell
birthname Jurgis Mikelaitis
birthdate 4April1929 (age 88)
birthplace Bildeniai, Lithuania
nationality Lithuanian,Australian
occupation Actor,writer
years active 1957–present
known for The Guns of NavaroneThe Great Escape
|
Human-like Generation
20
GeorgeMikell (born Jurgis Mikelaitis;4April1929)isaLithuanian-Australian actorandwriterbestknown forhisperformances in The Guns ofNavarone (1961)and The Great Escape(1963).
name GeorgeMikell
birthname Jurgis Mikelaitis
birthdate 4April1929 (age 88)
birthplace Bildeniai, Lithuania
nationality Lithuanian,Australian
occupation Actor,writer
years active 1957–present
known for The Guns of NavaroneThe Great Escape
|
Human-like Generation
21
GeorgeMikell (born Jurgis Mikelaitis;4April1929)isaLithuanian-Australianactorandwriterbestknown forhisperformances in The Guns ofNavarone (1961)and The Great Escape(1963).
name GeorgeMikell
birthname Jurgis Mikelaitis
birthdate 4April1929 (age 88)
birthplace Bildeniai, Lithuania
nationality Lithuanian,Australian
occupation Actor,writer
years active 1957–present
known for The Guns of NavaroneThe Great Escape
|22
Word-level & Field-level Dual Attention
ℎ#
George Mikell
(name,1,2)
(name,2,1)
ℎ$ ℎ%
Jurgis
(birthname,1,2)
……
……
The
ℎ$&
Great
ℎ$' ℎ%(
Escape
(known for,5,3)
(known for,6,2)
(known for,7,1)
𝑠%
George Mikell is
𝑠+ 𝑠,
an Australian<sos>
George Mikell is an Australian actor
𝑠,
……⊙
⊙ ……
……
……
⨁Embeddingfor ‘Australian’
dual attentionvector
Word level attention
Field level attention
⊗Dual attention
Input for 𝑠,
Field-gating Tableencoder
𝑠-𝑠$𝑠#
𝑧# 𝑧$ 𝑧% 𝑧$& 𝑧$' 𝑧%(
Description Decoder
Word-level Attention:
Field-level Attention:
Dual Attention:
Context Vector:
|23
Case study
|
Dataset: WIKIBIO
24
WIKIBIO (Lebret,Grangier,andAuli (2016)) contains728,321 articlesfromEnglishWikipedia(Sep2015).Thedatasetusesthefirstsentenceofeacharticleasthedescriptionoftherelated infobox.
GeorgeMikell (born JurgisMikelaitis;4April1929)isaLithuanian-Australian actorandwriterbestknown forhisperformancesin The Guns ofNavarone (1961)and The Great Escape(1963).
name GeorgeMikell
birthname Jurgis Mikelaitis
birthdate 4April1929 (age 88)
birthplace Bildeniai, Lithuania
nationality Lithuanian, Australian
occupation Actor,writer
years active 1957–present
known for The Guns of NavaroneThe Great Escape
Infobox Description
Lebret R,Grangier D,Auli M.Neuraltextgenerationfromstructureddatawithapplicationtothebiographydomain. EMNLP 2016
|
Experiments
25
Statistical Baselines:KN & Template KN:TheKneser-Ney(KN)model isawidelyusedlanguagemodel.TemplateKNisaKNmodelovertemplateswhichalsoservesasabaselinein[Lebret etal.,2016]
NLM& Table NLM:NLMisanaivestatisticallan-guage modelproposedbyLebret etal.2016.TableNLM includeslocalandglobalconditioning overthetables
Neural Network Baseline:Seq2seq: vanillaseq2seqneuralarchitectureisalsoprovidedasastrongbaselinewhichusestheconcatenationofwordembedding, fieldembedding andpositionembedding asthemodelinput.
|
Does the order matter?
26
name GeorgeMikell
birthname Jurgis Mikelaitis
birthdate 4April1929 (age 88)
birthplace Bildeniai, Lithuania
nationality Lithuanian, Australian
occupation Actor,writer
years active 1957–present
known for The Guns of NavaroneThe Great Escape
years active 1957–present
occupation Actor,writer
known for The Guns of NavaroneThe Great Escape
birthplace Bildeniai, Lithuania
nationality Lithuanian, Australian
birthname Jurgis Mikelaitis
name GeorgeMikell
birthdate 4April1929 (age 88)
Shuffle
|27
Thanks.