rebecca knowles and philipp koehnrknowles/presentations/knowleskoehnamta... · 2016. 11. 24. ·...
TRANSCRIPT
![Page 1: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/1.jpg)
Neural Interactive Translation Prediction
Rebecca Knowles and Philipp Koehn
![Page 2: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/2.jpg)
–––
![Page 3: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/3.jpg)
Interactive Translation Prediction
••
•
http://www.casmacat.eu/
![Page 4: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/4.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start job talks this month
![Page 5: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/5.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start job talks this month
![Page 6: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/6.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start job talks this month
![Page 7: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/7.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start job talks this month
![Page 8: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/8.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start job talks this month
![Page 9: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/9.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start job talks this month
![Page 10: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/10.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start job talks this month
![Page 11: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/11.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start job talks this month
![Page 12: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/12.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start job talks this month
![Page 13: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/13.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start interviewing talks this
![Page 14: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/14.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start
![Page 15: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/15.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start
![Page 16: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/16.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start job applicants this month ,
![Page 17: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/17.jpg)
The company said it will start interviewing applicants this month ,
The company said it will start job talks this month ,
![Page 18: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/18.jpg)
The company said it will start interviewing applicants this month ,
with staff levels rising from October through December .
![Page 19: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/19.jpg)
Interactive Translation Prediction using Search Graph
planned monthsfor
has for months
monthssincehas
he
it
![Page 20: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/20.jpg)
planned monthsfor
has for months
monthssincehas
he
it
![Page 21: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/21.jpg)
planned monthsfor
has for months
monthssincehas
he
it
![Page 22: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/22.jpg)
planned monthsfor
has for months
monthssincehas
he
it
![Page 24: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/24.jpg)
Ein Auftakt in dersouveräner Saison
Neural Machine Translation
![Page 25: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/25.jpg)
Ein Auftakt in dersouveräner Saison
![Page 26: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/26.jpg)
Ein in dersouveräner Auftakt Saison
![Page 27: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/27.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
<BOS>
![Page 28: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/28.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
Distribution Over Vocabulary
0.6 a
0.3 an
0.05 the
0.01 that
... ...
1e-9 halloween
1e-10 trilobite
<BOS>
![Page 29: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/29.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
Attention Mechanism
<BOS>
![Page 30: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/30.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
Condition on Previous Word
<BOS>
![Page 31: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/31.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
Select Most Probable Word
0.6 a
0.3 an
0.05 the
0.01 that
... ...
1e-9 halloween
1e-10 trilobite
<BOS> a
![Page 32: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/32.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
New Distribution, Conditioned on Previous Selection
<BOS> a
.
.
.
![Page 33: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/33.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
New Distribution, Conditioned on Previous Selection
Highest probability word:
“sovereign”
<BOS> a
.
.
.
![Page 34: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/34.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
New Distribution, Conditioned on Previous Selection
Highest probability word:
“sovereign”
<BOS> a
.
.
.
sovereign
![Page 35: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/35.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
<BOS> a
.
.
.
sovereign
.
.
.
pre- lude
.
.
.
in
.
.
.
the
.
.
.
season
A sovereign prelude in the season
![Page 36: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/36.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
<BOS> a
.
.
.
sovereign
.
.
.
pre- lude
.
.
.
in
.
.
.
the
.
.
.
season
![Page 37: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/37.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
<BOS> a
.
.
.
sovereign
.
.
.
pre- lude
.
.
.
in
.
.
.
the
.
.
.
season
a
✔
![Page 38: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/38.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
<BOS> a
.
.
.
sovereign
.
.
.
pre- lude
.
.
.
in
.
.
.
the
.
.
.
season
a
✔
![Page 39: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/39.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
<BOS> a
.
.
.
sovereign
.
.
.
pre- lude
.
.
.
in
.
.
.
the
.
.
.
season
a
✔
con-fident
✘
![Page 40: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/40.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
<BOS> a
.
.
.
sovereign
.
.
.
start
.
.
.
in
.
.
.
the
.
.
.
season
a
✔
con-fident
✘
![Page 41: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/41.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
<BOS> a
.
.
.
sovereign
.
.
.
start
.
.
.
to
.
.
.
the
.
.
.
season
a
✔
con-fident
✘
![Page 42: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/42.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
<BOS> a
.
.
.
sovereign
.
.
.
start
.
.
.
to
.
.
.
the
.
.
.
season
a
✔
con-fident
✘
start
✔
![Page 43: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/43.jpg)
Ein in dersouveräner Auftakt Saison
.
.
.
<BOS> a
.
.
.
sovereign
.
.
.
start
.
.
.
to
.
.
.
the
.
.
.
season
a
✔
con-fident
✘
start
✔to the season
✔ ✔ ✔
![Page 44: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/44.jpg)
.
.
.
<BOS> a
.
.
.
sovereign
.
.
.
start
.
.
.
to
.
.
.
the
.
.
.
season
a
✔
con-fident
✘
start
✔to the season
✔ ✔ ✔
Word Prediction Accuracy
In this example, what fraction of suggestions were accepted?
5/6
![Page 45: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/45.jpg)
Interactive Translation Prediction with Neural MT
•–
![Page 46: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/46.jpg)
Interactive Translation Prediction with Neural MT
•–
•
![Page 47: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/47.jpg)
Evaluations
••••
![Page 48: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/48.jpg)
Evaluation Data
•–––
![Page 49: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/49.jpg)
MT Systems
•–
•–
![Page 50: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/50.jpg)
System Quality
System Configuration BLEU
Neural no beam searchbeam size 12+ensemble+r2l reranking
34.536.237.538.6
Phrase-based 34.5
![Page 51: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/51.jpg)
System Quality
System Configuration BLEU
Neural no beam searchbeam size 12+ensemble+r2l reranking
34.536.237.538.6
Phrase-based 34.5
![Page 52: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/52.jpg)
Word Prediction Accuracy
Correct Prediction
✔✔✔✔✔✔✗✗✔✔✗✗✔✗✗✔✔✗✔✔
thecompanysaiditwillstartinterviewingapplicantsthismonth,withstafflevelsrisingfromOctoberthroughDecember.
thecompanysaiditwillstartjobtalksthismonthandandstaffnumbersincreasingfromOctobertoDecember.
Example with about-average word prediction accuracy.
(13/20)
![Page 53: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/53.jpg)
Word Prediction Accuracy
System Configuration Word Prediction Accuracy
Neural no beam searchbeam size 12
61.6%63.6%
Phrase-based - 43.3%
![Page 54: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/54.jpg)
DistributionsCorrect Prediction
✔✔✔✔✔✔✗✗✔✔✗✗✔✗✗✔✔✗✔✔
thecompanysaiditwillstartinterviewingapplicantsthismonth,withstafflevelsrisingfromOctoberthroughDecember.
thecompanysaiditwillstartjobtalksthismonthandandstaffnumbersincreasingfromOctobertoDecember.
![Page 55: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/55.jpg)
DistributionsCorrect Prediction
✔✔✔✔✔✔✗✗✔✔✗✗✔✗✗✔✔✗✔✔
thecompanysaiditwillstartinterviewingapplicantsthismonth,withstafflevelsrisingfromOctoberthroughDecember.
thecompanysaiditwillstartjobtalksthismonthandandstaffnumbersincreasingfromOctobertoDecember.
![Page 56: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/56.jpg)
DistributionsCorrect Prediction
✔✔✔✔✔✔✗✗✔✔✗✗✔✗✗✔✔✗✔✔
thecompanysaiditwillstartinterviewingapplicantsthismonth,withstafflevelsrisingfromOctoberthroughDecember.
thecompanysaiditwillstartjobtalksthismonthandandstaffnumbersincreasingfromOctobertoDecember.
![Page 57: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/57.jpg)
DistributionsCorrect Prediction
✔✔✔✔✔✔✗✗✔✔✗✗✔✗✗✔✔✗✔✔
thecompanysaiditwillstartinterviewingapplicantsthismonth,withstafflevelsrisingfromOctoberthroughDecember.
thecompanysaiditwillstartjobtalksthismonthandandstaffnumbersincreasingfromOctobertoDecember.
![Page 58: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/58.jpg)
Recovery from First Failure
![Page 59: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/59.jpg)
Recovery from First FailureCorrect Prediction
✔✔✔✗✗✔
andsomeareholdingoutfor...
andsomearewaitingontofor...
Correct Prediction
✔✗✔✔✔
atthistimelastcycle...
atthattimelastcycle...
![Page 60: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/60.jpg)
Sequences of MispredictionsCorrect Prediction
✔✔✔✔✔✔✗✗✔✔✗✗✔✗✗✔✔✗✔✔
thecompanysaiditwillstartinterviewingapplicantsthismonth,withstafflevelsrisingfromOctoberthroughDecember.
thecompanysaiditwillstartjobtalksthismonthandandstaffnumbersincreasingfromOctobertoDecember.
![Page 61: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/61.jpg)
Deployment and Speed
CASMACAT: http://www.casmacat.eu/
Lilt: https://lilt.com/
![Page 62: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/62.jpg)
Speed
![Page 63: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/63.jpg)
Patching Partial Predictions
![Page 64: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/64.jpg)
Patching Partial Predictions
![Page 65: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/65.jpg)
Patching Partial Predictions
![Page 66: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/66.jpg)
Patching Partial Predictions
![Page 67: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/67.jpg)
Patching Partial Predictions
![Page 68: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/68.jpg)
Patching Partial Predictions
→
![Page 69: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/69.jpg)
Conclusions
•
–––
![Page 70: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/70.jpg)
Thank You
![Page 71: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/71.jpg)
![Page 72: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/72.jpg)
Detailed Recovery
![Page 73: Rebecca Knowles and Philipp Koehnrknowles/presentations/KnowlesKoehnAMTA... · 2016. 11. 24. · Word Prediction Accuracy Correct Prediction the company said it will start interviewing](https://reader035.vdocument.in/reader035/viewer/2022071409/6102d657a906e714ea7b8fa6/html5/thumbnails/73.jpg)
Length of Error Sequences