humans vs machines: an mt cost benefit analysis
DESCRIPTION
In this presentation we compare machine translation with human translation. We look at a side by side comparison of workflows and a cost benefit analisys.TRANSCRIPT
![Page 2: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/2.jpg)
Translations for a working [email protected]
WelcomeIntroduction
• Webinar is being recorded and will be
made available
• Slides will be available with the
recording
• Details of how to access the recording
and the slides will be emailed after the
webinar
• Q&A at the end; use the chat box to
submit questions during the
presentation
Rob Davies
Marketing Manager
Milengo
Presenter
![Page 3: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/3.jpg)
Translations for a working [email protected]
MT and the current landscapeAn overview
• MT has been long lauded as the holy grail
• Reality hasn’t matched up to expectations
yet
• Free tools not suitable for business
• Free tools can’t deal with large volumes
• Custom development = high cost
• Our experience
• 2 years testing and development
![Page 4: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/4.jpg)
Translations for a working [email protected]
The ProjectWorkflow Comparison
• Technical document source files
• Translated from English into German
• Similar word volumes + subject matter
• Project 1 – Human Translation – 89k words
• Project 2 – MT + post-editing – 90k words
• Same TM was used for both projects with no
modification
• Analysis also includes test projects for both
![Page 6: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/6.jpg)
Translations for a working [email protected]
Human Translation WorkflowSample Translation / Test Project
Test files submitted
Team Selection
File + TM + CAT Tool prep
Fuzzy Match analysis
Human Translation
QA
Client delivery
Client Delivery
Client review/feedback
Amends
QA
![Page 7: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/7.jpg)
Translations for a working [email protected]
Human TranslationProduction / Project Workflow
Project files submitted
Fuzzy Match analysis
Human Translation
QA
Client deliveryAll language assets and tools have already set up
Client Delivery
Client review/feedback
Amends
QA
![Page 8: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/8.jpg)
Translations for a working [email protected]
Human TranslationCosts & Timescales
Covers all activity pre translation and post
QA.Based on a project size of 180k words
Project managementTranslation & Review
3 Translators 2500 words per day
1 senior linguist5000 words per day
180k words Total Time
40 Days
3 days10% of project
cost
36+1 daysPer Word Rate
![Page 9: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/9.jpg)
Translations for a working [email protected]
MT + Post-Editing WorkflowTest / Training Project
Test files + language data
File + CAT Tool prep
Engine Certification
Pre translation
QA
Post Processing
Client Delivery
Client review/feedback
Amends
QA
Client deliveryEngine build/training
Fuzzy Match analysis
Post-editor selection
Machine Translation
Post-Editing
Additional process steps
![Page 10: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/10.jpg)
Translations for a working [email protected]
MT + Post-Editing WorkflowProduction / Live Project
Test files + language data
File prep
Pre translation
QA
File consolidation
Client delivery
Fuzzy Match analysis
Machine Translation
Post-Editing
Engine setup, training and testing have been completed and CAT tools already set up.
Client Delivery
Client review/feedback
Amends
QA
![Page 11: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/11.jpg)
Translations for a working [email protected]
Machine Translation + Post-EditingCosts & Timescales
Project managementTranslation
Post-Editing & Review
Engine setup, asset prep, training and output
analysis.
Total Time 28 Days*
Engine Setup
Covers all activity pre translation and post
QA.Based on a project size of 189k words
MT 2000 words p/m3 post editors
5000 word per daySenior Linguist 7000 words
per day
*excluding engine training
1 day – test project onlyFREE
3 days10% of project
cost
<85% 132k66 mins with MT
Post edit 189k24+1 days
Per Word Rate
![Page 13: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/13.jpg)
Translations for a working [email protected]
ComparisonMT/PE vs Human only
Project Management/Setup
Human Only – 3 days
MT/PE – 90k Words – 4 days
Time difference - +1 day
Cost difference – none
Project management is always
10% of project cost.
Engine build is currently FREE!
Translation/Edit Time
Human Only – 180k words – 37 days
MT/PE – 189k Words – 66 mins 24
days
Time difference - -13 days
Cost difference – up to 50%
cheaper*
33% productivity increase.
*Light post-editing or Full post-editing
depending on end use.
![Page 14: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/14.jpg)
Translations for a working [email protected]
Where is MT applicable?Technical Documentation Translation
• MT works best with standardized
language
• Controlled authoring of source
text improves output accuracy
• Large volumes are most cost
effective
Example uses
• Product manuals
• Instruction manuals
• Data sheets
• Technical specifications
• Knowledge bases
• Help files
![Page 15: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/15.jpg)
Translations for a working [email protected]
What are the requirements?Some Facts
• Companies within a technical industry
• Controlled or standardized language
• Annual spend of over $50,000 per language
pair
• Project sizes of 10,000 words and above
• A minimum of 500,000 sentence pairs or
translated units (bilingual data)
• A minimum of 300MB of target language
data (monolingual data)
![Page 16: Humans vs Machines: An MT cost benefit analysis](https://reader036.vdocument.in/reader036/viewer/2022062704/555c4513d8b42a2c068b503a/html5/thumbnails/16.jpg)
Translations for a working [email protected]
What’s the potential?Some Numbers
• Total spend worldwide $30billion
2011
• 55% of spend on Language Services
was translation
• Average project cost $13,500
• MT/PE saves 30% in time
• MT/PE saves 30% in cost
Lowers average project cost to
under $10k