taus open source machine translation showcase, seattle, the simple install – streamlining moses...

16
TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE The Simple Install – Streamlining Moses Setup for Industry Scale Users 11:30-11:45 Wednesday, 17 October Jeff Rueppel Adobe

Upload: taus-enabling-better-translation

Post on 26-Jun-2015

692 views

Category:

Technology


0 download

DESCRIPTION

This presentation is a part of the MosesCore project that encourages the development and usage of open source machine translation tools, notably the Moses statistical MT toolkit. MosesCore is supported by the European Commission Grant Number 288487 under the 7th Framework Programme. For the latest updates, follow us on Twitter - #MosesCore

TRANSCRIPT

Page 1: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE

The Simple Install – Streamlining Moses Setup for Industry Scale Users

11:30-11:45Wednesday, 17 October

Jeff RueppelAdobe

Page 2: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

Jeffrey Rueppel | MT Architect – Multilingual Content Intelligence Team

Adobe Open Source MT Tooling And Best Practices

Page 3: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

Two Efforts – Tooling and Efficiency1. Tooling:• Corpus Tool• Training Tool• Testing Tool

2. Efficiency:• Automated

Trainer• RPM + YUM

3

Page 4: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

1. Tooling - Overview And Work Flow

4

Page 5: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

1. Tooling - Corpus Tool

5

Page 6: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

1. Tooling - Trainer

6

Page 7: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

1. Tooling - Testing Tool

7

Page 8: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

1. Tooling/Efficiency – Automated Trainer

8

Page 9: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

2. Efficiency - Why Streamline? Answer: Installing Moses In A Custom Environment Takes….

9

*Methuselah tree is now estimated at being 4,841 years old

A

LongTime.

Page 10: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

2. Efficiency - Standard Moses Install Practice1. Install Dependency Packages

2. Compile and Install Language Models and GIZA++

3. Check Out Source Code From GITHUB

4. Copy BIN and Source Scripts to Destination Folder

5. Download Sample Model And Translate Something

10

Page 11: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

2. Streamlined InstallationStreamlined MosesInstallation Instructions Fit On One Page

11

Page 12: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

2. How did we do it?1. Created RPM Package of dependencies(CENT OS6 in our Case)

12

2. Private YUM repository to centralize package management

+

YUM (Yellow Dog Updater Modified)

Page 13: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

2. RPM PACKAGE CREATION

13

glibc-develglibc-headerslibstdc++-develBoost-develxmlrpc-c-develzlib-deveMoses-suite-develgiza-ppirstlm

Boostxmlrpc-cgiza-ppirstlmzlibperl-CGIperl GDperl-XML-Twig

RequiredFor Building

Required To Run

Page 14: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

2. YUM Repository

14

1. Create a repository definition on the local machine - /etc/yum.repos.d

2. Execute: yum install moses-core-irstlm3. Execute: yum install moses-test-suite4. /moses-suite/bin/moses-suite-test-inst.sh

Page 15: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012

Thank You And Questions

?15

Page 16: TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE, Seattle, The Simple Install – Streamlining Moses Setup for Industry Scale Users, Jeff Rueppel, Adobe, 17 October 2012