WP7: PATENT CASE STUDY

March 2010

WP7: Participants

• Matrixware : – WP leader : 18PM effort

– Data provision, Human evaluation (TAUS)

• Ontotext : – prototype : 12PM effort

• UPC : – SMT : 6PM effort

• UGOT: – patent grammars : 6PM effort

2

WP7: planning

• Timeline– Duration: 27 months

– Starts: Month 4

– Ends: end of Month 30

• 3 Major deliverables– Prototype beta, due M18

– final prototype, due M24

– final report

• 8 Major Tasks– User reqs, patent corpora, SMT training, building Grammar, Hybrid,

buidling Prototype, human evaluation, report.

• 1 Major milestone– Completion of WP7

3

WP7: Objectives

• Commercially viable prototype

• Test multiple retrieval paradigms

• Translation in at least 3 languages– Quantify customization workload for new languages

• Translation quality:– Aiming for level 3 on the TAUS scale of human evaluation criteria of MT

output.

4

WP7: TAUS: Translation Automation Users Society

TAUS Evaluation Criteria• Excellent (4)

– Accurately transfers all info; correct terminology, correct grammar. Understanding not improved by reading the source text.

• Good (3)– Contains minor mistakes; would not need to refer to source text to

correct the mistakes.

• Medium (2)– Significant errors in output. Would need to read the source text to

correct the errors.

• Poor (1)– Serious errors in output. Would need to read the source text to

understand the output. Would probably need to retranslate from scratch.

5

Use case scenario

• A user (with mother Tongue A) searches for patents written in language B, using CLIR technology. -> HIT LIST : titles & abstracts. Requests a quick translation of title and abstract from B to A. Discards irrelevant docs.

• Second filtering phase, mainly based on the Claims but possibly the Description. Here the user again requests a quick translation of the Claims (and possibly the Description), from B to A. Again discards irrelevant docs.

• The user will usually request a high quality translation of the remaining docs through, e.g., Human Translation On Demand (HTOD).

• Note that the translation agency which processes the HTOD request may use the same automatic translation engine as the user, but will provide high quality post-editing of the machine translation output.

6

Use case scenario: typical technical problems

• Bilingual training data only partially available.– Bilingual titles and abstracts in langs A & B

– Monolingual claims in lang A

– Monolingual claims in lang B

– But NEED to be able to translate CLAIMS between A & B

• Noisy bilingual data because e.g.– Translation is really a simplification of the original

– Translation may be written according the rules of a different patent authority.

7

Claims translation at Espacenet

• Wordlingo = SYSTRAN MT engine + bilingual terminology• Bilingual terminology built from aligned patent sentences

– Automatic extraction– Manual post-editing

NOTES:• Variable quality depending on languages

– Depends on Systran “kernel” quality

• Costly and time consuming terminology customization• EPO interested in other solutions for other languages

Example (ep.espacenet.com)

Example: German translation

Example: French translation

Example: Spanish translation

Example: Italian translation

Example: claim 1 (English, source text)

ENGLISH

1. A method of manufacturing a molecular plasmonic nanostructure, which comprises the steps of:

a) forming of two distinct layers of conductive material consisting of a layer of upper conductor (1, 9) and a layer of lower conductor (2),

b) fabrication of a plasmonic nanostructure onto a layer of upper conductor (1, 9) with the use of a charged particle beam technique,

c) etching the surface through the layer of upper conductor (1, 9) with the use of a charged particle beam technique, thus exposing the desired area of a layer of lower conductor (2),

d) functionalising the exposed area with the use of desired molecular unit (6).

Example: claim 1 (Spanish)

SPANISH1. Un método de fabricación un nanostructure plasmonic molecular, de el cual

comprende las etapas:a) formación de dos capas características de material conductor que consisten en una

capa del conductor del superior (1, 9) y una capa de un conductor más bajo (2),b) fabricación de un nanostructure plasmonic sobre una capa del conductor del superior

(1, 9) con el uso de una técnica cargada de la haz de la partícula,c) ataque químico la superficie a través de la capa del conductor del superior (1, 9) con

el uso de una técnica cargada de la haz de la partícula, así exponiendo la área deseada de una capa de un conductor más bajo (2),

d) functionalising la área expuesto con el uso de la unidad molecular deseada (6).

Example: claim 1 (German)

GERMAN1. Ein Verfahren der Herstellung ein molekulares plasmonic nanostructure, deren Schritte

umfasst:a) Formung von zwei eindeutigen Schichten leitendem Material einer Schicht des oberen

Leiters (1, 9) und aus einer Schicht des niedrigeren Leiters bestehend (2),b) Herstellung eines plasmonic nanostructure auf eine Schicht des oberen Leiters (1, 9)

mit der Verwendung einer belasteten Teilchenstrahl-Technik,c) die Oberfläche durch die Schicht des oberen Leiters (1, 9) mit der Verwendung einer

belasteten Teilchenstrahl-Technik ätzen, den gewünschten Bereich einer Schicht des niedrigeren Leiters so herausstellend (2),

d) Functionalising den herausgestellten Bereich mit der Verwendung gewünschter molekularer Einheit (6).

Example: claim 1 (French)

FRENCH1. Une méthode de fabriquer un nanostructure plasmonic moléculaire, comprend dont les

étapes :a) former de deux couches distinctes de matériau conducteur se composant d'une

couche de à conducteur supérieur (1, 9) et d'une couche d'un conducteur plus inférieur (2),

b) fabrication d'un nanostructure plasmonic sur une couche de à conducteur supérieur (1, 9) avec l'utilisation d'une technique de faisceau de particule chargée,

c) gravant le traversant extérieur la couche de à conducteur supérieur (1, 9) avec l'utilisation d'une technique de faisceau de particule chargée, de ce fait exposant le secteur échéant d'une couche d'un conducteur plus inférieur (2),

d) functionalising le secteur découvert avec l'utilisation du motif moléculaire échéant (6).

Example: claim 1 (Italian)

ITALIAN1. Un metodo di fabbricazione un nanostructure plasmonic molecolare, di cui contiene le

fasi:a) formando di due strati distinti del materiale conduttore che consistono di uno strato

del conduttore di tomaia (1, 9) e di uno strato del conduttore più basso (2),b) fabbricazione di un nanostructure plasmonic su uno strato del conduttore di tomaia (1,

9) con l'uso di una tecnica caricata del fascio di particella,c) attacco la superficie tramite lo strato del conduttore di tomaia (1, 9) con l'uso di una

tecnica caricata del fascio di particella, così esponendo la zona voluta di uno strato del conduttore più basso (2),

d) functionalising la zona esposta con l'uso del gruppo molecolare voluto (6).

Example: Claims tree representation