artificial intelligence in huawei technologies - hang...

Hang Li

Noah’s Ark Lab

Huawei Technologies

Vision: Intelligent Information Assistant

Products

Huawei AppStore Recommendation and Search

Intelligent Help on Huawei Phone

Research Demos

Image Retrieval

Machine Translation

Natural Language Dialogue

Technologies

Deep Learning for Natural Language Processing

Intelligent

Telecommunication

Networks

Speech and Language

Big Data Analytics Intelligent Mobile Devices

SDN Network

Maintenance

Network Optimization and Planning

Huawei Big Data

Telco Big Data

Speech Recognition

Dialogue Machine

Translation

Recommendation Search

Noah Lab’s Research Areas

Vision: Intelligent Information Assistant

Products

Huawei AppStore Recommendation and Search

Intelligent Help on Huawei Phone

Research Demos

Image Retrieval

Machine Translation

Natural Language Dialogue

Technologies

Deep Learning for Natural Language Processing

• Accurate recommendation model • Efficient online learning algorithm

• Big data: billions of features and billions of instances

• Accurate recommendation is still

challenging, particularly for long tail and cold start

• 300 million registered users • 30 million users login every day • 100 million downloads every day

Noah’s Ark Lab is responsible for the development of algorithms

• Learning to rank and learning to match technologies

• Recognize more than 90% of the questions

• Accuracy of answer is over 92% • Currently processes 100K questions a day

• Mismatch between question and answer • “How can I access the Internet?” vs “ways

of connecting to the web”

• User can ask questions about usage of Huawei phones features in natural language

Noah’s Ark Lab is responsible for the development of system

Vision: Intelligent Information Assistant

Products

Huawei AppStore Recommendation and Search

Intelligent Help on Huawei Phone

Research Demos

Image Retrieval

Machine Translation

Natural Language Dialogue

Technologies

Deep Learning for Natural Language Processing

Research Demo

Research Demo

Research Demo

Vision: Intelligent Information Assistant

Products

Huawei AppStore Recommendation and Search

Intelligent Help on Huawei Phone

Research Demos

Image Retrieval

Machine Translation

Natural Language Dialogue

Technologies

Deep Learning for Natural Language Processing

Recommendation

Question Answering

Speech Recognition

Natural Language Dialogue

Machine Translation

Image Retrieval

Information Extraction

Deep Learning

Multimodal CNN

Neural Responding Machine

Augmented Attention-based Neural Machine Translation

Multimodal CNN

……

CNN

MLP

a dog is catching a ball

• One Convolutional Neural Network represents image • One Convolutional Neural Network represents text • Multi Layer Perceptron conducts matching

Experimental Results

• Experiment

– Trained with 30K Flickr data

– Outperforming other state-of-the-art models

1x1tx tx

Tx

1h 1th th Th

… …

1c1tc tc

'Tc

1s 1ts ts'Ts

1y 1ty ty'Ty

… …

Sequence to Sequence Learning with Attention Mechanism

A cat is sitting on the mat

一只 猫 坐 在 垫子 上

• Attention mechanism can make better alignment between source and target sentences

Neural Responding Machine

1x1tx tx

Tx

1h 1th th Th

… …

1c1tc tc

'Tc

1s 1ts ts'Ts

1y 1ty ty'Ty

… …

c

太 羡慕 你 了 祝 旅行 愉快

每年 冬天 都 来 海南 度假

• Using both local and global attention mechanisms

Experimental Results

• Experiment

– Trained with 4.4 million Weibo data (Chinese)

– 95% of responses are natural, 76% of responses are appropriate as replies

Message Response

Occupy Central is finally over Will Lujiazui (finance district in Shanghai) be the next?

I want to buy a Samsung phone Let us support our national brand.

Neural Machine Translation

1x1tx tx

Tx

1h 1th th Th

… …

1c1tc tc

'Tc

1s 1ts ts'Ts

1y 1ty ty'Ty

… …

一只 猫 坐 在 那张 垫子 上

A cat is sitting on the mat

• Using context vectors to avoid over-translation and under-translation • Using context gates to dynamically control the impact of attention

Experimental Results • Experiment

– Trained with 1.25 million LDC data (Chinese-English)

C-E Translation

有一些恐怖袭击会愈演愈烈。

NMT There will be some terrorist attacks.

+Both Some terrorist attacks will become more and more intense.

28.3

30.1 30.6

31.7

26

27

28

29

30

31

32

33

BLEU

NMT

+Coverage

+Context Gate

Vision: Intelligent Information Assistant

Products:

Huawei AppStore Recommendation and Search

Intelligent Help on Huawei Phone

Research Demos:

Image Retrieval

Machine Translation

Natural Language Dialogue

Advanced technologies in Deep Learning for Natural Language Processing