artificial intelligence in huawei technologies - hang...

Hang Li

Noah’s Ark Lab

Huawei Technologies

Vision: Intelligent Information Assistant

Products

Huawei AppStore Recommendation and Search

Intelligent Help on Huawei Phone

Research Demos

Image Retrieval

Machine Translation

Natural Language Dialogue

Technologies

Deep Learning for Natural Language Processing

Intelligent

Telecommunication

Networks

Speech and Language

Big Data Analytics Intelligent Mobile Devices

SDN Network

Maintenance

Network Optimization and Planning

Huawei Big Data

Telco Big Data

Speech Recognition

Dialogue Machine

Translation

Recommendation Search

Noah Lab’s Research Areas


Products



Research Demos

Image Retrieval

Machine Translation


Technologies


• Accurate recommendation model • Efficient online learning algorithm

• Big data: billions of features and billions of instances

• Accurate recommendation is still

challenging, particularly for long tail and cold start

• 300 million registered users • 30 million users login every day • 100 million downloads every day

Noah’s Ark Lab is responsible for the development of algorithms

• Learning to rank and learning to match technologies

• Recognize more than 90% of the questions

• Accuracy of answer is over 92% • Currently processes 100K questions a day

• Mismatch between question and answer • “How can I access the Internet?” vs “ways

of connecting to the web”

• User can ask questions about usage of Huawei phones features in natural language

Noah’s Ark Lab is responsible for the development of system


Products



Research Demos

Image Retrieval

Machine Translation


Technologies


Research Demo


Products



Research Demos

Image Retrieval

Machine Translation


Technologies


Recommendation

Question Answering

Speech Recognition


Machine Translation

Image Retrieval

Information Extraction

Deep Learning

Multimodal CNN

Neural Responding Machine

Augmented Attention-based Neural Machine Translation

Multimodal CNN

……

CNN

MLP

a dog is catching a ball

• One Convolutional Neural Network represents image • One Convolutional Neural Network represents text • Multi Layer Perceptron conducts matching

Experimental Results

• Experiment

– Trained with 30K Flickr data

– Outperforming other state-of-the-art models

1x1tx tx

Tx

1h 1th th Th

… …

1c1tc tc

'Tc

1s 1ts ts'Ts

1y 1ty ty'Ty

… …

Sequence to Sequence Learning with Attention Mechanism

A cat is sitting on the mat

一只猫坐在垫子上

• Attention mechanism can make better alignment between source and target sentences

Neural Responding Machine

1x1tx tx

Tx

1h 1th th Th

… …

1c1tc tc

'Tc

1s 1ts ts'Ts

1y 1ty ty'Ty

… …

c

太羡慕你了祝旅行愉快

每年冬天都来海南度假

• Using both local and global attention mechanisms

Experimental Results

• Experiment

– Trained with 4.4 million Weibo data (Chinese)

– 95% of responses are natural, 76% of responses are appropriate as replies

Message Response

Occupy Central is finally over Will Lujiazui (finance district in Shanghai) be the next?

I want to buy a Samsung phone Let us support our national brand.

Neural Machine Translation

1x1tx tx

Tx

1h 1th th Th

… …

1c1tc tc

'Tc

1s 1ts ts'Ts

1y 1ty ty'Ty

… …

一只猫坐在那张垫子上

A cat is sitting on the mat

• Using context vectors to avoid over-translation and under-translation • Using context gates to dynamically control the impact of attention

Experimental Results • Experiment

– Trained with 1.25 million LDC data (Chinese-English)

C-E Translation

有一些恐怖袭击会愈演愈烈。

NMT There will be some terrorist attacks.

+Both Some terrorist attacks will become more and more intense.

28.3

30.1 30.6

31.7

26

27

28

29

30

31

32

33

BLEU

NMT

+Coverage

+Context Gate


Products:



Research Demos:

Image Retrieval

Machine Translation


Advanced technologies in Deep Learning for Natural Language Processing

artificial intelligence in huawei technologies - hang...

Documents