artificial intelligence in huawei technologies

Click here to load reader

Post on 31-Dec-2016

216 views

Category:

Documents

1 download

Embed Size (px)

TRANSCRIPT

  • Hang Li

    Noahs Ark Lab

    Huawei Technologies

  • Vision: Intelligent Information Assistant

    Products

    Huawei AppStore Recommendation and Search

    Intelligent Help on Huawei Phone

    Research Demos

    Image Retrieval

    Machine Translation

    Natural Language Dialogue

    Technologies

    Deep Learning for Natural Language Processing

  • Intelligent

    Telecommunication

    Networks

    Speech and Language

    Big Data Analytics Intelligent Mobile Devices

    SDN Network

    Maintenance

    Network Optimization and Planning

    Huawei Big Data

    Telco Big Data

    Speech Recognition

    Dialogue Machine

    Translation

    Recommendation Search

    Noah Labs Research Areas

  • Vision: Intelligent Information Assistant

    Products

    Huawei AppStore Recommendation and Search

    Intelligent Help on Huawei Phone

    Research Demos

    Image Retrieval

    Machine Translation

    Natural Language Dialogue

    Technologies

    Deep Learning for Natural Language Processing

  • Accurate recommendation model Efficient online learning algorithm

    Big data: billions of features and billions of instances

    Accurate recommendation is still

    challenging, particularly for long tail and cold start

    300 million registered users 30 million users login every day 100 million downloads every day

    Noahs Ark Lab is responsible for the development of algorithms

  • Learning to rank and learning to match technologies

    Recognize more than 90% of the questions

    Accuracy of answer is over 92% Currently processes 100K questions a day

    Mismatch between question and answer How can I access the Internet? vs ways

    of connecting to the web

    User can ask questions about usage of Huawei phones features in natural language

    Noahs Ark Lab is responsible for the development of system

  • Vision: Intelligent Information Assistant

    Products

    Huawei AppStore Recommendation and Search

    Intelligent Help on Huawei Phone

    Research Demos

    Image Retrieval

    Machine Translation

    Natural Language Dialogue

    Technologies

    Deep Learning for Natural Language Processing

  • Research Demo

  • Research Demo

  • Research Demo

  • Vision: Intelligent Information Assistant

    Products

    Huawei AppStore Recommendation and Search

    Intelligent Help on Huawei Phone

    Research Demos

    Image Retrieval

    Machine Translation

    Natural Language Dialogue

    Technologies

    Deep Learning for Natural Language Processing

  • Recommendation

    Question Answering

    Speech Recognition

    Natural Language Dialogue

    Machine Translation

    Image Retrieval

    Information Extraction

    Deep Learning

  • Multimodal CNN

    Neural Responding Machine

    Augmented Attention-based Neural Machine Translation

  • Multimodal CNN

    CNN

    MLP

    a dog is catching a ball

    One Convolutional Neural Network represents image One Convolutional Neural Network represents text Multi Layer Perceptron conducts matching

  • Experimental Results

    Experiment

    Trained with 30K Flickr data

    Outperforming other state-of-the-art models

  • 1x 1tx tx Tx

    1h 1th th Th

    1c 1tc tc 'Tc

    1s 1ts ts

    'Ts

    1y 1ty ty 'Ty

    Sequence to Sequence Learning with Attention Mechanism

    A cat is sitting on the mat

    Attention mechanism can make better alignment between source and target sentences

  • Neural Responding Machine

    1x 1tx tx Tx

    1h 1th th Th

    1c 1tc tc 'Tc

    1s 1ts ts

    'Ts

    1y 1ty ty 'Ty

    c

    Using both local and global attention mechanisms

  • Experimental Results

    Experiment

    Trained with 4.4 million Weibo data (Chinese)

    95% of responses are natural, 76% of responses are appropriate as replies

    Message Response

    Occupy Central is finally over Will Lujiazui (finance district in Shanghai) be the next?

    I want to buy a Samsung phone Let us support our national brand.

  • Neural Machine Translation

    1x 1tx tx Tx

    1h 1th th Th

    1c 1tc tc 'Tc

    1s 1ts ts

    'Ts

    1y 1ty ty 'Ty

    A cat is sitting on the mat

    Using context vectors to avoid over-translation and under-translation Using context gates to dynamically control the impact of attention

  • Experimental Results Experiment

    Trained with 1.25 million LDC data (Chinese-English)

    C-E Translation

    NMT There will be some terrorist attacks.

    +Both Some terrorist attacks will become more and more intense.

    28.3

    30.1 30.6

    31.7

    26

    27

    28

    29

    30

    31

    32

    33

    BLEU

    NMT

    +Coverage

    +Context Gate

  • Vision: Intelligent Information Assistant

    Products:

    Huawei AppStore Recommendation and Search

    Intelligent Help on Huawei Phone

    Research Demos:

    Image Retrieval

    Machine Translation

    Natural Language Dialogue

    Advanced technologies in Deep Learning for Natural Language Processing