the latest deep neural network case study · 2018-06-01 · introduction in this code story, we...

36

The Latest Deep Neural Network Case Study - PII reduction run on Edge, Sequence Intent Classification using Neural Networks AI09

Upload: others

Post on 12-Aug-2020

0 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

The Latest Deep Neural Network Case Study - PII reduction run on Edge, Sequence Intent Classification using Neural Networks

AI09

Page 2: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 3: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 4: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

PII reduction on Edge

Page 5: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 6: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 7: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 8: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 9: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

• Abstracts hardware details

Page 10: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

• Processor speed: 700 MHz to 1.4 GHz

256 MB to 1 GB

Page 11: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

• Pascal GPU

• CPU: 6-16 CPUs

GB

Page 12: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

• Central message hub b¥w app and devices

Page 13: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 14: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

ML Module

Zip Module

Encryption

Module

Storage Module

Frame Feeder

Module

Sh

are

d V

olu

me

Azure Active

Directory

Azure

Key Vault

Autonomous

framesAzure

Table Storage

Sanitized

frames

Azure Container

Registry

Stitching

Service

Node API

Web App

Azure IoT

Hub

IoT Edge

Raw framesContainer

Blob Storage

Stitched

framesRedacted

frames

Azure

CDN

Linux

VMSS

Page 15: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 16: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 17: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 18: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 19: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 20: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Image source: Girshick et al., 2014

https://arxiv.org/abs/1311.2524

Page 21: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Sequence intent analysis with Hierarchical Attention NNs

Page 22: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

https://www.microsoft.com/developerblog/2018/03/06/sequence-intent-classification/

https://www.microsoft.com/developerblog/2018/03/06/sequence-intent-classification/

Page 23: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 24: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 25: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 26: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 27: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

recurrent neural network

Yang, Zichao et al. “Hierarchical Attention Networks for Document Classification”

https://en.wikipedia.org/wiki/Recurrent_neural_network

Page 28: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Yang, Zichao et al. “Hierarchical Attention Networks for Document Classification”

Page 29: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 30: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 31: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 32: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 33: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

Page 34: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

https://www.microsoft.com/developerblog/

2018/03/06/sequence-intent-classification/

https://www.microsoft.com/developerblog/2018/03/06/sequence-intent-classification/

https://www.microsoft.com/developerblog/2018/03/06/sequence-intent-classification/

Page 35: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

@OlgaLiakhovich

https://twitter.com/OlgaLiakhovich

Page 36: The Latest Deep Neural Network Case Study · 2018-06-01 · Introduction In this code story, we will discuss applications of Hierarchical Attention Neural Networks for sequence classification

© 2018 Microsoft Corporation. All rights reserved.

本コンテンツの著作権、および本コンテンツ中に出てくる商標権、団体名、ロゴ、製品、サービスなどはそれぞれ、各権利保有者に帰属します。

The Neural Correlates of Hierarchical Predictions for

A Hierarchical Neural Model of Data Prefetching

Hierarchical Modular Optimization of Convolutional …papers.nips.cc/paper/4991-hierarchical-modular...Figure 1: A) Heterogenous hierarchical convolutional neural networks are composed

Multimodal Transfer: A Hierarchical Deep Convolutional Neural …yfwang/papers/cvpr_17.pdf · 2017. 10. 16. · Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network

A Hierarchical Neural Hybrid Method for Failure

Hierarchical Neural Architecture Search for Single Image ... · Hierarchical Neural Architecture Search for Single Image Super-Resolution Yong Guo , Yongsheng Luo , Zhenhao He , Jin

Neural Networks - storage.googleapis.com · Neural Networks The purpose of this document is to review neural networks, discuss training rules and provide an example illustrating

ARTIFICIAL NEURAL NETWORK REPRESENTATIONS FOR …pure.iiasa.ac.at/4847/1/RR-97-12.pdf · ARTIFICIAL NEURAL NETWORK REPRESENTATIONS FOR HIERARCHICAL PREFERENCE STRUCTURES Antonie Stam,"2H

Hierarchical Neural Networks for Image InterpretationSven Behnke Hierarchical Neural Networks for Image Interpretation June 13, 2003 Draft submitted to Springer-Verlag Published as

Supervised Learning Networks. Linear perceptron networks Multi-layer perceptrons Mixture of experts Decision-based neural networks Hierarchical neural

Insider Threat Detection via Hierarchical Neural Temporal

Neocognitron: A Hierarchical Neural Network Capable of ...vision.stanford.edu/teaching/cs131_fall1415/lectures/Fukushima1988.pdf · Neocognitron: A Hierarchical Neural Network Capable

Robust Hough-Based Symbol Recognition Using Knowledge-Based Hierarchical Neural Networks · · 2008-09-03Robust Hough-Based Symbol Recognition Using Knowledge-Based Hierarchical

Model-based Reinforcement Learning with Neural Networks on Hierarchical Dynamic System

Convolutional Neural Networks for Architectures with Hierarchical Memories Ardavan Pedram VLSI Research Group Stanford University

Neural Task Programming: Learning to Generalize Across ... · Neural Task Programming: Learning to Generalize Across Hierarchical Tasks ... Yet these methods fall short ... It has

Image Compression with a Hierarchical Neural · PDF fileImage Compression with a Hierarchical Neural Network By. ... A neural network data compression method is ... Cottrell's method

Performance-optimized hierarchical models predict neural

Hierarchical Linear Modeling: Understanding Applications ...€¦ · 16/05/2016 · Introduce Hierarchical Linear Modeling (HLM) principles and techniques Discuss appropriate use

Neural Implementation of Hierarchical Bayesian Inference ...cocosci.princeton.edu/tom/papers/neuralIS.pdf · Training RBF networks is practical for neural implementation. Unlike the

A hierarchical unsupervised growing neural network for clustering gene expression patterns Javier Herrero, Alfonso Valencia & Joaquin Dopazo Seminar “Neural

Deep Neural Networks predict Hierarchical Spatio-temporal ... · PDF fileDeep Neural Networks predict Hierarchical Spatio-temporal Cortical Dynamics of Human Visual Object Recognition

Parallel Self-Adaptive Parallel Processing Neural Networks with irregular Nodal Processing Powers using Hierarchical Partitioning of Artificial neural Networks

Neural Mechanisms of Hierarchical Planning in a Virtual

Hierarchical Recurrent Neural Networks for Long …papers.nips.cc/paper/1102-hierarchical-recurrent-neural...Hierarchical Recurrent Neural Networks for Long-term Dependencies 495 The

Hierarchical Neural Story Generation · Hierarchical Neural Story Generation Angela Fan Mike Lewis Facebook AI Research, Menlo Park fangelafan, mikelewis, [email protected] Yann Dauphin

Model-based Reinforcement Learning with Neural Networks on ...akihikoy.net/info/wdocs/Yamaguchi,Atkeson,2016... · Model-based Reinforcement Learning with Neural Networks on Hierarchical

Hierarchical Neural Networks for Image Interpretation

IEEE TRANSACTIONS ON NEURAL NETWORKS AND ...crabwq.github.io/pdf/2018 Hierarchical Feature Selection...IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 1 Hierarchical Feature

Semi-Supervised Hierarchical Recurrent Graph Neural

Multiscale Neural Networks based on hierarchical matricesmath.mit.edu/~lzepeda/mnnh.pdf · 2018. 7. 21. · 1 A multiscale neural network based on hierarchical matrices 2 Yuwei Fany,

Latent Variable / Hierarchical Models in Computational Neural Science Ying Nian Wu

A Hierarchical Variational Neural Uncertainty Model for

Neural Implementation of Hierarchical Bayesian Inference ...papers.nips.cc/paper/3782-neural-implementation-of-hierarchical... · and tuning curves detail how neuron’s responses

Performance-optimized hierarchical models predict neural ...web.stanford.edu/class/psych209/Readings/YaminsEtAl14...Performance-optimized hierarchical models predict neural responses