aws 先進的機器學習產...

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

以 AWS 先進的機器學習產品加速雲端創新

王宇博AWS大中華區人工智慧業務發展負責人

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Quick Look at Machine Learn ing in 2018


FinServ HCLS

A I i n Eve r y I n d u st r y Ve r t i c a l


Fast Compute

Bigger Data

Advanced Learning Algorithms

W hy n o w


A g re a t M L P l a t fo r m c a n U n l o c k t h e D a t a

📱🎬

📷🌄

2020

Amazon S3

Amazon Glacier

AWS GlueAmazon Redshift +Spectrum

Amazon EMR

AthenaKinesis

Amazon SageMaker

Deep Learning AMI

Amazon Rekognition

Lex

Polly

TranslateTranscribe

Comprehend

$210B

$150.8B

2017

Data Analytics MarketData is the real battleground


📱🎬📷🌄

Snowball

AW S I s t h e C e n t e r o f G rav i t y fo r M L

AWS IoT

Snowmobile

DBS Migration

Greengrass ML

Edge

MTurk

Kinesis

Amazon Rekognition

Lex

Polly Translate

Transcribe Comprehend

AppServices

AI Platform&Engines

Amazon SageMaker

Cloud


M o re m a c h i n e l e a r n i n g i s b u i l t o n AW S t h a n a ny w h e re e l s e


C o m p u t e r v i s i o n

http://www.tusimple.com/index-en.html


Re c o m m e n d a t i o n e n g i n e s


9fin uses computer vision and natural language to search, filter and analyze

financial documents

Signal Media provides organizations with business intelligence from large

volumes of news data

SCDM Financial extracts actionable information about markets and consumers from mountains

of documents

LISA is an AI assistant that reads, understands, categorizes, and drafts

emails

The Washington Post uses AI to moderate comments and to filter

non-compliant posts

Echobox uses AI to automate the management of social media and

editorial content

Zendesk helps automate customer service and mitigate higher-cost

interactions

U n d e rs t a n d i n g n a t u ra l l a n g u a ge


TwoSense uses behavioral biometrics to identify and authenticate users by their mobile device movement

Vidora analyzes customer behavior to predict and reduce customer churn

SigOpt’s optimization engine helps to speed up and improve AI and machine learning models

German Autolabs built an AI-powered digital assistant for drivers to make driving safer and easier

Missing Link simplifies deep learning for clients and optimizes AI models for improved performance

SignalBox provides a simplified deep learning platform with a drag-and-drop web interface

Pa tt e r n re c o g n i t i o n a n d o p t i m i za t i o n


Put machine learning in the hands of every developer and data scientist

ML @ AWS: Our mission


Productrecommendation

engine

Robot-enabledfulfillment

centers

Newproduct

categories

Amazon has invested in AI/ML since our inception, and we share our knowledge and capabilities with

our customers20181995

Natural language processing-supported contact centers

ML-driven supplychain and

capacity planning

Checkout-freeshopping

using deep learning

A m a zo n ’s d e e p i n n o va t i o n w i t h A I / M L


A W S o f f e r s a r a n g e o f t o o l s t o m a k e A I / M L m o r e a c c e s s i b l e

PollyLex Rekognition

Deep Learning FrameworksAmazon AI/ML Services

Usability/simplicity:leverages AWS AI/ML expertise

Greater control:customer-specific modelsThese solutions are underpinned by proven,

scalable AWS products and services

AWS GreengrassAWSIoT

AWSLambda

Amazon EC2(P2 and G2 GPUs)

AmazonS3

AmazonDynamoDB

Amazon Redshift

Amazon EC2(CPUs)

Amazon EC2(ENA)

RekognitionVideo

Machine Learning Platforms

Amazon ML

Spark & EMR

Kinesis

Batch

ECS

Connect Transcribe Translate ComprehendSageMaker

DeepLens


T h e s e t o o l s c o m e t o ge t h e r t o a f u l l A I / M L s t a c k

Platforms

Amazon ML ECSSpark & EMR Kinesis Batch

Infrastructure GPU MobileCPU IoT

Services

Lex

Polly

Rekognition

Frameworks Apache MXNet

TorchCognitive

ToolkitKerasTheano

Caffe2 & Caffe

TensorFlow

AWS Deep Learning AMI

Our approach is to support all major frameworks and enable our customers to use the best tool for the job.

Rekognition Video

ConnectTranscribe

Translate Comprehend

SageMaker DeepLens ML Solutions Lab


Appl icat ion Ser v ices


M L A p p l i c a t i o n S e r v i c e s a r e d e s i g n e d f o r e a s e - o f - u s e

Amazon data science expertise

Amazon trainingdata

Amazon modelsand learning

Accessibility via API

Foundational components of Amazon AI/ML services

Scalable, trained, and continuously optimized services that

do not require extensive AI/ML expertise


E n h a n c i n g t h e c u s t o m e r e x p e r i e n c e a n d u n c o v e r i n g i n s i g h t s

PollyTurn text into lifelike speech using

deep learning

LexConversational interfaces through natural language understanding

ComprehendDiscover insights and relationships in text

TranscribeAdd speech to text capability to

applications

TranslateMore accurate and natural sounding

translation services

RekognitionFacial and object recognition through deep

learning-based image analysis

Vision

Text

Language

Rekognition VideoFacial and object recognition through deep

learning-based video analysis


R e ko g n i t i o n I m a g e & V i d e o h a r n e s s u n s t r u c t u r e d d a t a

Face-based user verification

• Confirm user identities by comparing live images with a reference image

• Automated account opening• Biometric authentication transaction

security from images and video

Facial recognition

• Find similar faces in a collection of images and video

• Log visitors (timestamp)• Person verification – detect

stolen/shared IDs

Rekognition


L ex a n d Po l l y h e l p p e rs o n a l i ze c o nve rs a t i o n s

• Informational bots

• Create chatbots for everyday consumer requests

• Application bots

• Build powerful interfaces tomobile applications

• Enterprise productivity bots

• Streamline enterprise workactivities and improve efficiencies

• Internet of Things (IoT) bots

• Enable conversational interfacesfor device interactions

Use cases

• News updates• Investment information• Account information

• Book trades • Pay bills• Manage bank accounts

• Check sales numbers• Marketing performance• Answer employee queries

(benefits, HR, etc.)

• Wearables• Location-based

personalization• Telematics for insurance


A m a zo n C o n n e c t i n t e g ra t e s M L i m p ro v i n g c u st o m e r ex p e r i e n c e

Thank you. Your credit card is now unlocked and you should be able to proceed with the

transaction.

Sure, the code is 12345.

Great,thank you!Data

DipCRM content

Hi Nikki Wolf,based on unusual activity, we have

locked your Credit Card. Is your call

related to this? If so, please enter the

onetime code sent to your phone.

Incomingcustomer

call

NATURALConnect integrates with Amazon Lex to give

the apply speech recognition and natural language understanding technology that powers Alexa to customer interactions

DYNAMICAmazon Connect answers

customer questions before they are asked

PERSONALContact flows adapt on a per

customer basis


Tra n s c r i b e , Tra n s l a t e , a n d C o m p re h e n d m i n e vo i c e c o m m u n i c a t i o n s fo r i n s i g h t

Transcribe

Transcribe audio files into text making them easily searchable

• Customer service call logs

Add a custom library of terms

• Suspect phrases

Translate

Translate text in real time

• Customer support

• Websites

Comprehend

Find insights and relationships in text

• Extract key phrases

Understand the sentiment behind the text

• Customer support calls

• Social media feeds


Plat form Ser v ices


Machine Learn ing i s Part o f a P ipe l ine

ModelAlgorithmData Lake

Prediction

New data


What i s Amazon SageMaker?

One-click training for ML, DL, and custom

algorithms

Easier training with hyperparameter

optimization

Highly-optimized machine learning

algorithms

Deployment without engineering

effort

Fully-managed hosting at scale

BuildPre-built notebook

instances

Deploy

Train



Prediction

New data

Amazon SageMaker


Data Lake ModelAlgorithm

Prediction

New data

Amazon SageMaker

High availabilitymodel hosting

-as-a-service

Model training and

optimization

Fully-managedAPI endpoints

Low latency inference


AlgorithmData Lake

Amazon SageMaker

-as-a-service

K-Means

XGBoostLinear Learner

DeepAR

Seq2Seq

Factorization Machine

PCA

BYOA

BlazingText

LDA

Image Classification

NTM



Amazon SageMaker

-as-a-service

Edge

Greengrass ML


AWS DeepLens : A Deep Learn ing -Enabled V ideo Camera for Developers

• Fully programmable video camera

• Optimized for deep-learning on the

device with Apache MXNet, Caffe,

TensorFlow

• Tutorials, sample code, examples, and pre-built models

• Integrated with Amazon IM for custom models


Amazon Mechanical Turk

• The first and foremost challenge in build AI systems is to build ground truth data

• Need human intelligence to annotate speech, vision, or language data sets


Frameworks and Infrastructure


Amazon EC2 P3 Instances

• Up to eight NVIDIA Tesla V100 GPUs

• 1 PetaFLOP of computational performance – 14x

better than P2

• 300 GB/s GPU-to-GPU communication (NVLink)

– 9X better than P2

• 16 GB GPU memory with 900 GB/sec peak GPU

memory bandwidth

T h e f a s t e s t , m o s t p o w e r f u l G P U i n s t a n c e s i n t h e c l o u d


Gluon

• Simplifies development of deep learning models

• Provides greater flexibility in building neural networks

• Offers high performance

• Developed in collaboration with Microsoft

• Available now in MXNet, coming soon to CNTK

Simple, Easy-to-Understand Code

Flexible, Imperative Structure

Dynamic Graphs High Performance


Open Neura l Network Exchange (ONNX)

• Developers can choose the framework that best fits their needs

• More customers can take advantage of MXNet’s performance and

scalability

• MXNet users to run their model on various mobile and edge devices

(Qualcomm, Huawei, Intel, and ARM announced support for ONNX)


AWS Greengrass ML Inference

Build and train ML models in the cloud

Accelerate ML inferenceapplications on the edge

Devices take action quickly – even when disconnected

Use Greengrass to deploy optimized models on your target device


T h e b ro a d e st M L p l at fo r m , t h at ’s e a s i e st to u s e , a n d h a s t h e m o st c u sto m e rs

DATA LAKE STORAGE

Amazon S3

SECURITY

Access Control

Encryption

COMPUTE

Powerful GPU and CPU Instances

ANALYTICS

Amazon Athena

Amazon Redshift and Redshift Spectrum

Amazon EMR

(Spark, Hive, Presto, Pig)

AWS Glue

Amazon Kinesis

Amazon QuickSight

Amazon Macie

AWS Organizations

Complementary Services

APPLICATION SERVICES

Amazon Lex

Amazon Polly

Amazon Comprehend

Amazon Translate

Amazon Transcribe

Amazon Rekognition Image

Amazon Rekognition Video

PLATFORM SERVICES

Amazon SageMaker AWS DeepLens

FRAMEW ORKS AND INTERFACES

AWS Deep Learning AMI

Apache MXNet

Caffe2

CNTK

PyTorch

TensorFlow

Theano

Torch

Gluon

Keras

AWS ML Platform AWS ML Customers


Let’s Get Started with machine learning on AWS

THANK YOU!

aws 先進的機器學習產...

Documents