aws 先進的機器學習產 品加速雲端創新...© 2017, amazon web services, inc. or its...
TRANSCRIPT
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
以 AWS 先進的機器學習產品加速雲端創新
王宇博AWS大中華區人工智慧業務發展負責人
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Quick Look at Machine Learn ing in 2018
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
FinServ HCLS
A I i n Eve r y I n d u st r y Ve r t i c a l
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fast Compute
Bigger Data
Advanced Learning Algorithms
W hy n o w
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A g re a t M L P l a t fo r m c a n U n l o c k t h e D a t a
📱🎬
📷🌄
2020
Amazon S3
Amazon Glacier
AWS GlueAmazon Redshift +Spectrum
Amazon EMR
AthenaKinesis
Amazon SageMaker
Deep Learning AMI
Amazon Rekognition
Lex
Polly
TranslateTranscribe
Comprehend
$210B
$150.8B
2017
Data Analytics MarketData is the real battleground
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
📱🎬📷🌄
Snowball
AW S I s t h e C e n t e r o f G rav i t y fo r M L
AWS IoT
Snowmobile
DBS Migration
Greengrass ML
Edge
MTurk
Kinesis
Amazon Rekognition
Lex
Polly Translate
Transcribe Comprehend
AppServices
AI Platform&Engines
Amazon SageMaker
Cloud
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
M o re m a c h i n e l e a r n i n g i s b u i l t o n AW S t h a n a ny w h e re e l s e
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
C o m p u t e r v i s i o n
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Re c o m m e n d a t i o n e n g i n e s
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
9fin uses computer vision and natural language to search, filter and analyze
financial documents
Signal Media provides organizations with business intelligence from large
volumes of news data
SCDM Financial extracts actionable information about markets and consumers from mountains
of documents
LISA is an AI assistant that reads, understands, categorizes, and drafts
emails
The Washington Post uses AI to moderate comments and to filter
non-compliant posts
Echobox uses AI to automate the management of social media and
editorial content
Zendesk helps automate customer service and mitigate higher-cost
interactions
U n d e rs t a n d i n g n a t u ra l l a n g u a ge
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
TwoSense uses behavioral biometrics to identify and authenticate users by their mobile device movement
Vidora analyzes customer behavior to predict and reduce customer churn
SigOpt’s optimization engine helps to speed up and improve AI and machine learning models
German Autolabs built an AI-powered digital assistant for drivers to make driving safer and easier
Missing Link simplifies deep learning for clients and optimizes AI models for improved performance
SignalBox provides a simplified deep learning platform with a drag-and-drop web interface
Pa tt e r n re c o g n i t i o n a n d o p t i m i za t i o n
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Put machine learning in the hands of every developer and data scientist
ML @ AWS: Our mission
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Productrecommendation
engine
Robot-enabledfulfillment
centers
Newproduct
categories
Amazon has invested in AI/ML since our inception, and we share our knowledge and capabilities with
our customers20181995
Natural language processing-supported contact centers
ML-driven supplychain and
capacity planning
Checkout-freeshopping
using deep learning
A m a zo n ’s d e e p i n n o va t i o n w i t h A I / M L
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A W S o f f e r s a r a n g e o f t o o l s t o m a k e A I / M L m o r e a c c e s s i b l e
PollyLex Rekognition
Deep Learning FrameworksAmazon AI/ML Services
Usability/simplicity:leverages AWS AI/ML expertise
Greater control:customer-specific modelsThese solutions are underpinned by proven,
scalable AWS products and services
AWS GreengrassAWSIoT
AWSLambda
Amazon EC2(P2 and G2 GPUs)
AmazonS3
AmazonDynamoDB
Amazon Redshift
Amazon EC2(CPUs)
Amazon EC2(ENA)
RekognitionVideo
Machine Learning Platforms
Amazon ML
Spark & EMR
Kinesis
Batch
ECS
Connect Transcribe Translate ComprehendSageMaker
DeepLens
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
T h e s e t o o l s c o m e t o ge t h e r t o a f u l l A I / M L s t a c k
Platforms
Amazon ML ECSSpark & EMR Kinesis Batch
Infrastructure GPU MobileCPU IoT
Services
Lex
Polly
Rekognition
Frameworks Apache MXNet
TorchCognitive
ToolkitKerasTheano
Caffe2 & Caffe
TensorFlow
AWS Deep Learning AMI
Our approach is to support all major frameworks and enable our customers to use the best tool for the job.
Rekognition Video
ConnectTranscribe
Translate Comprehend
SageMaker DeepLens ML Solutions Lab
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Appl icat ion Ser v ices
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
M L A p p l i c a t i o n S e r v i c e s a r e d e s i g n e d f o r e a s e - o f - u s e
Amazon data science expertise
Amazon trainingdata
Amazon modelsand learning
Accessibility via API
Foundational components of Amazon AI/ML services
Scalable, trained, and continuously optimized services that
do not require extensive AI/ML expertise
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
E n h a n c i n g t h e c u s t o m e r e x p e r i e n c e a n d u n c o v e r i n g i n s i g h t s
PollyTurn text into lifelike speech using
deep learning
LexConversational interfaces through natural language understanding
ComprehendDiscover insights and relationships in text
TranscribeAdd speech to text capability to
applications
TranslateMore accurate and natural sounding
translation services
RekognitionFacial and object recognition through deep
learning-based image analysis
Vision
Text
Language
Rekognition VideoFacial and object recognition through deep
learning-based video analysis
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
R e ko g n i t i o n I m a g e & V i d e o h a r n e s s u n s t r u c t u r e d d a t a
Face-based user verification
• Confirm user identities by comparing live images with a reference image
• Automated account opening• Biometric authentication transaction
security from images and video
Facial recognition
• Find similar faces in a collection of images and video
• Log visitors (timestamp)• Person verification – detect
stolen/shared IDs
Rekognition
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
L ex a n d Po l l y h e l p p e rs o n a l i ze c o nve rs a t i o n s
• Informational bots
• Create chatbots for everyday consumer requests
• Application bots
• Build powerful interfaces tomobile applications
• Enterprise productivity bots
• Streamline enterprise workactivities and improve efficiencies
• Internet of Things (IoT) bots
• Enable conversational interfacesfor device interactions
Use cases
• News updates• Investment information• Account information
• Book trades • Pay bills• Manage bank accounts
• Check sales numbers• Marketing performance• Answer employee queries
(benefits, HR, etc.)
• Wearables• Location-based
personalization• Telematics for insurance
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A m a zo n C o n n e c t i n t e g ra t e s M L i m p ro v i n g c u st o m e r ex p e r i e n c e
Thank you. Your credit card is now unlocked and you should be able to proceed with the
transaction.
Sure, the code is 12345.
Great,thank you!Data
DipCRM content
Hi Nikki Wolf,based on unusual activity, we have
locked your Credit Card. Is your call
related to this? If so, please enter the
onetime code sent to your phone.
Incomingcustomer
call
NATURALConnect integrates with Amazon Lex to give
the apply speech recognition and natural language understanding technology that powers Alexa to customer interactions
DYNAMICAmazon Connect answers
customer questions before they are asked
PERSONALContact flows adapt on a per
customer basis
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Tra n s c r i b e , Tra n s l a t e , a n d C o m p re h e n d m i n e vo i c e c o m m u n i c a t i o n s fo r i n s i g h t
Transcribe
Transcribe audio files into text making them easily searchable
• Customer service call logs
Add a custom library of terms
• Suspect phrases
Translate
Translate text in real time
• Customer support
• Websites
Comprehend
Find insights and relationships in text
• Extract key phrases
Understand the sentiment behind the text
• Customer support calls
• Social media feeds
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Plat form Ser v ices
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Machine Learn ing i s Part o f a P ipe l ine
ModelAlgorithmData Lake
Prediction
New data
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What i s Amazon SageMaker?
One-click training for ML, DL, and custom
algorithms
Easier training with hyperparameter
optimization
Highly-optimized machine learning
algorithms
Deployment without engineering
effort
Fully-managed hosting at scale
BuildPre-built notebook
instances
Deploy
Train
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ModelAlgorithmData Lake
Prediction
New data
Amazon SageMaker
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data Lake ModelAlgorithm
Prediction
New data
Amazon SageMaker
High availabilitymodel hosting
-as-a-service
Model training and
optimization
Fully-managedAPI endpoints
Low latency inference
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AlgorithmData Lake
Amazon SageMaker
-as-a-service
K-Means
XGBoostLinear Learner
DeepAR
Seq2Seq
Factorization Machine
PCA
BYOA
BlazingText
LDA
Image Classification
NTM
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ModelAlgorithmData Lake
Amazon SageMaker
-as-a-service
Edge
Greengrass ML
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS DeepLens : A Deep Learn ing -Enabled V ideo Camera for Developers
• Fully programmable video camera
• Optimized for deep-learning on the
device with Apache MXNet, Caffe,
TensorFlow
• Tutorials, sample code, examples, and pre-built models
• Integrated with Amazon IM for custom models
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Mechanical Turk
• The first and foremost challenge in build AI systems is to build ground truth data
• Need human intelligence to annotate speech, vision, or language data sets
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks and Infrastructure
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 P3 Instances
• Up to eight NVIDIA Tesla V100 GPUs
• 1 PetaFLOP of computational performance – 14x
better than P2
• 300 GB/s GPU-to-GPU communication (NVLink)
– 9X better than P2
• 16 GB GPU memory with 900 GB/sec peak GPU
memory bandwidth
T h e f a s t e s t , m o s t p o w e r f u l G P U i n s t a n c e s i n t h e c l o u d
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Gluon
• Simplifies development of deep learning models
• Provides greater flexibility in building neural networks
• Offers high performance
• Developed in collaboration with Microsoft
• Available now in MXNet, coming soon to CNTK
Simple, Easy-to-Understand Code
Flexible, Imperative Structure
Dynamic Graphs High Performance
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Open Neura l Network Exchange (ONNX)
• Developers can choose the framework that best fits their needs
• More customers can take advantage of MXNet’s performance and
scalability
• MXNet users to run their model on various mobile and edge devices
(Qualcomm, Huawei, Intel, and ARM announced support for ONNX)
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Greengrass ML Inference
Build and train ML models in the cloud
Accelerate ML inferenceapplications on the edge
Devices take action quickly – even when disconnected
Use Greengrass to deploy optimized models on your target device
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
T h e b ro a d e st M L p l at fo r m , t h at ’s e a s i e st to u s e , a n d h a s t h e m o st c u sto m e rs
DATA LAKE STORAGE
Amazon S3
SECURITY
Access Control
Encryption
COMPUTE
Powerful GPU and CPU Instances
ANALYTICS
Amazon Athena
Amazon Redshift and Redshift Spectrum
Amazon EMR
(Spark, Hive, Presto, Pig)
AWS Glue
Amazon Kinesis
Amazon QuickSight
Amazon Macie
AWS Organizations
Complementary Services
APPLICATION SERVICES
Amazon Lex
Amazon Polly
Amazon Comprehend
Amazon Translate
Amazon Transcribe
Amazon Rekognition Image
Amazon Rekognition Video
PLATFORM SERVICES
Amazon SageMaker AWS DeepLens
FRAMEW ORKS AND INTERFACES
AWS Deep Learning AMI
Apache MXNet
Caffe2
CNTK
PyTorch
TensorFlow
Theano
Torch
Gluon
Keras
AWS ML Platform AWS ML Customers
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Let’s Get Started with machine learning on AWS
THANK YOU!