ai services aws - taglit

60
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. HUStart Taglit – AWS Herzelia January 2018 AI Services on AWS Boaz Ziniman – Technical Evangelist, AWS @ziniman

Upload: boaz-ziniman

Post on 21-Jan-2018

125 views

Category:

Technology


2 download

TRANSCRIPT

Page 1: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

HUStart Taglit – AWS Herzelia

January 2018

AI Services on AWSBoaz Ziniman – Technical Evangelist, AWS

@ziniman

Page 2: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

The difficulty comes in writing software that will make sense

of the data

Page 3: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Artificial Intelligence

A system or service which can perform tasks that usually require human intelligence

Page 4: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Page 5: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Page 6: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Page 7: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

25,000 skills

Page 8: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

And a few more examples…

Fraud detection Detecting fraudulent transactions, filtering spam emails, flagging suspicious reviews, …

Personalization Recommending content, predictive content loading, improving user experience, …

Targeted marketing Matching customers and offers, choosing marketing campaigns, cross-selling and up-selling, …

Content classification Categorizing documents, matching hiring managers and resumes, …

Churn prediction Finding customers who are likely to stop using the service, free-tier upgrade targeting, …

Customer support Predictive routing of customer emails, social media listening, …

Page 9: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Machine Learning On AWS Today

Page 10: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

VI S I ON LANGUAGE

A P P L I C A T I O N S E R V I C E S

Amazon Rekognition Image Amazon Polly Amazon Lex

Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW

Amazon AI Ecosystem

Page 11: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

VI S I ON LANGUAGE

A P P L I C A T I O N S E R V I C E S

Amazon Rekognition Image Amazon Polly Amazon Lex

Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW

Amazon AI Ecosystem

Page 12: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

General-purpose GPU compute applications.Features:• High Frequency Intel Xeon E5-2686v4 (Broadwell)• High-performance NVIDIA V100 GPUs, each with

5,120 GPU cores + 640 Tensor cores and 16GiB of GPU memory

• Supports GPUDirect™• Enhanced Networking• EBS-optimized by default at no additional cost

Amazon EC2 P3 Instances

Instance Size GPUs GPU Peer to Peer

vCPUs Memory (GiB)

Network Bandwidth*

p3.2xlarge 1 - 8 61 Up to 10Gbpsp3.8xlarge 4 Y 32 244 10Gbpsp3.16xlarge 8 Y 64 488 25Gbps

Page 13: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Expedia - Ranking Hotel Images

• Leading online travel company• How to improve hotels listing images?

• Use GPUs and deep learning to rank hotel images• Build a model based on 100K images

• How to rank 10M images?• Use data parallelization across multiple GPUs on AWS• Improve ranking time from more than a week to 1 day

Page 14: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

VI S I ON LANGUAGE

A P P L I C A T I O N S E R V I C E S

Amazon Rekognition Image Amazon Polly Amazon Lex

Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW

Amazon AI Ecosystem

Page 15: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

VI S I ON LANGUAGE

A P P L I C A T I O N S E R V I C E S

Amazon Rekognition Image Amazon Polly Amazon Lex

Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW

Amazon AI Ecosystem

Page 16: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

One-ClickDeep Learning

AWS Deep Learning AMIsAmazon Linux & Ubuntu

Up to~40k CUDA cores

Apache MXNetTensorFlow

Theano

Keras

Caffe

CNTK

Torch

Pre-configured CUDA drivers

Anaconda, Python3

Out-of-the-box Tutorials

+ CloudFormation template+ Container Image

Available in the AWS Marketplace

Page 17: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Can We Help CustomersPut Intelligence At The Heart Of Every Application & Business?

Page 18: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

VI S I ON LANGUAGE

A P P L I C A T I O N S E R V I C E S

Amazon Rekognition Image Amazon Polly Amazon Lex

Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW

Amazon AI Ecosystem

Page 19: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon

Rekognition

Object and scene detection

Facial analysis

Face comparison

Celebrity recognition

Image moderation

Amazon Rekognition: Images In, Rich Metadata Out

Page 20: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Object & Scene Detection

Page 21: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Facial Analysis

Page 22: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Smiling?

Facial Analysis

(Deep) Learning from a Masterpiecehttp://bit.ly/MonaLisaAI

Page 23: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Celebrity Recognition

Page 24: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Facial Search

Page 25: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Explicit Nudity

Nudity

Graphic Male Nudity

Graphic Female Nudity

Sexual Activity

Partial Nudity

Suggestive

Female Swimwear or Underwear

Male Swimwear or Underwear

Revealing Clothes

Image moderation

Page 26: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon Rekognition Customers

Digital Asset ManagementMedia and EntertainmentTravel and HospitalityInfluencer MarketingSystems IntegrationDigital AdvertisingConsumer StorageLaw EnforcementPublic SafetyeCommerceEducation

Page 27: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.https://aws.amazon.com/solutions/case-studies/cspan/

Page 28: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

R e a l - t i m e a n d b a t c h v i d e o a n a l y t i c sGeneral ly avai lable today

NEW! Amazon Rekognition Video

Page 29: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

AMAZON REKOGNITION VIDEO

A M A Z O N R E K O G N I T I O N

V I D E O

Video in. People, activities, and details out.

Objects and scenes

Facial analysis and recognition

Inappropriate content detection

Celebrity recognition

Person tracking

Page 30: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

AMAZON REKOGNITION VIDEO

Easy to use Batch

processing

Processesreal-time

video

Continually

trained

Low costTimestamp generation

Page 31: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon Polly

“Today in Seattle, WA it’s 11°F”

“Today in Seattle Washington it’s 11 degrees Fahrenheit”

Amazon Polly: Text In, Life-like Speech Out

52 voices across 25 languages

Page 32: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A Focus On Voice Quality & Pronunciation

1. Automatic, Accurate Text Processing• “Today in Seattle, WA, it’s 11°F”• ‘"We live for the music" live from the Madison Square Garden.’

Page 33: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A Focus On Voice Quality & Pronunciation

1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand

Page 34: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A Focus On Voice Quality & Pronunciation

1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand3. Add Semantic Meaning to Text

Page 35: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

https://www.w3.org/TR/speech-synthesis/

<speak>The spelling of my name is

<prosody rate='x-slow'><say-as interpret-as="characters">Boaz</say-as>

</prosody></speak>

A Focus On Voice Quality & Pronunciation

Page 36: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A Focus On Voice Quality & Pronunciation

1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand3. Add Semantic Meaning to Text

• “Richard’s number is 2122341237“<say-as interpret-as="telephone">

Page 37: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A Focus On Voice Quality & Pronunciation

1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand3. Add Semantic Meaning to Text

• “Richard’s number is 2122341237“ • “My daughter’s name is Kaja.”

Page 38: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A Focus On Voice Quality & Pronunciation

1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand3. Add Semantic Meaning to Text

• “Richard’s number is 2122341237“ • “My daughter’s name is Kaja.”

4. Amazon Polly-specific tags• dynamic range compression (drc)

<speak><prosody volume="loud">This text needs to be understandable

and loud.<amazon:effect name="drc">This text also needs to be more

understandable in a moving car.</amazon:effect></prosody></speak>

Page 39: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A Focus On Voice Quality & Pronunciation

1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand3. Add Semantic Meaning to Text

• “Richard’s number is 2122341237“ • “My daughter’s name is Kaja.”

4. Amazon Polly-specific tags• dynamic range compression (drc)• whispered

Page 40: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Duolingo voices its language learning service Using Polly

Duolingo is a free language learning service where users help translate the web and rate translations.

With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices available on the market.

Severin HackerCTO, Duolingo

”“ • Spoken language crucial for

language learning

• Accurate pronunciation matters

• Faster iteration thanks to TTS

• As good as natural human speech

Page 41: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A u t o m a t i c s p e e c h r e c o g n i t i o n

Avai lable in preview today

NEW!

A m a z o n

T r a n s c r i b e

Page 42: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon Transcribe

Support for telephony audio

Timestamp generation

Intelligent punctuation and

formatting

Recognize multiplespeakers

Customvocabulary

Multiple

languages

A u t o m a t i c c o n v e r s i o n o f s p e e c h i n t o a c c u r a t e , g r a m m a t i c a l l y c o r r e c t t e x t

Page 43: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A u t o m a t i c a l l y t r a n s l a t e s

t e x t b e t w e e n l a n g u a g e s

Avai lable in preview today

A m a z o n

T r a n s l a t e

NEW!

Page 44: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon Translate

Real-time translation Batch analysis Automatic language recognition Low cost

Page 45: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Buy what does all this text mean?

Page 46: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

F u l l y m a n a g e d n a t u r a l l a n g u a g e p r o c e s s i n g

General ly avai lable today

NEW!A m a z o n

C o m p r e h e n d

Page 47: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Discover valuable insights from text

Entities

Key Phrases

Language

Sentiment

Amazon

Comprehend

Amazon Comprehend

Page 48: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

STORM

WORLD SERIES

STOCK MARKET

WASHINGTON

LIBRARY OF

NEWS ARTICLES

Amazon

Comprehend

Discover valuable insights from text

Amazon Comprehend

Page 49: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

DEMO

Page 50: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon LexAutomatic Speech Recognition

Natural Language Understanding

“What’s the weather forecast?”

WeatherForecast

Amazon Lex: Speech Recognition & Natural Language Understanding

Page 51: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon LexAutomatic Speech Recognition

Natural Language Understanding

“What’s the weather forecast?”

“It will be sunny and 25°C”

WeatherForecast

Speech Recognition & Natural Language Understanding

Page 52: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

VI S I ON LANGUAGE

A P P L I C A T I O N S E R V I C E S

Amazon Rekognition Image Amazon Polly Amazon Lex

Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW

Amazon AI Ecosystem

Page 53: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon AI Services

High quality,through

best-in-classdeep learning

Deep functionality

Easy to use& thoughtfully

integrated

Built forproduction

Lowcost

Page 54: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Smile!@ziniman

Page 55: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Thank you!@ziniman

Page 56: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

@[email protected]

Artificial Intelligence Workshop

January 2018Boaz Ziniman - Technical Evangelist - AWS

Page 57: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

What to expect

Rekognition – Image recognition (20 min)• 5,000 images per month and store up to 1,000 face metadata

each month, for the first 12 months.

Polly – Text to Speech (10 min)• 5 million characters per month for speech or Speech Marks

requests, for the first 12 months

Lex – Building a chatbot (10 min)• 10,000 text requests and 5,000 speech requests per month for

free for the first year.

Page 58: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Rekognition

• Login to AWS Console - https://console.aws.amazon.com/• Go to Rekognition UI (Try Demo)• Try all 5 demos with photos you take/found online

• Object and scene detection• Image moderation• Facial analysis• Celebrity recognition• Face comparison

Page 59: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Polly

• Login to AWS Console - https://console.aws.amazon.com/• Go to Polly UI• Play with the Plain text tab

• Save some of the files locally

• Open SSML docs - http://bit.ly/AWS-SSML(Using SSML with the Amazon Polly Console)

• Find a dialog from a movie you like (http://www.simplyscripts.com/)

• Try to use SSML to give life to this dialog with Polly

Page 60: Ai services AWS - Taglit

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Lex

• Login to AWS Console - https://console.aws.amazon.com/• Go to Lex UI (Try Demo)• Create a new Bot• Choose one of the 3 sample bots• Chat with your bot• Try to change some of the answers (don’t forget to re-build)