real-time serverless machine learning · 2017. 10. 20. · aws lambda amazon s3 data storage ......

23
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. October, 2017 Real-Time Serverless Machine Learning Powering the retail industry Roy Ben-Alta, Principal BDM

Upload: others

Post on 25-Sep-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

October, 2017

Real-Time Serverless Machine LearningPowering the retail industry

Roy Ben-Alta, Principal BDM

Page 2: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Retailers need to deliver continuous

differentiation

Personalization InnovationReal-time engagement

Page 3: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Personalization MerchandisingReal-time engagement

Retailers need to deliver continuous

differentiation

Page 4: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Kaiten Sushiro Story

Page 5: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Ingest/

Collect

Consume/

visualizeStore

Process/

analyze

Data

1 40 9

5

Amazon

Kinesis Amazon RedShift

Answers &

Insights

Store operation

dashboard

Personalization

Reporting

Page 6: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Personalization MerchandisingReal-time engagement

Retailers need to deliver continuous

differentiation

Page 7: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

American upscale fashion retailer

Nordstrom has

323 stores operating

in 38 of the United States

and also in Canada; the

largest in number of

stores and

geographic footprint of its retail competitors

Fashion retailer that sells

clothing, shoes,

cosmetics, and

accessories

Nordstrom is

going all in on AWS

https://aws.amazon.com/solutions/case-studies/nordstrom/

NORDSTROM

Page 8: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose
Page 9: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Ingest/

Collect

Consume/

visualizeStore

Process/

analyze

Data

1 40 9

5

Outcomes

& Insights

Personalized

recommendations within

seconds (from 15-20 min)

Scale the expertise of

stylists to all shoppers

Reduce costs by 2X order

of magnitude

Mobile Users

Desktop Users

Analytics

Tools

Online Stylist

Amazon

RedShift

Amazon

Kinesis

AWS

Lambda

Amazon

DynamoDBAWS

Lambda

Amazon S3

Data Storage

NORDSTROM

Page 10: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Nordstrom gives personalized style recommendations in seconds

.

Alert me when the

internet is down ...

Keith Homewood

Cloud Product Owner, Nordstrom

“ • Nordstrom Recommendation is the online version of a

stylist. It can analyze and deliver personalized

recommendations in seconds

• Going All-In on AWS has resulted in reducing costs

by 2X

• Continuous delivery allows Nordstrom to deliver

multiple production launches a day in a single

application

• Can now create a personalized recommendation in

seconds, in what used to take 15-20 minutes of

processing

• Nordstrom Cloud Product Owner finds the reliability

and availability of AWS so suitable that as long as the

internet is working, Nordstrom Recommendation is

working

Nordstrom

Page 11: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Retailers need to deliver continuous

differentiation

Personalization InnovationReal-time engagement

Page 12: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

At Amazon, we’ve been making

investments in ML for the last 20 years…

Search &

Discovery

Fulfilment

& Logistics

Existing

Products

New

Initiatives

Page 13: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Amazon AI

Services

Platforms

Frameworks

Infrastructure

Apache

MXNetTorch

Cognitiv

e ToolkitKerasTheano

Caffe2

& CaffeTensorFlow

AWS Deep Learning AMI

GPU MobileCPU IoT

Amazon ML ECSSpark &

EMRKinesis Batch

Vision Speech Language

Page 14: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Demo

Page 15: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Streaming Analytics Demo

http://amzn.to/takeselfie

Page 16: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

SELECT

STREAM COUNT(*) AS MUSTACH_COUNT,

STEP(ROWTIME BY INTERVAL '1' SECOND)

FROM SOURCE_STREAM

WHERE HAS_MUSTACH = TRUE;

End-to-End Architecture

Amazon

Kinesis

Stream

Amazon

Kinesis

Analytics

Amazon

Cognito

Amazon

Kinesis

Stream

Amazon

DynamoDB

Amazon

Lambda

Amazon

S3

JavaScript

SDK

Amazon

Rekognition

Amazon

Kinesis

Firehose

Amazon

S3

Page 17: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Real-time Dashboard Demo

amzn.to/bigdata

Page 18: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

End-to-End Architecture

Amazon

Kinesis

Stream

Amazon

Kinesis

Analytics

Amazon

Cognito

Amazon

Kinesis

Stream

Amazon

DynamoDB

Amazon

Lambda

Amazon

S3

JavaScript

SDK

Page 19: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon Kinesis

Kinesis

Firehose

Kinesis

AnalyticsKinesis Streams

Build your own custom

applications that process

or analyze streaming

data

Easily analyze data

streams using standard

SQL queries

Easily load massive volumes

of streaming data into other

destinations

Page 20: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon Kinesis Customer Base

Diversity

1 billion events/wk from

connected devices | IoT

17 PB of game data per

season | Entertainment

80 billion ad

impressions/day, 30 ms

response time | Ad Tech

Predictive Analytics and

ML

50 billion ad

impressions/day sub-50

ms responses | Ad Tech

10 million events/day

| Retail

Ingesting 7M+ network

events every second

Funnel all

production events

through Amazon

Kinesis

Page 21: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Why Are These Customers Choosing

Amazon Kinesis?

Lower costs

Performant without

heavy lifting

Scales elastically

Increased agility

Secure and visible

Plug and play

Page 22: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Serverless Analytics – Enable your org with 0 operation overhead

Amazon S3

IngestStreaming

ETLPersist Analyze

AWS

Lambda

O msec seconds minutes

Amazon Kinesis

Firehose

Amazon

Redshift

Amazon

Elasticsearch

Amazon

Athena

Amazon

Kinesis

Analytics

Amazon

Redshift

SpectrumAmazon

Kinesis

Streams

Page 23: Real-Time Serverless Machine Learning · 2017. 10. 20. · AWS Lambda Amazon S3 Data Storage ... Lambda DynamoDB Amazon S3 JavaScript SDK Amazon Rekognition Amazon Kinesis Firehose

Thank You