aws re:invent 2016: visualizing big data insights with amazon quicksight (bdm204)

29
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Quinton Alsbury and Guy Farber - AWS Sergi Mesquida - HotelBeds Group BDM204 Analyzing Big Data with Amazon QuickSight

Upload: amazon-web-services

Post on 06-Jan-2017

164 views

Category:

Technology


1 download

TRANSCRIPT

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Quinton Alsbury and Guy Farber - AWS

Sergi Mesquida - HotelBeds Group

BDM204

Analyzing Big Data with Amazon QuickSight

The explosion of data that is being generated by cloud-based applications and services,

as well as data that is being migrated to cloud platforms, is increasing exponentially

Data generated by cloud based

applications and services

Migrating On-Prem Data

Big Data Frameworks

Confidential

Amazon

Glacier

Amazon S3

Amazon

DynamoDB

Amazon RDS,

Aurora

Amazon

CloudSearch

Amazon

Elasticsearch

Amazon EMR

Amazon EC2

Amazon

Redshift

Amazon

Machine

Learning

Amazon Kinesis

Analytics

AWS continues to deliver ground-breaking services for developers and

businesses to store, manage, and process your data…

Amazon

Kinesis

Firehose

Amazon Kinesis

AWS Direct Connect

AWS Import/Export

Collect Store Analyze

Introducing

Amazon QuickSight is a fast, easy to use business analytics service at 1/10th

the cost of traditional BI solutions.

Business Professionals

Data Consumers

Data

Professionals

Who Is QuickSight For?

QuickSight is designed to give everyday

business users the flexibility to do easy, self

serve analysis on their data.

QuickSight is also perfect for delivering

published dashboards throughout the

organization.

CEOs

Confidential

Business Professionals

Data Consumers

CMO

Sales Managers

Product Managers

CEOs

ProcurementAWS Ops

Sales Reps

Store Managers

Warehouse Managers

Support Reps

Fast, Easy Ad-Hoc Analytics for

End Users

QuickSight combines an elegant, easy to

use interface with blazing fast performance

powered by SPICE to get users from data

to insights faster than ever before.

Confidential

Collaborate, Share and Publish

QuickSight let’s users create and share Data Sets, collaborate on your live Analyses, and share,

read only Dashboards and Storyboards that can be accessed on any device, anytime, anywhere.

Analyses

Analyses are visual explorations of your data.

Multiple users can collaborate on an analyses with

the ability to modify and change them in any way.

StoryBoards

Let you combine visualizations into a

guided tour that you can share with

other users.

Dashboards

You can share your analyses as read only

dashboards. Viewers can interact with and filter

the visualizations without modifying them.

Confidential

Deeply Integrated

QuickSight is deeply integrated with

AWS data sources like Amazon

Redshift, RDS, S3 and others, as

well as third party sources like

Excel, Salesforce as well as on-

premises databases.

Amazon S3

Amazon RDS, Aurora Amazon Redshift

Flat

Files

Confidential

Connect, SPICE, Analyze

QuickSight allows you to connect to data from a wide variety of AWS, third party, and on-premises sources

and import it to SPICE. Users can then easily explore, analyze, and share their insights with anyone.

Amazon RDS

Amazon S3

Amazon Redshift

Intelligent Analytics

In future versions QuickSight will leverage

machine learning to deliver powerful

features like auto suggestions, predictive

analytics, and machine generated insights.

+Amazon Machine

Learning

Confidential

Demo

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Sergi Mesquida - Head of Innovation & New Ventures

11/29/2016

AWS & Quicksight

in Hotelbeds Group

ROOMNIGHTS

+13,000TRANSFER ROUTES

+8,000ACTIVITIES

+12,000PORTCALLS

+25 MILLION

+75,000HOTELS CONTRACTED

€4.28BNIN SALES

14 YEARSDOUBLE DIGIT GROWTH

+120SOURCE MARKETS

PRODUCTS IN

+185 COUNTRIES

INCOMING SERVICES IN

+40 COUNTRIES

Market consolidation

Services developed from the need for extraordinary Scalability

The Tech Challenge – Organic + Inorganic Growth

Hundreds of servers to be deployed

between Feb & June

The business has Data but what we need is Information

• 170M requests a Day

• 250k entries of logs per day

• 1.3 PetaBytes of Storage

• 30% Yearly growth of our data

• Why does this hotel stop selling?

• How good is my pricing?

• How seasonal are bookings in BCN?

TOFROM

So we have created a platform to make sense of the Data In real time

Direct

Connect

Lambda

S3

Redshift

Kinesis

Tableau

QuickSight

90%

NRT

10%

BATCH

20 Shards 600GB RAM +5 TB DAILY

+2500M events per

day

+5,000 Tables ingested per datM events per

day

SPICE

QuickSight, Data as a Service to the Business Units II

• Sub model with HBG Tables selected & redesigned from the Global Model (1.300 Tables)

• Contains the Master & Transactional Tables with all the info required by any agent.

• Corporate Master Data and Corporate Data Marts.

• Are consumed very fast way: loaded in QuickSight to resolve in memory

• multi joins queries, aggregations, groupings, etc..

• avoiding need to materialize all possible complex queries.

Core Business will provide the Business Units with a product with the

most relevant data while reducing the number of recurrent queries

to Redshift with Spice:

QuickSight, as a tool to develop data products

We Liked!Easy Access to data sources

Easy connection test

Load in SPICE is very fast

Good syntax assistant to create new fields

Import summary report very useful

User friendly visual creation analysis interface

Visual transformation are easy & fast

Strong self-discovery & data analysis

Drill down and explore a char are powerful

Creating / sharing dashboards through email

Lessons Learned

Nice to Have!More data sources types

Security implemented in data source

Connect Tableau to SPICE

More functions to create new field

More visual types

More and complex Filters

Easy way to apply dimensions granularity &

labels to a single chart

Need to include dimensions in titles

Secure, Scalable, Cloud

As a native cloud service, QuickSight combines the speed, scalability, and security that our customers

have come to depend on with the value and cost effectiveness you expect from AWS.

• Native AWS Cloud Service

• Secure

• No Server Licensing

• No Infrastructure or Maintenance Costs

• No Deployment, Sign Up and Go!

• Designed to Scale

• Simple, Intuitive UX

• Subscription Model

Confidential

Q&AGuy Farber, BDM AWS

Thank you!