hortonworks data cloud for aws
TRANSCRIPT
1 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Hortonworks Data Cloud for AWSField Awareness SessionNovember 4, 2016
2 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Introducing Hortonworks Data Cloud for AWS
Delivered and sold via AWS Marketplace Focuses on business agility, rather than
infinite configurability and cluster management
Addresses prescriptive, ephemeral use cases around Spark and Hive
Offers Pay-As-You-Go (PAYG) pricing “Optional Free Community Support”**
** Enterprise Support option coming soon
3 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Choose from Set of Prescriptive Cluster Types
4 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Product Architecture
cloudcontroller
(powered by Cloudbreak)
MasterNode
WorkerNode
WorkerNode
WorkerNode
MasterNode
WorkerNode
WorkerNode
WorkerNode
MasterNode
WorkerNode
WorkerNode
WorkerNode
Hortonworks Cloud - Product Architecture
HDP Cluster A
HDP Cluster B
HDP Cluster C
AMI-1 AMI-2 AMI-2 AMI-2 AMI-2
AMI-2 AMI-2 AMI-2 AMI-2
AMI-2 AMI-2 AMI-2 AMI-2
Docker
5 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Cluster Node Types
Master Node
Worker Node
- Ambari Server- Ambari Metrics Collector- HDP Master components (NameNode, ResourceManager,
HiveServer, etc)- Network Gateway
- Ambari Agent- Ambari Metrics Monitor- HDP Slave components (NodeManager, DataNode, etc)
2
6 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Hortonworks Data Cloud: Two AWS Marketplace Products
Name Description Components
Hortonworks Data Cloud – Controller Service
Initial Version: 1.8
Users run a single instance of this AMI in their AWS environment. It is the “cloud controller” for creating and managing HDP clusters.
- Operating System (Amazon Linux)- Cloudbreak- JDK (OpenJDK)- Database (PostgreSQL)- SmartSense
Hortonworks Data Cloud – HDP Services
Initial Version: 2.5
This AMI contains the Ambari + HDP software that becomes a cluster launched from the “cloud controller”.
- Operating System (Amazon Linux)- Ambari- HDP- JDK (OpenJDK)- Database (PostgreSQL)- SmartSense
• User must accept both product subscriptions in AWS Marketplace in order to create clusters
7 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Getting Started
Launch Cloud Controller
1Create
Cluster(s)
2Resize
Clone
Terminate
3
Subscribe to Products
0
8 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Launch Cloud Controller: Basic vs. Advanced
Basic Advanced
Cloud Controller Database Embedded PostgreSQL External Amazon RDS PostgreSQL
Cloud Controller VPC Creates New VPC + Subnet Uses Existing VPC + Subnet
Cluster VPC Options - Same VPC + New Subnet, or- Existing VPC + Subnet
- Same VPC + New Subnet, or- Existing VPC + Subnet
• Basic: Easiest approach, great for getting started but…• If you lose your controller instance, you lose your setup information.• No method to upgrade (to future releases).
• Advanced: For real deployments, stores controller setup information in external DB but…• Required more AWS knowledge to get started.
1
9 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Common Issues: First Time Access and SSL
This is not actually an issue…this is just the first time experience….– But user might be startled so this question might come up.
User needs to accept the SSL certificate when first accessing the cloud controller.
1
10 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Create Cluster: Hardware & Storage
Choose instance type for Master and Worker nodes Choose number of Worker node instances Advanced Option to customize storage per instance
2