Starburst Presto on Kubernetes

Starburst: www.starburstdata.com

Agenda

Starburst Introduction

Overview of Starburst Presto Kubernetes

Autoscaling

Demo

Questions

Starburst Offering• Enterprise Presto

• Latest Cost Based Query Optimizer• Fully Tested, Stable Releases

• Management• Starburst Mission Control• Presto Coordinator High Availability• Autoscaling with Graceful Shutdown

• Connectivity• Enterprise ODBC & JDBC drivers• Long list of connectors, including Oracle,

Teradata, BigQuery, and Snowflake4

• Security• Apache Ranger Integration• Apache Sentry Integration• Data Encryption• Query Auditing

• Support• 24x7 Support SLA from the Presto

Experts• Long Term Presto Version Support• Hot fixes and Security Patches• Access to Customer Success team of Data

Architects• Starburst & Presto Roadmap Influence

Overview

Key TakeawaysK8S

Starburst Presto Kubernetes solution provides the data architect the most deployment flexibility for cloud, multi-cloud, hybrid-cloud, and on-premises environments. Presto runs wherever Kubernetes runs.

Deployment Option What to Sell

•

GCP

Azure

AWS

On Prem

Starburst Enterprise with Kubernetes (on GKE)

Starburst Enterprise with Kubernetes (on AKS)

Starburst Enterprise via AMI/CFT

Starburst Enterprise with Marketplace (via AMI/CFT)

Starburst Enterprise with Kubernetes (on EKS)

Starburst Enterprise on bare metal

Starburst Enterprise on VMs

Starburst Enterprise with Kubernetes

Starburst Presto on Kubernetes

Starburst Presto Kubernetes Operator allows you to easily deploy and manage Presto on Kubernetes

• Google Kubernetes Engine (GKE)• Amazon Elastic Container Service for Kubernetes (EKS)• Azure Kubernetes Service (AKS)• RedHat OpenShift Container Platform (In Certification Process)

7

Why Kubernetes?

8

https://kubernetes.io/docs/concepts/overview/what-is-kubernetes/

Concepts: K8s Cluster• K8s cluster is made up of nodes• Adding nodes to the cluster adds CPU/Memory available• User interact with Kubernetes cluster API, and not the nodes directly• Kubernetes handles where your program runs

9

Concepts: K8s Pod

• K8s does not run containers. It runs Pods which contain the containers.• Containers in the pods share the same resources and network• Containers in the same pod can communicate with each other as if on

the same machine (i.e. localhost)

10

16128 GB

Presto WorkerPod

Presto WorkerPod

Starburst Presto on K8s Architecture

11

Presto CoordinatorPod

Presto WorkerPod

Horizontal Pod Autoscaler (HPA)

Presto OperatorK8s Operator

PrestoService

Hive Metastore ServicePod

Config Properties:connection-url=<pgsql_url>connection-password=<password>connection-user=<sb-user>RDS=PostgreSQL

Hadoop / Hive

RDBMS

What is a Kubernetes Operator?

• Deploy non-trivial application on top of k8s• Introduced by CoreOS (2016)• Another layer of abstraction used to maintain state and expand the

types of applications that can run on K8s. • Focus on business logic. Domain Knowledge as code.• Reduce complexity and boilerplate code• Pattern for building Kubernetes native applications. Runs as a

container.https://github.com/operator-framework

What Does the Presto Kubernetes Operator Do?

• Autoconfiguration of Presto cluster• Coordinator High Availability using liveliness probes• Presto Worker Autoscaling• Graceful Scale down

• Operator Metering (coming soon)• Enable usage reporting for operators and resources with K8s• Do reports for showing “chargeback”

Demo

Questions?