alpha presentation kubernetes cluster inspection tool · •visualize pod to pod communication...

9

From Students… …to Professionals The Capstone Experience Alpha Presentation Kubernetes Cluster Inspection Tool Department of Computer Science and Engineering Michigan State University Spring 2019 Team Google David Ackley Guillermo Jimenez Linghao Ji Haylee Quarles Casey Schneider Ben Whitelaw

Upload: others

Post on 29-Sep-2020

6 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Alpha Presentation Kubernetes Cluster Inspection Tool · •Visualize Pod to Pod Communication •Stackdriver Logging API and Front end visualization •Meet with Kubernetes active

From Students…

…to Professionals

The Capstone Experience

Alpha PresentationKubernetes Cluster Inspection Tool

Department of Computer Science and EngineeringMichigan State University

Spring 2019

Team GoogleDavid Ackley

Guillermo JimenezLinghao Ji

Haylee QuarlesCasey Schneider

Ben Whitelaw

http://www.capstone.cse.msu.edu/

Page 2: Alpha Presentation Kubernetes Cluster Inspection Tool · •Visualize Pod to Pod Communication •Stackdriver Logging API and Front end visualization •Meet with Kubernetes active

Project Overview

• Provide Robust Inspection Tool of Kubernetes Cluster

▪ Both Current and Historical State

• Gather All Cluster Data into a Single Interactive View

▪ Provide Health, Performance, and Resource Changes

▪ Ingest with Native, Kubernetes Stackdiver Agent

▪ Trace Lifecycle of Nodes, Pods, and Containers

• Implement Easily on Any GCP Kubernetes Cluster

The Capstone Experience Team Google Alpha Presentation 5

Page 3: Alpha Presentation Kubernetes Cluster Inspection Tool · •Visualize Pod to Pod Communication •Stackdriver Logging API and Front end visualization •Meet with Kubernetes active

System Architecture

The Capstone Experience Team Google Alpha Presentation 6

Page 4: Alpha Presentation Kubernetes Cluster Inspection Tool · •Visualize Pod to Pod Communication •Stackdriver Logging API and Front end visualization •Meet with Kubernetes active

Event Logs

The Capstone Experience Team Google Alpha Presentation 9

Page 5: Alpha Presentation Kubernetes Cluster Inspection Tool · •Visualize Pod to Pod Communication •Stackdriver Logging API and Front end visualization •Meet with Kubernetes active

Node Monitoring

The Capstone Experience Team Google Alpha Presentation 7

Page 6: Alpha Presentation Kubernetes Cluster Inspection Tool · •Visualize Pod to Pod Communication •Stackdriver Logging API and Front end visualization •Meet with Kubernetes active

Cluster Playback

The Capstone Experience Team Google Alpha Presentation 10

Page 7: Alpha Presentation Kubernetes Cluster Inspection Tool · •Visualize Pod to Pod Communication •Stackdriver Logging API and Front end visualization •Meet with Kubernetes active

Pod to Pod Communication Logs

The Capstone Experience Team Google Alpha Presentation 8

Page 8: Alpha Presentation Kubernetes Cluster Inspection Tool · •Visualize Pod to Pod Communication •Stackdriver Logging API and Front end visualization •Meet with Kubernetes active

What’s left to do?

• Visualize Pod to Pod Communication

• Stackdriver Logging API and Front end visualization

• Meet with Kubernetes active users to get Visualization Tool feedback

• Get long term events that are not stored in Kubernetes

The Capstone Experience Team Google Alpha Presentation 11

Page 9: Alpha Presentation Kubernetes Cluster Inspection Tool · •Visualize Pod to Pod Communication •Stackdriver Logging API and Front end visualization •Meet with Kubernetes active

Questions?

The Capstone Experience Team Google Alpha Presentation 12

?

? ??

?

?

?

?

?

CI/CD Pipeline mit Gitlab CI und Kubernetes · API Kubernetes Deployment 20 Kubernetes Gitlab CI ns: todo-app-staging Pod v1.1 Pod v1.1 Pod v1.2 Deploy Deploy v1.2 into staging ment

Monitoring with Stackdriver

Go containers? Go serverless? - FOSDEM · Go containers? Go serverless? ... containerized microservices (Kubernetes) serverless (AWS Lambda) unit of deployment pod function build

Developing Your Closed Point of Dispensing (POD ......POD 1 POD 2 POD 3 POD 4 POD 5 POD 6 POD 7 POD 1 POD 2 POD 3 POD 4 POD 5 POD 6 POD 7 Example of a Unified Command Structure Example

Airflow on Kubernetes: Containerizing your Workflows · Golang templating language to templatize manifests Automate deployment of Airflow with Helm using Terraform Pod Pod Pod Pod

Infrastructure Design for Kubernetes · Kubernetes 1.9 Kubernetes 1.10 Kubernetes 1.11 Kubernetes 1.12 December 2017 March 2018 June 2018 September 2018 Kubernetes 1.13 December 2018

Kubernetes Administration Certification€¦ · 2. Basics of Kubernetes • Define Kubernetes • Meaning of Kubernetes • Adoption • Project Governance • Labs 3. Installation

Kubernetes the Very Hard Way - USENIX...a.Kubernetes and Certificates b.Exceptions? c.Impact of Certificate Rotation 3.Efficient networking a.Giving pod IPs and routing them b.Accessing

Kubernetes: What's it do? - Red Hateparis/kubernetes/kube.pdf · Kubernetes: What's it do? Presenter Eric Paris Red Hat. 2 Eric Paris Agenda What is Kubernetes Kubernetes Primitives

Greenplum on PKS - 数字化三部曲 · kubelet kube-proxy docker Pod Kubernetes 101 . Greenplum on Kubernetes Node Pod mirror kubelet kube-proxy docker 20 Greenplum Service

Kubernetes Autoscaling on Azure - LF Asia, LLC · Autoscalingin Kubernetes • Horizontal Pod autoscaler(HPA) – Scale number of Pods • Vertical Pod autoscaler(VPA) – Scale resources

Kubernetes Patterns Kubernetes Patterns

You can find the most up-to-date technical documentation ...€¦ · Tanzu Kubernetes clusters implement Calico for pod-to-pod networking by default. Tanzu Kubernetes Cluster Plans

Application modernization and the decoupling of ... · Kubernetes introduced pods to help with this kind of decoupling. A pod is a group A pod is a group of containers that are co-scheduled

Instaclustr Cassandra and Kubernetes Presention...• K8s (industry approved abbreviation for Kubernetes) • Pod - Represents a running process on your cluster. • Controller - A

ConfD AND KUBERNETES - Tail-f Systems ConfDandKubernetes... · Pod. Every container must run in a Pod, and the Pod becomes the basic deployable unit in Kubernetes. In our ConfD on

Secure Inference at Scale in Kubernetes* Container …...For stateful sessions, it is beneficial to route the sequential calls from a client to the same Kubernetes pod back end instance

Kubernetes Boston — Custom High Availability of Kubernetes

CNA3045BU What’s New Containers on SDDC or distribution · for the cluster components themselves (masters and etcd nodes). Scaling. Kubernetes clusters handle scaling the pod/service

NSX-T Container Plug-in (NCP) - VMware Docs Home · PDF fileNSX-T Container Plug-in for Kubernetes - Installation and Administration Guide 4 ... Key in the NCP Pod 23 ... in for Kubernetes

Docker All The Things OpenStack Services and Atomic and Kubernetes · 2014-11-05 · Docker kube-scheduler Glance-API Registry 1. Quick Tour of Kubernetes 2. Deploying a Pod/Service

Kubernetes on Openstack - HPC Advisory Council · neutron router VM aka k8s node VM aka k8s node Default gateway is the neutron router Default gateway is the neutron router Pod Pod

kubernetes - Direct DevOps from QualityThought · STEPS TO CREATE PODS Create a Sample Pod i.e file with pod.yml apiVersion: v1 kind: Pod metadata: name: hello-pod spec: containers:

KUBERNETES-USERGlusterFS / NFS Ceph iSCSI 7.2 KUBERNETES : VOLUMES On déclare d'abord le volume et on l'affecte à un service : apiVersion: v1 kind: Pod metadata: name: redis spec:

Continuous Delivery the hard way with Kubernetes€¦ · Docker container image, contains your application code in an isolated environment. Pod A set of containers, sharing network

Join us for KubeCon + CloudNativeCon Virtual€¦ · Kubernetes CNI Integrating Project Antrea and NVIDIA Mellanox ConnectX SmartNICS ... Plumbing eth0 (network interface) into Pod

Lessons learned building Kubernetes controllers · g’day. Contour A Kubernetes Ingress Controller. Connaissez-vous Kubernetes? Kubernetes in one slide • Replicated data store;

Table of Contents · The Kubernetes pod was deployed using upstream Kubernetes version 1.15.1. What is kubeadm? kubeadm is a tool included in every Kubernetes release that helps users

Kubernetes on NVIDIA DGX ServersNot to be confused with the hardware notion. A Kubernetes pod is the smallest atomic Kubernetes object and represents a set of running containers on

Understanding ONF’s Curated Portfolio of Projects...OSAM-Local EMS/NMS-adaptor OSAM-Central SEBA POD All control software deployed as containers on compute nodes using Kubernetes

Kubernetes Data Collector - NetApp Documentation · Kubernetes Data Collector Cloud Insights uses this data collector to gather Kubernetes Pod, Node, and Container metrics. Installation

Kubernetes Architecture and Introduction – Paris Kubernetes Meetup

CNA3045BE What’s New Containers on SDDC or distribution · Kubernetes clusters handle scaling the pod/service within the Nodes, but doesn’t provide a mechanism to scale Masters,

KUBERNETES PATTERNS...One shot action before Pod starts Needs to be idempotent Has own resource requirements Pod app containers init containers Container Container Container Container

Drone Mapping: Hyperscaling a service with Kubernetes on ARMs3.amazonaws.com/connect.linaro.org/bud17... · Kubernetes v1.5 Weave Pod Networking NFS Server providing persistent storage