whatap labs introduction to infrastructure monitoring

35
-- Copyright © 2017 WhaTap Developed by WhaTap Labs Inc. Company Specializing in Cloud Monitoring Service WhaTap Labs Introduction to Infrastructure Monitoring 2017.11 WhaTap Labs Inc.

Upload: others

Post on 22-Apr-2022

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: WhaTap Labs Introduction to Infrastructure Monitoring

- -

Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc. Company Specializing in Cloud Monitoring Service

WhaTap Labs

Introduction to

Infrastructure

Monitoring

2017.11

WhaTap Labs Inc.

Page 2: WhaTap Labs Introduction to Infrastructure Monitoring

Table of

Contents

Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

I. Company Overview

II. Business Areas

III. Product Lineup

IV. Our Uniqueness

V. Main Functions of Infrastructure

Monitoring

VI. Main Clients

Page 3: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Company Overview

WhaTap Labs is an IT monitoring company established in July 2015. It launched the server monitoring service (SMS) in December 2015

and, since then, it has widened the scope of monitoring areas by launching services such as JAVA, Node.js, PHP, Python Application

Monitoring and Infrastructure Monitoring.

The best performance analysis experts in Korea gathered to operate cloud-based monitoring service that goes beyond the limitations of

installation-type monitoring service.

2015.07 Founded WhaTap Labs Inc.

2015.12 Launched SMS monitoring service.

2016.12 Selected as one of the 300 prospective ICT companies.

2017.04 Launched the Node.js Application Monitoring service.

2016.11

2017.08 Launched the Infrastructure Monitoringservice.

Launched the PHP/Python Application Monitoring beta service.

Launched Java Application Monitoring service.

Received the 2016 K-Global DB-Stars grand prize.

Certified for its cloud service.

2017.02 Certified for GS.

2017.09 Launched the PHP Application Monitoring service.

2017.11 Launched the Python Application Monitoring service.

Page 4: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Business Areas

WhaTap Labs Co focuses on monitoring services and has been recognized for its superiority by solving, with its excellent monitoring

technology, the problems that the existing monitoring products could not solve.

In 2016, the company received quality certification for its cloud service from Korea Association of Cloud Industry and currently operates

public cloud monitoring service. It can also implement its commercial solutions, which are currently under operation, in the client's

infrastructure.

Performance Management

Consulting

Service-type Monitoring Installation-type Monitoring

Page 5: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Product Overview

WhaTap is a service monitoring the performance of infrastructure (server) systems and JAVA, Node.js, PHP, and Python applications.

In the cloud service environment, the complexity of servers tends to increase. Often, a mixture of applications developed in multiple languages are

used for the service.

To successfully cope with such characteristics, our product lineup is composed of infrastructure monitoring and application monitoring for different

languages. The two products are designed based on the same architecture.

The Same Architecture

Application monitoring that

allows you to assess the

transactions at the code level

at a glance

Infrastructure monitoring that

allows you to accurately

determine the resource usage

at the time of each process.

Page 6: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Infrastructure & Application

WhaTap provides two different services depending on the lifecycle of the services. It provides application monitoring service for service

development, testing and performance check for launching the service, and infrastructure monitoring service for managing the service

at the stage of service stabilization.

In the development and

verification stages,

application monitoring is

required to fix the problems

at the service ends such as

code errors and slow

queries.

When the service becomes

stable, infrastructure

monitoring is required as the

monitoring of memory and

CPU becomes more urgent

than the problems at the

service end.

Verification

Stage

Stabilization

Stage

Page 7: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Platforms Supported

Application Monitoring manages the performance of JAVA, NODE.JS, PHP and PYTHON applications.

Infrastructure Monitoring supports the monitoring of various cloud server environments as well as the traditional physical server environment.

Agent

• Operating Systems

‐ HP.UX 11.x 32bit, 64bit, Itanium 64bit

‐ Oracle Solaris 2.8, 2.9, 10, 11 32bit, 64bit,

x86

‐ Intel Linux 32bit, Redhat Itanium 64bit

‐ Microsoft Windows 2000, XP, 2003, 2008,

7, 8

‐ Every OS that can be installed with jdk1.6

• Application Server

‐ Oracle WebLogic 9.x, 10.x, 11.x,

12.x

‐ Tmaxsoft JEUS 6.x, 7.x

‐ SUN Application Server 8.x, 9.x

‐ Fujitsu Interstage 5.x, 6.x, 7.x

‐ Hitachi Cosminexus 7.x, 8.x, 9.x

‐ Apache Jakarta Tomcat 5.x, 6.x, 7.x, 8.x

‐ Caucho Technology Resin 3.x, 4.x

‐ RedHat JBoss Application Server 6.x, 7.x

‐ GlassFish 3.x

Java

Operating Systems

‐ Supports all environments that can run

nodejs such as windows, mac (osx), linux,

ubuntu, centos, etc.

Web server

‐ All frameworks that use the basic node

module such as express.js, hapi.js,

Mean.js, Koa.js, etc.

Nodejs version

‐ 0.1.12 or higher.

Database

‐ Mysql, mssql, MongoDB, redis, etc.

Node.js

Operating Systems

‐ Centos/Redhat 6.x (64bit) or higher.

‐ Debian/Ubuntu 12.04 (64bit) or higher.

Web server

‐ Apache and PHP-FPM (Nginx)

PHP version

‐ Operates as a PHP extension module.

‐ 5.2, 5.3, 5.4, 5.5, 5.6, 7.0, 7.1, zts (Zend

Thread Safe) supported

Library

‐ Mysql, Mysqli, PDO, cURL

PHP

Operating Systems

‐ Redhat/CentOS 6.x (64bit) or higher.

‐ Debian/Ubuntu 12.04 (64bit) or higher.

Application

‐ Django, bottle, cherrypy, flask,

tornado

Python version

‐ 2.7 & 3.3+

Libraries supported

‐ External call: httplib, requests, urllib

‐ Database: mysql, postgresql

Python

Operating Systems

‐ Windows

‐ Windows Server 2008 R2

Windows XP version or higher

‐ Cent OS / RedHat

‐ Supports Amazon AMI Linux as well as

CentOS(5,6,7) and RedHat.

‐ Ubuntu / Debian

‐ Supports Ubuntu (12.0.4 or higher) and

Debian (6.0 or higher).

Infrastructure

Server

• JDK: Oracle JDK 1.7 required.

• Need to adjust the OS's file descriptor settings. (Higher file I/O is

required.)

• OS: Ubuntu/CentOs stabilization version.

• CPU: 4 cores or higher (minimum 2 cores)

• Memory: 16 GB or more (minimum 8 GB)

• Disk: 200 GB or more

Page 8: WhaTap Labs Introduction to Infrastructure Monitoring

Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Our Uniqueness

Page 9: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

WhaTap Monitoring Structure

WhaTap monitoring solution is composed of agents and monitoring servers and data is encrypted for security between agents and servers.

Application Monitoring and Infrastructure Monitoring classify agents according to the platform, but one collection server manages the data.

Server Description

Proxy

• Agent-linked server

• It receives the user data and encrypts and

sends it to the YARD.

Yard

• Data collection server

• It collects the data from the proxy server

and scales the data according to the data

capacity.

Web Front

• Web Service Server

• It is a server that users access, and

multiple users (administrator, developer,

and business manager) can access it at

the same time.

Page 10: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Considering Cloud Service

The basic goal of WhaTap monitoring service is to share the resources (both labor and material). For the existing product, you must implement

additional collection servers and web screens for each monitoring target.

However, WhaTap monitoring service allows you to share the collection server but protect independence of each service at the same time.

Competitors’ installation-type product WhaTap cloud monitorin

Data Center/Cloud Data Center/Cloud

Collection

server

Data Center/Cloud

Collection

server

Collection

server

Collection

server

Collection

server

Developer/Operator Developer/Operator Developer/Operator Developer/Operator Developer/Operator

Integrated

monitoring server

Developer/Operator

Page 11: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Support for Integrated Monitoring of Multiple Regions

When multiple zones or regions are created, only the collection server is installed. And on the single monitoring screen, you can monitor multiple

regions at the same time.

You can monitor affiliates on the same screen.

Collection server

Collection server

Collection server

Collection server

Collection server

Collection server

Collection server

Developer/Operator

Developer/Operator

Page 12: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Support for Integrated Management of Multiple Users (Multiple Tenants)

When you monitor multiple companies' systems, it is impossible for one administrator to comprehensively manage the

permissions of every user.

The management of multiple users should go beyond simple permission management and reach the level of tenant

management.

In the multi-tenant environment, even a top-level administrator should not view the individual system parameters.

WhaTap Cloud Monitoring System

Org. A/Company user Org. B/Company user Org. C/Company user Org. D/Company user

Server A to C Server D to F Server G to I Server Y to ZSuperuser Superuser Superuser Superuser

Service Administrator

Page 13: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Scalable and Stable Collection Server Architecture

To cover increasing number of managed (monitored) servers, the monitoring server should have its own internal scalability.

To guarantee data stability, you must support the redundancy and data recovery functions.

• Yard: Data storage

• Journal: Duplicated data backup

Collection Server

Redundancy

Duplication

Duplication

Journal

Master-1

Master-2

Journal

Journal

Journal

Page 14: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Using a Multi-index File for Statistical Processing

By processing a large amount statistics using file data, you can monitor a large-scale system in the distributed architecture.

Agent 1

Agent 2

Agent 3

Real-time

Performance

Performance

Statistics

Implementation of File-based Multi-index Structure

Monitoring Service

Index 2 Data 2

Index 1 Data 1

Index 3 Data 3

Page 15: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Data Archiving to Handle a Large Amount of Data

WhaTap uses its archiving technology to structure user access data, transactions, resources and tuning data and group them as one

structured file to provide performance incomparable to other APM services that use RDB or NoSQL.

WhaTap Archiving

Technology

Page 16: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Data Encryption

Agents and servers use binary-type communication protocols. In addition, they selectively encrypt data to guarantee data security and reduce the

burden of encryption. The monitored server must open the firewall for the main address of the region.

Developer/General Manager

File Update

The length of AES encryption

key varies depending on the

agent settings.

Development Manager/Business Manager

Agents and servers use binary-

type communication protocols.

They selectively encrypt data to

guarantee data security and

reduce the burden of encryption.

The monitoring target server must

open the firewall for the main

address of region.

SQL Parameter Collection/Encryption

APM Management Operator

Settings

Enter the parameter encryption value displayed on

the console after installing the agent.

A separate encryption key is

provided for parameter monitoring.

It is not possible to check the key

unless it is a console (server ssh)

access.

Page 17: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Installation Method That Does Not Require a Restart

Application Monitoring provides an installation method that can be applied without restarting the application server for failure analysis.

Infrastructure Agent does not require system restart when it is installed or updated as the external library is not used.

attach.sh

Tracer

Setup

Monitoring

Application Monitoring Attachment Installation Infrastructure Monitoring Installation

Infra agent

Process

Monitoring

Page 18: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Provision of Mobile Application

WhaTap not only supports desktop computers but also is specialized for mobile devices. So you can easily perform monitoring anytime

anywhere by using an iPhone/iPad or Android phone.

WhaTap's dedicated mobile app provides the following functions: Push notification, data usage minimization, battery usage

minimization, and UI/UX optimized for mobile devices.

[Desktop]

Web

Supports Chrome, Firefox, and Internet Explorer 9 or higher.

[Mobile]

Android (Phone, Tablet)

Supports various types of mobile devices based on Android OS

4.0.3 or higher.

iOS (iPhone, iPad)

Supports various mobile devices with iOS 8.0 or higher.

Page 19: WhaTap Labs Introduction to Infrastructure Monitoring

Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Main Functions of Infrastructure Monitoring

Page 20: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Main Functions

Infrastructure Monitoring provides the function to monitor transactions in real time and analyze them at the designated time. For convenient

operation, the report function has been improved and an operator is allowed to select the notification method that he/she wants.

• Collects data at a 5-sec. interval.

• Monitors all processes.

• Collects custom indice.

• Focuses on collection of the cloud's vulnerable indice.

(Disk IO)

Performance Management

of Cloud Server

• Supports every platform inside and outside Korea.

• Automatic registration and cancellation in the case of

automatic scaling

• Serverless service monitoring

• Supports containers (dockers).

Support of Cloud Platform

• Integrated dashboard

• Real-time performance analysis of more than 1000

servers

• Access control for different server projects

Support of Monitoring Business

Page 21: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Dashboard – Compound Eye View

You can view the availability of several dozens of servers and services at a glance.

One Eye

CPU usage, memory usage, disk usage, network data

received, network data transmitted.

Especially, the network usage option allows you to check the

amount of received/transmitted data at a glance and also find

out whether external attacks such as DDOS have occurred in

multiple servers.

Memory

Disk Usage

CPU

Rx

Tx

Page 22: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Dashboard - Server List View

You can see the performance status of all servers at a glance, including all managed targets and collection items. You can also select a specific

server to compare it with others.

An operator can set the necessary indice to comprehensively assess the status in different situations.

Performance Status of All Managed Targets

Page 23: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Dashboard –Availability Graph

In the infrastructure environment where cloud servers and physical servers are mixed with each other, you can identify the servers prone to problems

at a glance.

You can check the availability of all servers on a daily, weekly or monthly basis.

Availability Dashboard Using the Cloud API to Support Seamless Scaling

Dashboard

Page 24: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Performance Trend Analysis

You can select a specific node to check the trend graphs on a minute/hour/weekly/daily/monthly basis.

Support of trend graph for the monitored items (transactions, etc.) on a

minute/hour/daily/weekly/monthly basis.

30 min 1 hr 3 hr 12 hr 24 hr 7 days 30 days

Server Lists

Page 25: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Analysis of OS Process Performance

You can identify the problems of the resources and analyze them down to the process level at the sever.

Server list

Server resource monitoring Process monitoring

Page 26: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Expansion Pack Monitoring

Customized Data Collection• Addition of third-party data collection scripts (they can be

developed by users)

• Collecting random time series float data and displaying

them in a chart

• Collecting application status variables

• Designation of a threshold for notifications

• Saving the OLTP results to monitor business data

Remote Monitoring without

Installing an Agent• Monitoring of legacy network devices

• Clustered No SQL

• IaaS/PaaS Platform Health Data Gathering

Expansion Pack Monitoring

Page 27: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Integrated Failure Management.

You can view failures and alerts occurring in the managed target on a time basis and search for them by server names.

Server resource monitoring

Additional Agent

FunctionsRemark

Time of

occurrenceTime of failure/alert

Risk levelDisplayed as ‘Danger’ or

‘Warning’

Server name Server name

Description

Description of

notifications based on

the settings set in the

notification policy

Snapshot

Snapshot information

about CPU, memory,

disk and network for

notifications generated

Current status

Server condition at the

time of a notification

occurrence

Processing detailsNotification processing

details

Alert Lists

Page 28: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Integrated Failure Management.

You can use the event notification function for each failure type (SMS, email, and pop-up) to share the details of failure occurrences. But, SMS or email requires

additional development into a structure linked to the client system. It provides the class of a failure for different managed targets and the threshold setting screen.

You can also apply the same rule to multiple servers.

* For the level of notifications, “Warning” and “Fatal” are provided. Also, a function is provided to set the duration of status change for each threshold.

* Suppression of each failure event can be enabled or disabled.

Target of Event

Notifications

Restart

Lost communication with

the collection server

File log keyword detection

Server Restart Notification

Network

Fatal Warning

Page 29: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Notification Settings

When a notification is sent for a server threshold situation, you can receive it via your email / SMS / mobile apps.

You can set the notification language, whether to receive notifications, and notification receipt time and day for each user.

Person in Charge

Day shift Weekday 9 AM to 9 PM

Night shift Weekday 9 PM to 9 AM

Weekend shift Saturday, Sunday

Team leader Only send an email.

Page 30: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Notification Settings for Individual Processes

Infrastructure Monitoring allows you to set notifications for each process, which is its best merit.

You can set the max./min. thresholds for the number of processes, CPU usage and memory usage for a specific process.

Page 31: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Warning Handling Process

Infrastructure Monitoring notifications are sent via SMS/email to broadcast the condition of the server and induce the response of the person in charge.

If a notification has no record of response details, notifications are sent immediately, after 10 minutes, after 1 hour and after one day to make sure that the person in

charge does not forget responding to the notification.

When a notification is generated, it is sent to the group of persons in charge and the response details are shared among them to facilitate the collaboration among

them for handling the problem.

When the error state persists

Immediately After 10 min After 1 hr

Error state cleared

A notification is sent

immediately when the error

state is cleared.

Initial

notification

Initial

notification

Initial

notification

Repeated

notification

Repeated

notification

Repeated

notification

Group of persons in charge

Group of persons in charge

Terminate an alert after

checking the problem.

Terminate an alert after

checking the problem.

Page 32: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Warning Notification and Its Recognition

When the equipment has a failure or generates a notification, the person in charge recognizes it and use the acknowledge (processing details)

function to prevent any more notifications from being generated for the warning acknowledged.

Page 33: WhaTap Labs Introduction to Infrastructure Monitoring

Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Main Clients

Page 34: WhaTap Labs Introduction to Infrastructure Monitoring

- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Main Clients of Infrastructure Monitoring

At present, about 1,000 clients from around the world use Infrastructure Monitoring 15,000VM.

Page 35: WhaTap Labs Introduction to Infrastructure Monitoring

The copyright of the document belongs to WhaTap Labs Inc.

The document should not be reproduced, distributed or changed in any form without written consent from WhaTap Labs Inc.

Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.

Thank you!Thank you.