whatap labs introduction to infrastructure monitoring
TRANSCRIPT
- -
Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc. Company Specializing in Cloud Monitoring Service
WhaTap Labs
Introduction to
Infrastructure
Monitoring
2017.11
WhaTap Labs Inc.
Table of
Contents
Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
I. Company Overview
II. Business Areas
III. Product Lineup
IV. Our Uniqueness
V. Main Functions of Infrastructure
Monitoring
VI. Main Clients
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Company Overview
WhaTap Labs is an IT monitoring company established in July 2015. It launched the server monitoring service (SMS) in December 2015
and, since then, it has widened the scope of monitoring areas by launching services such as JAVA, Node.js, PHP, Python Application
Monitoring and Infrastructure Monitoring.
The best performance analysis experts in Korea gathered to operate cloud-based monitoring service that goes beyond the limitations of
installation-type monitoring service.
2015.07 Founded WhaTap Labs Inc.
2015.12 Launched SMS monitoring service.
2016.12 Selected as one of the 300 prospective ICT companies.
2017.04 Launched the Node.js Application Monitoring service.
2016.11
2017.08 Launched the Infrastructure Monitoringservice.
Launched the PHP/Python Application Monitoring beta service.
Launched Java Application Monitoring service.
Received the 2016 K-Global DB-Stars grand prize.
Certified for its cloud service.
2017.02 Certified for GS.
2017.09 Launched the PHP Application Monitoring service.
2017.11 Launched the Python Application Monitoring service.
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Business Areas
WhaTap Labs Co focuses on monitoring services and has been recognized for its superiority by solving, with its excellent monitoring
technology, the problems that the existing monitoring products could not solve.
In 2016, the company received quality certification for its cloud service from Korea Association of Cloud Industry and currently operates
public cloud monitoring service. It can also implement its commercial solutions, which are currently under operation, in the client's
infrastructure.
Performance Management
Consulting
Service-type Monitoring Installation-type Monitoring
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Product Overview
WhaTap is a service monitoring the performance of infrastructure (server) systems and JAVA, Node.js, PHP, and Python applications.
In the cloud service environment, the complexity of servers tends to increase. Often, a mixture of applications developed in multiple languages are
used for the service.
To successfully cope with such characteristics, our product lineup is composed of infrastructure monitoring and application monitoring for different
languages. The two products are designed based on the same architecture.
The Same Architecture
Application monitoring that
allows you to assess the
transactions at the code level
at a glance
Infrastructure monitoring that
allows you to accurately
determine the resource usage
at the time of each process.
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Infrastructure & Application
WhaTap provides two different services depending on the lifecycle of the services. It provides application monitoring service for service
development, testing and performance check for launching the service, and infrastructure monitoring service for managing the service
at the stage of service stabilization.
In the development and
verification stages,
application monitoring is
required to fix the problems
at the service ends such as
code errors and slow
queries.
When the service becomes
stable, infrastructure
monitoring is required as the
monitoring of memory and
CPU becomes more urgent
than the problems at the
service end.
Verification
Stage
Stabilization
Stage
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Platforms Supported
Application Monitoring manages the performance of JAVA, NODE.JS, PHP and PYTHON applications.
Infrastructure Monitoring supports the monitoring of various cloud server environments as well as the traditional physical server environment.
Agent
• Operating Systems
‐ HP.UX 11.x 32bit, 64bit, Itanium 64bit
‐ Oracle Solaris 2.8, 2.9, 10, 11 32bit, 64bit,
x86
‐ Intel Linux 32bit, Redhat Itanium 64bit
‐ Microsoft Windows 2000, XP, 2003, 2008,
7, 8
‐ Every OS that can be installed with jdk1.6
• Application Server
‐ Oracle WebLogic 9.x, 10.x, 11.x,
12.x
‐ Tmaxsoft JEUS 6.x, 7.x
‐ SUN Application Server 8.x, 9.x
‐ Fujitsu Interstage 5.x, 6.x, 7.x
‐ Hitachi Cosminexus 7.x, 8.x, 9.x
‐ Apache Jakarta Tomcat 5.x, 6.x, 7.x, 8.x
‐ Caucho Technology Resin 3.x, 4.x
‐ RedHat JBoss Application Server 6.x, 7.x
‐ GlassFish 3.x
Java
Operating Systems
‐ Supports all environments that can run
nodejs such as windows, mac (osx), linux,
ubuntu, centos, etc.
Web server
‐ All frameworks that use the basic node
module such as express.js, hapi.js,
Mean.js, Koa.js, etc.
Nodejs version
‐ 0.1.12 or higher.
Database
‐ Mysql, mssql, MongoDB, redis, etc.
Node.js
Operating Systems
‐ Centos/Redhat 6.x (64bit) or higher.
‐ Debian/Ubuntu 12.04 (64bit) or higher.
Web server
‐ Apache and PHP-FPM (Nginx)
PHP version
‐ Operates as a PHP extension module.
‐ 5.2, 5.3, 5.4, 5.5, 5.6, 7.0, 7.1, zts (Zend
Thread Safe) supported
Library
‐ Mysql, Mysqli, PDO, cURL
PHP
Operating Systems
‐ Redhat/CentOS 6.x (64bit) or higher.
‐ Debian/Ubuntu 12.04 (64bit) or higher.
Application
‐ Django, bottle, cherrypy, flask,
tornado
Python version
‐ 2.7 & 3.3+
Libraries supported
‐ External call: httplib, requests, urllib
‐ Database: mysql, postgresql
Python
Operating Systems
‐ Windows
‐ Windows Server 2008 R2
Windows XP version or higher
‐ Cent OS / RedHat
‐ Supports Amazon AMI Linux as well as
CentOS(5,6,7) and RedHat.
‐ Ubuntu / Debian
‐ Supports Ubuntu (12.0.4 or higher) and
Debian (6.0 or higher).
Infrastructure
Server
• JDK: Oracle JDK 1.7 required.
• Need to adjust the OS's file descriptor settings. (Higher file I/O is
required.)
• OS: Ubuntu/CentOs stabilization version.
• CPU: 4 cores or higher (minimum 2 cores)
• Memory: 16 GB or more (minimum 8 GB)
• Disk: 200 GB or more
Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Our Uniqueness
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
WhaTap Monitoring Structure
WhaTap monitoring solution is composed of agents and monitoring servers and data is encrypted for security between agents and servers.
Application Monitoring and Infrastructure Monitoring classify agents according to the platform, but one collection server manages the data.
Server Description
Proxy
• Agent-linked server
• It receives the user data and encrypts and
sends it to the YARD.
Yard
• Data collection server
• It collects the data from the proxy server
and scales the data according to the data
capacity.
Web Front
• Web Service Server
• It is a server that users access, and
multiple users (administrator, developer,
and business manager) can access it at
the same time.
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Considering Cloud Service
The basic goal of WhaTap monitoring service is to share the resources (both labor and material). For the existing product, you must implement
additional collection servers and web screens for each monitoring target.
However, WhaTap monitoring service allows you to share the collection server but protect independence of each service at the same time.
Competitors’ installation-type product WhaTap cloud monitorin
Data Center/Cloud Data Center/Cloud
Collection
server
Data Center/Cloud
Collection
server
Collection
server
Collection
server
Collection
server
Developer/Operator Developer/Operator Developer/Operator Developer/Operator Developer/Operator
Integrated
monitoring server
Developer/Operator
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Support for Integrated Monitoring of Multiple Regions
When multiple zones or regions are created, only the collection server is installed. And on the single monitoring screen, you can monitor multiple
regions at the same time.
You can monitor affiliates on the same screen.
Collection server
Collection server
Collection server
Collection server
Collection server
Collection server
Collection server
Developer/Operator
Developer/Operator
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Support for Integrated Management of Multiple Users (Multiple Tenants)
When you monitor multiple companies' systems, it is impossible for one administrator to comprehensively manage the
permissions of every user.
The management of multiple users should go beyond simple permission management and reach the level of tenant
management.
In the multi-tenant environment, even a top-level administrator should not view the individual system parameters.
WhaTap Cloud Monitoring System
Org. A/Company user Org. B/Company user Org. C/Company user Org. D/Company user
Server A to C Server D to F Server G to I Server Y to ZSuperuser Superuser Superuser Superuser
Service Administrator
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Scalable and Stable Collection Server Architecture
To cover increasing number of managed (monitored) servers, the monitoring server should have its own internal scalability.
To guarantee data stability, you must support the redundancy and data recovery functions.
• Yard: Data storage
• Journal: Duplicated data backup
Collection Server
Redundancy
Duplication
Duplication
Journal
Master-1
Master-2
Journal
Journal
Journal
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Using a Multi-index File for Statistical Processing
By processing a large amount statistics using file data, you can monitor a large-scale system in the distributed architecture.
Agent 1
Agent 2
Agent 3
Real-time
Performance
Performance
Statistics
Implementation of File-based Multi-index Structure
Monitoring Service
Index 2 Data 2
Index 1 Data 1
Index 3 Data 3
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Data Archiving to Handle a Large Amount of Data
WhaTap uses its archiving technology to structure user access data, transactions, resources and tuning data and group them as one
structured file to provide performance incomparable to other APM services that use RDB or NoSQL.
WhaTap Archiving
Technology
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Data Encryption
Agents and servers use binary-type communication protocols. In addition, they selectively encrypt data to guarantee data security and reduce the
burden of encryption. The monitored server must open the firewall for the main address of the region.
Developer/General Manager
File Update
The length of AES encryption
key varies depending on the
agent settings.
Development Manager/Business Manager
Agents and servers use binary-
type communication protocols.
They selectively encrypt data to
guarantee data security and
reduce the burden of encryption.
The monitoring target server must
open the firewall for the main
address of region.
SQL Parameter Collection/Encryption
APM Management Operator
Settings
Enter the parameter encryption value displayed on
the console after installing the agent.
A separate encryption key is
provided for parameter monitoring.
It is not possible to check the key
unless it is a console (server ssh)
access.
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Installation Method That Does Not Require a Restart
Application Monitoring provides an installation method that can be applied without restarting the application server for failure analysis.
Infrastructure Agent does not require system restart when it is installed or updated as the external library is not used.
attach.sh
Tracer
Setup
Monitoring
Application Monitoring Attachment Installation Infrastructure Monitoring Installation
Infra agent
Process
Monitoring
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Provision of Mobile Application
WhaTap not only supports desktop computers but also is specialized for mobile devices. So you can easily perform monitoring anytime
anywhere by using an iPhone/iPad or Android phone.
WhaTap's dedicated mobile app provides the following functions: Push notification, data usage minimization, battery usage
minimization, and UI/UX optimized for mobile devices.
[Desktop]
Web
Supports Chrome, Firefox, and Internet Explorer 9 or higher.
[Mobile]
Android (Phone, Tablet)
Supports various types of mobile devices based on Android OS
4.0.3 or higher.
iOS (iPhone, iPad)
Supports various mobile devices with iOS 8.0 or higher.
Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Main Functions of Infrastructure Monitoring
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Main Functions
Infrastructure Monitoring provides the function to monitor transactions in real time and analyze them at the designated time. For convenient
operation, the report function has been improved and an operator is allowed to select the notification method that he/she wants.
• Collects data at a 5-sec. interval.
• Monitors all processes.
• Collects custom indice.
• Focuses on collection of the cloud's vulnerable indice.
(Disk IO)
Performance Management
of Cloud Server
• Supports every platform inside and outside Korea.
• Automatic registration and cancellation in the case of
automatic scaling
• Serverless service monitoring
• Supports containers (dockers).
Support of Cloud Platform
• Integrated dashboard
• Real-time performance analysis of more than 1000
servers
• Access control for different server projects
Support of Monitoring Business
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Dashboard – Compound Eye View
You can view the availability of several dozens of servers and services at a glance.
One Eye
CPU usage, memory usage, disk usage, network data
received, network data transmitted.
Especially, the network usage option allows you to check the
amount of received/transmitted data at a glance and also find
out whether external attacks such as DDOS have occurred in
multiple servers.
Memory
Disk Usage
CPU
Rx
Tx
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Dashboard - Server List View
You can see the performance status of all servers at a glance, including all managed targets and collection items. You can also select a specific
server to compare it with others.
An operator can set the necessary indice to comprehensively assess the status in different situations.
Performance Status of All Managed Targets
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Dashboard –Availability Graph
In the infrastructure environment where cloud servers and physical servers are mixed with each other, you can identify the servers prone to problems
at a glance.
You can check the availability of all servers on a daily, weekly or monthly basis.
Availability Dashboard Using the Cloud API to Support Seamless Scaling
Dashboard
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Performance Trend Analysis
You can select a specific node to check the trend graphs on a minute/hour/weekly/daily/monthly basis.
Support of trend graph for the monitored items (transactions, etc.) on a
minute/hour/daily/weekly/monthly basis.
30 min 1 hr 3 hr 12 hr 24 hr 7 days 30 days
Server Lists
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Analysis of OS Process Performance
You can identify the problems of the resources and analyze them down to the process level at the sever.
Server list
Server resource monitoring Process monitoring
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Expansion Pack Monitoring
Customized Data Collection• Addition of third-party data collection scripts (they can be
developed by users)
• Collecting random time series float data and displaying
them in a chart
• Collecting application status variables
• Designation of a threshold for notifications
• Saving the OLTP results to monitor business data
Remote Monitoring without
Installing an Agent• Monitoring of legacy network devices
• Clustered No SQL
• IaaS/PaaS Platform Health Data Gathering
Expansion Pack Monitoring
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Integrated Failure Management.
You can view failures and alerts occurring in the managed target on a time basis and search for them by server names.
Server resource monitoring
Additional Agent
FunctionsRemark
Time of
occurrenceTime of failure/alert
Risk levelDisplayed as ‘Danger’ or
‘Warning’
Server name Server name
Description
Description of
notifications based on
the settings set in the
notification policy
Snapshot
Snapshot information
about CPU, memory,
disk and network for
notifications generated
Current status
Server condition at the
time of a notification
occurrence
Processing detailsNotification processing
details
Alert Lists
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Integrated Failure Management.
You can use the event notification function for each failure type (SMS, email, and pop-up) to share the details of failure occurrences. But, SMS or email requires
additional development into a structure linked to the client system. It provides the class of a failure for different managed targets and the threshold setting screen.
You can also apply the same rule to multiple servers.
* For the level of notifications, “Warning” and “Fatal” are provided. Also, a function is provided to set the duration of status change for each threshold.
* Suppression of each failure event can be enabled or disabled.
Target of Event
Notifications
Restart
Lost communication with
the collection server
File log keyword detection
Server Restart Notification
Network
Fatal Warning
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Notification Settings
When a notification is sent for a server threshold situation, you can receive it via your email / SMS / mobile apps.
You can set the notification language, whether to receive notifications, and notification receipt time and day for each user.
Person in Charge
Day shift Weekday 9 AM to 9 PM
Night shift Weekday 9 PM to 9 AM
Weekend shift Saturday, Sunday
Team leader Only send an email.
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Notification Settings for Individual Processes
Infrastructure Monitoring allows you to set notifications for each process, which is its best merit.
You can set the max./min. thresholds for the number of processes, CPU usage and memory usage for a specific process.
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Warning Handling Process
Infrastructure Monitoring notifications are sent via SMS/email to broadcast the condition of the server and induce the response of the person in charge.
If a notification has no record of response details, notifications are sent immediately, after 10 minutes, after 1 hour and after one day to make sure that the person in
charge does not forget responding to the notification.
When a notification is generated, it is sent to the group of persons in charge and the response details are shared among them to facilitate the collaboration among
them for handling the problem.
When the error state persists
Immediately After 10 min After 1 hr
Error state cleared
A notification is sent
immediately when the error
state is cleared.
Initial
notification
Initial
notification
Initial
notification
Repeated
notification
Repeated
notification
Repeated
notification
Group of persons in charge
Group of persons in charge
Terminate an alert after
checking the problem.
Terminate an alert after
checking the problem.
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Warning Notification and Its Recognition
When the equipment has a failure or generates a notification, the person in charge recognizes it and use the acknowledge (processing details)
function to prevent any more notifications from being generated for the warning acknowledged.
Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Main Clients
- -Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Main Clients of Infrastructure Monitoring
At present, about 1,000 clients from around the world use Infrastructure Monitoring 15,000VM.
The copyright of the document belongs to WhaTap Labs Inc.
The document should not be reproduced, distributed or changed in any form without written consent from WhaTap Labs Inc.
Copyright © 2017 WhaTap – Developed by WhaTap Labs Inc.
Thank you!Thank you.