manegement plataform of a dtmb signal monitoring network · influxdb •time series database...

24
INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONES Orden “Carlos J. Finlay” Manegement Plataform of a DTMB signal monitoring network MSc. Rufino Cabrera Alvares rufino @lacetel.cu …and others authors from LACETEL-CUAJE November 6 th , 2019

Upload: others

Post on 03-Jun-2020

13 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Manegement Plataform of a DTMB

signal monitoring network

MSc. Rufino Cabrera Alvares

[email protected]

…and others authors from LACETEL-CUAJE

November 6th, 2019

Page 2: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Introduction (1/5)

COAXIAL CABLE

Some coverage issues

LACETEL developed a DTMB

monitorization tool based on

commercial STB

Page 3: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Introduction (2/5)

LACETEL developed a DTMB

monitorization tool based on

commercial STB

STB

Signal Level

SNR

BER

Time&Date Values191106-09:30 -77

191106-09:35 -73

191106-09:40 -72

191106-09:45 -75

USB Device

Page 4: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Introduction (3/5)

To develop a monitorization platform based on:

• Sensor connected to GPRS network

• Data base + web in order to storage and manage data

Sensor

GPRS

• Data base + web in order to storage and manage data

Page 5: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Introduction (4/5)

The web platform:

• Users Security&Manegement

• Data storage

• Graphical representation and data analysis

• Alerts issues

• Geography representation (NO INCLUDED YET)

Page 6: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Introduction (5/5)

The web design team:

• NO EXPERIENCE

• Then:

Simplify the web design…

…Application Performance Management (APM)

configuration

Page 7: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Management platform

Data Base Server

Sensors

Web Client

APK

APM Visual

NOT YET

Page 8: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

APM Systems: Main components

• Data Base.

• Agent.

• Visualization Panel and/or Dashboard.

• Alert Manager.

ELK

Elasticsearch (Database)

Logstash (Data Processor)

Kibana (Visual & Dashboard)

TICK

Telegraf (Agent)

InfluxDB (Database)

Chronograf (Agent)

Kapacitor (Visual & Dashboard)

Elasticsearch

InfluxDB

Page 9: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Data Base: Requirements

• Receive, storage y consult large volumes of data.

• Efficient real-time performance.

Time Series Data Bases (TSDB): optimized for storing and

service time series through associated pairs of time(s) and

value(s) in order to follow trend processing.

Page 10: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

InfluxDB

• Time Series Database (TSDB).

• Top one in TSDB ranking. Reference site: db-engines.com.

• High performance in order to receive large volumes of data.

• Efficient data compression.

• Configurable policies for data reduction and retention.

Page 11: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Line protocol

<measure>[,<tag-key>=<tag-value>...] <field-key>=<field-

value>[,<field2-key>=<field2-valor>...] [timestamp]

• <measure> string to identify the measurement.

• Similar to SQL-table structure.

• Indexed tags and no-indexed fields.

• Time stamp according to Unix nanosecond format.

Page 12: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Line protocol

FREQ 470MHz with BER = 0,05, SNR = 15 and Level = -77dBm

470user=lct,id=983211 BER=0.05,SNR=15,LVL=-77

1465839830100400200

ID 983211 FREQ 470MHz

T&D …

BER SNR LVL 0,05 15 -77

… 0,03 14 -75 … 0,04 15 -79

ID 543119 FREQ 470MHz

T&D …

BER SNR LVL 0,05 15 -77

… 0,03 14 -75 … 0,04 15 -79

¿? FREQ 470MHz … 617MHs…671MHz…

Page 13: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Agent: Telegraf

• Developed by InfluxData: High compatibility and integration with InfluxDB.

• Simple and easy to configure.

• Support for many input sources.

• Light installation, plugins extinction functionalities.

Page 14: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Visualization panel, dashboard and alerts management: Grafana

• Easy use and integration with different systems.

• Include an alert management.

• Many complements in order to incorporate functionalities.

Page 15: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Data Base Server

Sensors

Web Client

APK

APM Visual

NO YET

Agent

Alert

Manager

@

Management platform + APM

Page 16: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Installation

• Virtual machine. Ubuntu 18.10.

• Installed and configurated Telegraf, InfluxDB andGrafana.

Page 17: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Result Validation

Virtual machine. Ubuntu 18.10.Data

Genearator

Application:

• It simulated 10 sensors and each one receives 5 TV channels

• Values (Level, SNR and BER) are generated randomly as a

fixed value with a 5% standard deviation

Page 18: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Signal level

Page 19: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Signal level and SNR: sensor 101

Page 20: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Alerts

Page 21: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Alerts: Telegram

Page 22: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Dashboard

Total

15Working

15Total

10Working

10Paused

0

Transmitters Sensors

List14 473MHz Tx-No.1

38 617MHz Tx-No.2

40 629MHz Tx-No.3

41 635MHz Tx-No.4

43 641MHz Tx-No.5

44 647MHz Tx-No.6

ListLCT00314 Boyeros-1

LCT05719 Boyeros-2

LCT12693 Boyeros-3

LCT24516 MINCOM-1

LCT43215 LCT-1

LCT54321 LCT-2

List

Page 23: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Future work

• Stress the platform

• Network design

• Geography representation

Page 24: Manegement Plataform of a DTMB signal monitoring network · InfluxDB •Time Series Database (TSDB). •Top one in TSDB ranking. Reference site: db-engines.com. •High performance

INSTITUTO DE INVESTIGACIÓN Y DESARROLLO DE TELECOMUNICACIONESOrden “Carlos J. Finlay”

Manegement Plataform of a DTMB

signal monitoring network

MSc. Rufino Cabrera Alvares

[email protected]

…and others authors from LACETEL-CUAJE

November 6th, 2019