a flexible, multi-purpose, open source test platform … · 2017-10-16 · a flexible,...

A FLEXIBLE, MULTI-PURPOSE, OPEN SOURCE TEST PLATFORM FOR IOT TESTING

Presented by Tibor Csöndes and Antal Wu-Hen-Chang

Ericsson Hungary Ltd.

[email protected], [email protected]

© All rights reserved

mailto:[email protected]

mailto:[email protected]


Source: Ericsson Mobility Report

November 2016

Connected Devices

in 202229 BILLION

18.1 billionM2M/IOT DEVICES

8,6 billionMOBILE PHONES

Connect autonomous devices to an application server

(device ↔ server)

Machine to Machine

Connect autonomous devices to each other as well

(device ↔ device)

Internet of Things

5.6 Billion in 2016

3 billionPC/TABLET/LAPTOOP/FIXED PHONES

3 Billion in 2016

7.3 Billion in 2016


IoT/M2M Communication- Evolving with Wide Range of Requirements

Massive IOT

CAPILLARY NETWORKS

LOGISTICS, TRACKING AND FLEET

MANAGEMENT

SMART

AGRICULTURE

SMART

BUILDING

SMART

METER

Critical IoT

TRAFFIC SAFETY &

CONTROL

INDUSTRIAL APPLICATION

& CONTROL

REMOTE

MANUFACTURING,

TRAINING,

SURGERY

REMOTE HEALTH

CARE

Cellular M2M today

• Electricity meters

• Connected cars

• POS terminals

• ETC

• ~400 million cellular

M2M connections

today

• Majority over GPRS

LOW COST, LOW ENERGY

SMALL DATA VOLUMES

MASSIVE NUMBERS

Massive IoT Radio

Access ULTRA RELIABLE

VERY LOW LATENCY

VERY HIGH AVAILABILITY

4G Evolution & 5G


Cellular for Massive IoTMeeting diversity of use case requirements

Coverage Battery life Throughput (peak) Security DeploymentMobility

EC-GSM-IoT 164dB

(+20dB)

10+ Year 473/473k

bps

SW

Cat-M1 160dB

(+15dB)

10+ Year 0.8/1 Mbps

full duplex

SWConnected &

idle mode

mobility

NB-IoT 164dB

(+20dB)

10+ Year 227/250kbps

multi-tone ULSWIdle mode

mobility

Bandwidth

600kHz

1.4MHz

200kHz

Idle mode

mobility

Massive IoT in Ericsson


LTE-M NB-IoT EC-GSM

IoT Platform

Massive IoT

Infrastructure DCP IoT Apps

Typically delivered

as a serviceDelivered either

on-premises or

partly as a service

Wi-Fi

Thread

BLE

3GPP LPWA access

Capillary networks for non-3GPP

devices

LoRa

Non-3GPP LPWA access

LTE

CAT1-4

IoT Cloud Services

Mobile

Broadband

GPRS

System under test: things


LTE-M NB-IoT EC-GSM

IoT Platform

Massive IoT


Typically delivered


on-premises or

partly as a service

Wi-Fi

Thread

BLE

3GPP LPWA access


devices

LoRa


LTE

CAT1-4

IoT Cloud Services

Mobile

Broadband

GPRS

System under test: infrastructure


LTE-M NB-IoT EC-GSM

IoT Platform

Massive IoT


Typically delivered


on-premises or

partly as a service

Wi-Fi

Thread

BLE

3GPP LPWA access


devices

LoRa


LTE

CAT1-4

IoT Cloud Services

Mobile

Broadband

GPRS

System under test: platform


LTE-M NB-IoT EC-GSM

IoT Platform

Massive IoT


Typically delivered


on-premises or

partly as a service

Wi-Fi

Thread

BLE

3GPP LPWA access


devices

LoRa


LTE

CAT1-4

IoT Cloud Services

Mobile

Broadband

GPRS


Testing challenges

Scaling-up to millions of IoT devices with

new traffic patterns

IoT traffic may cause disturbances for other

mobile subscribers

Diverse set of IoT functionalities and applied

technologies

New security risks

CAPACITY, SCALABILITY TESTS

COEXISTENCE TESTS

FUNCTIONAL TESTS

SECURITY TESTS

IoT testing with


Titan: open-source TTCN-3 test automation framework

• Developed at Ericsson Hungary

Titan supports IoT protocols

• TCP/HTTP, TCP/MQTT, UDP/DTLS/CoAP, SMS/CoAP …

oneM2M

• global consortium for standardizing IoT common services

• chosen Titan as the basis for oneM2M Tester

https://projects.eclipse.org/projects/tools.titan

https://projects.eclipse.org/projects/tools.titan

“Internet of Lego”


Architecture of Lego truck


IoT Platform

INFRASTRUCTURE

(Internet)App

Wi-Fi

iot.eclipse.org

HARDWARE

(motors)

RASPBERRY

PI 3

CONTROL LOGIC

MQTTMQTT

HTTP

IoT traffic with RIOT ( )


Core Load Library

Application behavior (CEFSMs)

CoAP Library

LwM2M Library

MQTT Library HTTP Library

CoAP Peers

MQTT Devices Web Clients

Core Load Library

• Load generator components

• Resource mgmt.

• Scheduling

• REST API for presentation

Protocol Stacks

• Non-blocking functions

• Handling large number

of sessions

Protocol Stacks

• Finite State Machine based

• Simulating huge number

of instances

LwM2M Devices

CoAP Peers


IoT traffic with RIOT ( )


Core Load Library

Application behavior (CEFSMs)

CoAP Library

LwM2M Library

MQTT Library HTTP Library

CoAP Peers


Core Load Library

• Load generator components

• Resource mgmt.

• Scheduling

• REST API for presentation

Protocol Stacks

• Non-blocking functions

• Handling large number

of sessions

Protocol Stacks

• Finite State Machine based

• Simulating huge number

of instances

LwM2M Devices

CoAP Peers



IoT traffic with RIOT

AppIoT

MQTT


Core Load Library

CoAP Library

LwM2M Library

Device Simulation (FSMs)

LwM2M Devices

HTTP Library

Web Clients

traffic

IoT traffic example


IoT traffic example

Core Load Library

CoAP Library

LwM2M Library


LwM2M Devices

HTTP Library

Web Clients

traffic


IoT traffic example

Core Load Library

CoAP Library

LwM2M Library

Device Simulation

(FSMs)LwM2M Devices

HTTP Library

Web Clients

traffic


IoT traffic example

Core Load Library

CoAP Library

LwM2M Library


LwM2M Devices

HTTP Library

Web Clients

traffic


IoT traffic example

Core Load Library

CoAP Library

LwM2M Library


LwM2M Devices

HTTP Library

Web Clients

traffic

Register

201 Created

Read

204 Content

Deregister

202 Deleted


IoT traffic example

Core Load Library

CoAP Library

LwM2M Library


LwM2M Devices

HTTP Library

Web Clients

traffic


IoT traffic example

Core Load Library

CoAP Library

LwM2M Library


LwM2M Devices

HTTP Library

Web Clients

traffic

GET /api/clients

200 OK (JSON)

GET /api/clients/clientX/

200 OK (JSON)

a flexible, multi-purpose, open source test platform … · 2017-10-16 · a flexible,...

Documents