live demos and open call eucnc, athens, june 27 …...7 - f-interop – eucnc – athens – 27-30...

1 - F-Interop – EUCNC – Athens – 27-30 June 2016

Live Demos and Open Call

EUCNC, Athens, June 27-30

2 - F-Interop – EUCNC – Athens – 27-30 June 2016

IUT

Remote interoperability testing – Overview

IUT

Interoperability Test System

GUI GUI

Internet

Control plane Data plane

3 - F-Interop – EUCNC – Athens – 27-30 June 2016

Internet

IUT1 CoAP Client

GUI

IUT2 CoAP Server

Interoperability Test System

3

Remote interoperability testing – Demo Use Case

Control plane Data plane

4 - F-Interop – EUCNC – Athens – 27-30 June 2016 4

CoAP remote interoperability testing – Main Components

IUT1 CoAP Client

GUI

Test analyzer

User-assisted IUT

IUT2 CoAP Server

Test execution binding

Automated IUT

Test coordinator

Dump files

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test analysis scripts

5 - F-Interop – EUCNC – Athens – 27-30 June 2016

CoAP remote interoperability testing – Session Execution

6 - F-Interop – EUCNC – Athens – 27-30 June 2016

CoAP remote interoperability testing – Session Execution

IUT1 CoAP Client

GUI

Test analyzer

IUT2 CoAP Server

Test execution binding

Test coordinator

Dump files

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test analysis scripts

nextTestCase() launchSniffer()

Control plane Data plane

7 - F-Interop – EUCNC – Athens – 27-30 June 2016

[Execute test case 7 ] [SnifferReady]

CoAP remote interoperability testing – Session Execution

Control plane Data plane

IUT1 CoAP Client

GUI

Test analyzer

IUT2 CoAP Server

Test execution binding

Test coordinator

Dump files

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test analysis scripts

8 - F-Interop – EUCNC – Athens – 27-30 June 2016

IUT1 CoAP Client

GUI

Test analyzer

IUT2 CoAP Server

Test execution binding

Test coordinator

Dump files

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test analysis scripts

PUT, NON, MID:13185

2.04 Changed, NON, MID:59898

Control plane Data plane

8

CoAP remote interoperability testing – Session Execution

9 - F-Interop – EUCNC – Athens – 27-30 June 2016

IUT1 CoAP Client

GUI

Test analyzer

IUT2 CoAP Server

Test execution binding

Test coordinator

Dump files

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test analysis scripts

finishTestCase() finishSniffer()

analyzer_testCaseAnalyze(tc, dump_file)

CoAP remote interoperability testing – Session Execution

Control plane Data plane

10 - F-Interop – EUCNC – Athens – 27-30 June 2016

IUT1 CoAP Client

GUI

Test analyzer

IUT2 CoAP Server

Test execution binding

Test coordinator

Dump files

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test execution

scripts

Test analysis scripts

[Verdict, token]

[Verdict, token]

Control plane Data plane

CoAP remote interoperability testing – Session Execution

11 - F-Interop – EUCNC – Athens – 27-30 June 2016

TEST CASE VERDICT

CoAP remote interoperability testing – Verdicts

12 - F-Interop – EUCNC – Athens – 27-30 June 2016

CoAP remote interoperability testing – Verdict Diagnostics

13 - F-Interop – EUCNC – Athens – 27-30 June 2016

VERDICT EVALUATION INFORMATION

CoAP remote interoperability testing – Verdict Diagnostics

14 - F-Interop – EUCNC – Athens – 27-30 June 2016

CoAP remote interoperability testing – Verdict Diagnostics

15 - F-Interop – EUCNC – Athens – 27-30 June 2016

EXCHANGED MESSAGES

CoAP remote interoperability testing – Verdict Diagnostics

16 - F-Interop – EUCNC – Athens – 27-30 June 2016

PROTOCOL FIELD

INFORMATION

CoAP remote interoperability testing – Verdict Diagnostics

17 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool - Architecture

18 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool Troubleshooting Example

A user has an issue with the service...

19 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool Troubleshooting Example

What is the root cause of the issue?

20 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool Troubleshooting Example

Multiple paths: multiple potential locations for the issue...

21 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool Path Extraction

Need to identify the specific end to end path followed by the packet from the end user to the target server. Tracking packets in SDN is not specificially addressed by OpenFlow and OpenDayLight based networks.

22 - F-Interop – EUCNC – Athens – 27-30 June 2016

Based on the SimpleForwarding application (by default in OpenDaylight, Hydrogen)

Dumping switch rules

Looking in the rules in search for dest=B

No need of modifications in the switches

User U

Switch B

If dest=S fwd to port AB

Server S

Switch A

If dest=S fwd to port S

QoS Monitoring Tool Path Extraction

23 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool: Cause Analysis

Locate possible links in the topology

24 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool: Cause Analysis

Use more information: find links without issues

25 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool: Cause Analysis

Use more information: whitelist links without issues

26 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool: Cause Analysis

Use even more information... From other users

27 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool: Cause Analysis

Whitelist, simplify

28 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool: Cause Analysis

Locate most probable problematic link

29 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool: Testbed

4 VMs in Fed4Fire Switches and hosts: Mininet SDN Controller: OpenDaylight -- Nephos6 Sonar Controller 2..N Nephos6 Sonar Agents Measurement type: ping-RTT

RSPEC to automatically configure a new experiment with all software configured.

30 - F-Interop – EUCNC – Athens – 27-30 June 2016

Mininet Configuration

QoS Agent Configuration

QoS Monitoring Tool: Fed4Fire RSPEC

31 - F-Interop – EUCNC – Athens – 27-30 June 2016

Topology re-created from SDN Info Thresholds

QoS performance

QoS Monitoring Tool: Prototype GUI

32 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool: Packet Loss Data

33 - F-Interop – EUCNC – Athens – 27-30 June 2016

QoS Monitoring Tool: Link Bandwidth Data

34 - F-Interop – EUCNC – Athens – 27-30 June 2016

Path to Target

Double click to select the Source host

Target Server

Host with Latency > Threshold

Host with Latency <= Threshold

Link thickness is proportional to the % of being a problematic Link ( based on QoS data)

Link Latency

QoS Data Visualization

35 - F-Interop – EUCNC – Athens – 27-30 June 2016

Open Call: Current Base Platform

36 - F-Interop – EUCNC – Athens – 27-30 June 2016

Open Call Categories

New testing tools to extend capabilities of F-Interop

New tests designs to test interoperability & other

measures

SME device Interop tests to test F-Interop platform

Plugtests to conduct 3 remote online plugtest events

37 - F-Interop – EUCNC – Athens – 27-30 June 2016

Open Call: Supported Activities & Budget

List of Categories Grants Award

New F-Interop tools extensions 3 100 000

New interop test design and implementation 3 60 000

Plugtests 3 10 000

SME devices F-Interop tests and report 10 10 000

38 - F-Interop – EUCNC – Athens – 27-30 June 2016

Open Call: Community Support & Impact

Follow-up selected proposals submitted to the open call

Management of project startups throughout the life cycle of

the experiments

Support for tools development & test design projects

Cascade funding payments

39 - F-Interop – EUCNC – Athens – 27-30 June 2016

Open Call: Important Dates

Formally launch Open Call & open the

application process

Open Call Starts

November

… 2016 … 2017

Close the application process

Delivery of plugtest events

January

Conduct evaluations &

select 3rd parties

April August

Commence experiments/

projects

May

… 2018

Review 1st release of tools & tests projects

Projects kick off

April February

Results announcement

…