live demos and open call eucnc, athens, june 27 …...7 - f-interop – eucnc – athens – 27-30...
TRANSCRIPT
1 - F-Interop – EUCNC – Athens – 27-30 June 2016
Live Demos and Open Call
EUCNC, Athens, June 27-30
2 - F-Interop – EUCNC – Athens – 27-30 June 2016
IUT
Remote interoperability testing – Overview
IUT
Interoperability Test System
GUI GUI
Internet
Control plane Data plane
3 - F-Interop – EUCNC – Athens – 27-30 June 2016
Internet
IUT1 CoAP Client
GUI
IUT2 CoAP Server
Interoperability Test System
3
Remote interoperability testing – Demo Use Case
Control plane Data plane
4 - F-Interop – EUCNC – Athens – 27-30 June 2016 4
CoAP remote interoperability testing – Main Components
IUT1 CoAP Client
GUI
Test analyzer
User-assisted IUT
IUT2 CoAP Server
Test execution binding
Automated IUT
Test coordinator
Dump files
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test analysis scripts
5 - F-Interop – EUCNC – Athens – 27-30 June 2016
CoAP remote interoperability testing – Session Execution
6 - F-Interop – EUCNC – Athens – 27-30 June 2016
CoAP remote interoperability testing – Session Execution
IUT1 CoAP Client
GUI
Test analyzer
IUT2 CoAP Server
Test execution binding
Test coordinator
Dump files
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test analysis scripts
nextTestCase() launchSniffer()
Control plane Data plane
7 - F-Interop – EUCNC – Athens – 27-30 June 2016
[Execute test case 7 ] [SnifferReady]
CoAP remote interoperability testing – Session Execution
Control plane Data plane
IUT1 CoAP Client
GUI
Test analyzer
IUT2 CoAP Server
Test execution binding
Test coordinator
Dump files
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test analysis scripts
8 - F-Interop – EUCNC – Athens – 27-30 June 2016
IUT1 CoAP Client
GUI
Test analyzer
IUT2 CoAP Server
Test execution binding
Test coordinator
Dump files
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test analysis scripts
PUT, NON, MID:13185
2.04 Changed, NON, MID:59898
Control plane Data plane
8
CoAP remote interoperability testing – Session Execution
9 - F-Interop – EUCNC – Athens – 27-30 June 2016
IUT1 CoAP Client
GUI
Test analyzer
IUT2 CoAP Server
Test execution binding
Test coordinator
Dump files
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test analysis scripts
finishTestCase() finishSniffer()
analyzer_testCaseAnalyze(tc, dump_file)
CoAP remote interoperability testing – Session Execution
Control plane Data plane
10 - F-Interop – EUCNC – Athens – 27-30 June 2016
IUT1 CoAP Client
GUI
Test analyzer
IUT2 CoAP Server
Test execution binding
Test coordinator
Dump files
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test execution
scripts
Test analysis scripts
[Verdict, token]
[Verdict, token]
Control plane Data plane
CoAP remote interoperability testing – Session Execution
11 - F-Interop – EUCNC – Athens – 27-30 June 2016
TEST CASE VERDICT
CoAP remote interoperability testing – Verdicts
12 - F-Interop – EUCNC – Athens – 27-30 June 2016
CoAP remote interoperability testing – Verdict Diagnostics
13 - F-Interop – EUCNC – Athens – 27-30 June 2016
VERDICT EVALUATION INFORMATION
CoAP remote interoperability testing – Verdict Diagnostics
14 - F-Interop – EUCNC – Athens – 27-30 June 2016
CoAP remote interoperability testing – Verdict Diagnostics
15 - F-Interop – EUCNC – Athens – 27-30 June 2016
EXCHANGED MESSAGES
CoAP remote interoperability testing – Verdict Diagnostics
16 - F-Interop – EUCNC – Athens – 27-30 June 2016
PROTOCOL FIELD
INFORMATION
CoAP remote interoperability testing – Verdict Diagnostics
17 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool - Architecture
18 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool Troubleshooting Example
A user has an issue with the service...
19 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool Troubleshooting Example
What is the root cause of the issue?
20 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool Troubleshooting Example
Multiple paths: multiple potential locations for the issue...
21 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool Path Extraction
Need to identify the specific end to end path followed by the packet from the end user to the target server. Tracking packets in SDN is not specificially addressed by OpenFlow and OpenDayLight based networks.
22 - F-Interop – EUCNC – Athens – 27-30 June 2016
Based on the SimpleForwarding application (by default in OpenDaylight, Hydrogen)
Dumping switch rules
Looking in the rules in search for dest=B
No need of modifications in the switches
User U
Switch B
If dest=S fwd to port AB
Server S
Switch A
If dest=S fwd to port S
QoS Monitoring Tool Path Extraction
23 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool: Cause Analysis
Locate possible links in the topology
24 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool: Cause Analysis
Use more information: find links without issues
25 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool: Cause Analysis
Use more information: whitelist links without issues
26 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool: Cause Analysis
Use even more information... From other users
27 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool: Cause Analysis
Whitelist, simplify
28 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool: Cause Analysis
Locate most probable problematic link
29 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool: Testbed
4 VMs in Fed4Fire Switches and hosts: Mininet SDN Controller: OpenDaylight -- Nephos6 Sonar Controller 2..N Nephos6 Sonar Agents Measurement type: ping-RTT
RSPEC to automatically configure a new experiment with all software configured.
30 - F-Interop – EUCNC – Athens – 27-30 June 2016
Mininet Configuration
QoS Agent Configuration
QoS Monitoring Tool: Fed4Fire RSPEC
31 - F-Interop – EUCNC – Athens – 27-30 June 2016
Topology re-created from SDN Info Thresholds
QoS performance
QoS Monitoring Tool: Prototype GUI
32 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool: Packet Loss Data
33 - F-Interop – EUCNC – Athens – 27-30 June 2016
QoS Monitoring Tool: Link Bandwidth Data
34 - F-Interop – EUCNC – Athens – 27-30 June 2016
Path to Target
Double click to select the Source host
Target Server
Host with Latency > Threshold
Host with Latency <= Threshold
Link thickness is proportional to the % of being a problematic Link ( based on QoS data)
Link Latency
QoS Data Visualization
35 - F-Interop – EUCNC – Athens – 27-30 June 2016
Open Call: Current Base Platform
36 - F-Interop – EUCNC – Athens – 27-30 June 2016
Open Call Categories
New testing tools to extend capabilities of F-Interop
New tests designs to test interoperability & other
measures
SME device Interop tests to test F-Interop platform
Plugtests to conduct 3 remote online plugtest events
37 - F-Interop – EUCNC – Athens – 27-30 June 2016
Open Call: Supported Activities & Budget
List of Categories Grants Award
New F-Interop tools extensions 3 100 000
New interop test design and implementation 3 60 000
Plugtests 3 10 000
SME devices F-Interop tests and report 10 10 000
38 - F-Interop – EUCNC – Athens – 27-30 June 2016
Open Call: Community Support & Impact
Follow-up selected proposals submitted to the open call
Management of project startups throughout the life cycle of
the experiments
Support for tools development & test design projects
Cascade funding payments
39 - F-Interop – EUCNC – Athens – 27-30 June 2016
Open Call: Important Dates
Formally launch Open Call & open the
application process
Open Call Starts
November
… 2016 … 2017
Close the application process
Delivery of plugtest events
January
Conduct evaluations &
select 3rd parties
April August
Commence experiments/
projects
May
… 2018
Review 1st release of tools & tests projects
Projects kick off
April February
Results announcement
…