intelligent workflow resource planning on the network service interface (nsi) zhiming zhao, cosmin...
TRANSCRIPT
Intelligent workflow resource planning on the Network Service
Interface (NSI)
Zhiming Zhao, Cosmin Dumitru,Arie Taal, Adianto Wibisono, Paola Grosso, Cees de Laat
Data intensive applications on programmable infrastructure
NEwork aware Workflow QoS Planner
Main functionality
Abstract workflow of
DIA
Resource discovery
Network selection/
reservation/ provisioning
Application execution
NEWQoS-Planner
1. Zhao, Z., et al., (2012). Planning data intensive workflows on inter-domain resources using the Network Service Interface (NSI), WORKS in SC12 Salt Lake City.2. Zhao, Z., et al., (2011). An agent based network resource planner for workflow applications. International journal of Multiagent and Grid Systems, 7(6), 187-202.
We will demonstrate:• How the NEtwork aware Workflow Planner (NEWQoSPlanner)
supports these issues:• How to describe an abstract workflow?• How to select optimal resources and network paths for a
workflow?• How to reserve/provision network paths using the
Network Service Interface (NSI)?
How to start the NEWQoSPlannerSoftware structure
As XMLRpcAs FIPA agentsAs standalone application
Dependent packagesJavaSWIProlog
Support NSIStart the software
$NEWQoSP_HOME/bin/script/startServer.sh
How does it work?
GUI Planning engine
Abstract workflow
Resource candidates and execution control
Abstract workflow descriptionDescribing an abstract application using the
QoS aware abstract workflow (QoSAWF) schema
RequestProcessPre/Execution/Post conditionsDataQoS
QosAWF_Thing
Reliability
CodecQualityResolution
Precision
Throughput
Security_LevelTimeliness
ArchiveData
PlaybackData
Quality_Attribute
Request
DataCondition
Process
CompressionRateFramerate
Or_Condition
And_Condition
Media Scientific_Data
Video
Audio
Sensor_Data
Simulation_Results
Is-a
Is-a
Is-a
Is-aIs-a
Is-a Is-a
Is-a
Is-a
Is-a
Is-a Is-a
Is-a
Is-aIs-a
Is-a
Is-a
Is-a
Is-a
Is-a
Is-aIs-a
Is-aIs-a
require_Functionality
contain_Condition
create_Datarequire_Data
require_Quality
execution_Condition
post_Condition
pre_Condition
MoveData
Is-a
Demo 1: semantic resource search: - keywords
- Resolution - etc.
Demo 2: Search a movie about Bridge to display, using the network path selection/ reservation/ provision function of NSI.
Performance characteristics
Performance characteristics
Demo test bed (uvalight-sc12.owl)
Summary• NEWQoSPlanner
• Searching, planning• Challenges
• Multi viewpoint in GUI• Automatic • Cross domain
• Future work• NSI+Openflow• With existing workflow
applications
Acknowledgement
NEWQoSPlanner: Zhiming ZhaoInformation PreProcessing: Arie TaalGUI developer: Adianto Wibisono, Cosmin
DumitruTest bed VM and NSI installation: Ralph
Koning, Jeroen van Ham.Portal interface
http://newqosplanner-demo.appspot.com/main/Project page
http://staff.science.uva.nl/~zhiming