egee-iii infso-ri-222667 enabling grids for e-science enabling omnet++ simulations on the grid...

EGEE-III INFSO-RI-222667

Enabling Grids for E-sciencE

www.eu-egee.org

Enabling OMNET++ Simulationson the Grid

Gergely Sipos*, Miklós Kozlovszky*, Ákos Balaskó*, András Varga**

*MTA SZTAKI, **OMNEST Inc.

[email protected]/gasuc


EGEE-III-INFSO-RI-222667

What is OMNeT++?

A generic simulation framework:• For the simulation of complex distributed systems: distributed hardware

and software architectures, communication networks, queuing networks,…– An open environment: in terms of source code, embedding, extensibility,

integration, modularity

• Dual licensing:– Academic Public License– Commercial License

• Vivid and growing academic community• Strong commercial referencesComponent-oriented approach:

- The basic building block is a module. - Simple modules can be grouped to form compound modules.- Modules are connected with each other.



OMNET++ simulation domains

Modules may represent: Messages / events may represent:

hardware systems sensor, controller, disk, interface card, CPU, memory

signals, commands, disk head movement, interrupts,…

server farm application server, web server, daemon process (service), thread, database, database query process

HTTP request, remote method invocation, SQL query,…

business processes department, organizational unit, filing cabinet, database, employee, customer,…

file or job, email/phone communication, deadline,…

communication networks host, router, comm. media, protocol layer, application, simulated user, app. session

protocol header, packet, beginning/end of frame transmission, collision, timer expiry, session start/end,…

call centers call center, clerk, customer start/end phone calls, end of customer’s patience (balking),…

queuing systems queue, switch,… job, beginning/end of processing



Defining the Topology(.ned file)

• Modules are written in C language

• NED (Network Description Language) defines topology: how modules are assembled to form larger modules and whole models

//// Host with an Ethernet interface//module EthernetHost { parameters: ... gates: ... submodules: app: EtherTrafficGen; llc: EtherLLC; mac: EtherMAC; connections: app.out --> llc.hl_in; app.in <-- llc.hl_out; llc.ll_in <-- mac.hl_out; llc.ll_out --> mac.hl_in; mac.ll_in <-- in; mac.ll_out --> out;}

The graphical editor operates directly on NED files



Defining simulation parameters (omnet.ini file)

[General]cmdenv-express-mode = true

[Config Ring]description = "a server ring"network = RingQueue**.source.numJobs = ${numJobs=5,10,20}**.source.numJobs = 25**.serviceTime = exponential(${serviceTimeMean=0.5s,1s,2s})**.apply-default = trueconstraint = $numJobs!=20 || $serviceTimeMean<1srepeat = 3

Further runs…

Named configurations(by default, config name serves as experiment

name)

Parameter variations

Repeat count



Advanced simulation event visualization and result analysis

• Simulations write result files:– vector results: a sequence of (time, value) pairs recorded during simulation

example: queue lengths during simulation; end-to-end delays of arrived packets typical visualization: line chart

– scalar results: values of variables, typically recorded at the end of simulation example: total number of packets dropped; average throughput typical visualization: bar chart, x-y plot (scatter plot)

• File format: line-oriented text file– you can use OMNeT++'s tools to process and visualize them– or you can use 3rd party tools (R, Matlab, Excel, etc) or write your own ones for

specialized computations



EGEE Application Porting Group

• Porting legacy applications to EGEE– Some code that already runs on a single machine, cluster or another grid– Not development from scratch

• Includes– Consultancy– F2F meetings– Customized training– Technology support– Email / telephone help desk– Working together

• Generic service for any user / community– Independent from application domain, Virtual Organization, project

• Porting centers in Europe– MTA SZTAKI, Budapest, Hungary– INFN Catania (Italy)– CSIC Santander (Spain)– UCM Madrid (Spain)– WMIN London (UK)

• More information, stories and how to apply: http://www.lpds.sztaki.hu/gasuc



• General purpose grid application developer and user environment • Since 2003, Latest version: 2.7. • To port parameter studies, workflows and workflow based parameter studies to

EGEE and Globus grids• Open source community coordinated by MTA SZTAKI:

http://sourceforge.net/projects/pgportal/

• Supported grid middleware services:

Service EGEE grid (gLite middleware) Globus grids

Job execution Computing Element GRAM

File storage Storage Element, File catalog GridFTP server

Certificate management MyProxy server, VOMS

Information system BDII MDS-2, MDS-4

BrokeringWorkload Management System

Application monitoring & visualization

PROVE

Possibility to hide P-GRADE Portal grid applications behind custom GUIs

Chosen porting tool: P-GRADE Portalwww.portal.p-grade.hu



Grid application development vs.Grid application usage

• EGEE Porting Team with OMNeT++ developer community

• Ported OMNET framework to gLite with P-GRADE Portal:

• Workflow based parameter study• Created custom web interface to access grid-enabled OMNET++ framework

• OMNeT++ users• Provide custom NED files and INI files, execute simulation, download results OR• Provide custom modules, NED files and INI files, execute simulation, download results• Benefit from better performance• Don’t & can’t see the grid



OMNET++ Workflow

File to specify which “OMNET runs” to

execute on the grid

Generator: Separates OMNET

parameter scans into independent

grid jobs.



OMNET++ Workflow

Additional libraries : libstdc++.so.6.0.3, libxml2.so.2.6.16

Output file:Scalar results of

simulation

Executable:Wrapper script to

initialize Simplified OMNET framework

Custom NED file

Custom INI file

Omnet framework

(tar.gz)~10 MByte,

Pulled from SE

Custom OMNET modules – only in developer portal



Two types of OMNET portals

OMNET user portal

• User accounts exist for 1 week

• Can handle NED files that use INET and Queuing module sets from OMNET

• No binary come from end user– Portal does grid operations with

one fixed certificate

OMNET developer portal

• Permanent user accounts

• Can handle custom OMNET modules and NED files that handle such modules

• Binaries come from end users– Users are authenticated based on

their personal certificates



OMNeT++ user portalAccount request



OMNeT++ user portal“Account created” email



OMNeT++ user portalPersonal settings



OMNeT++ user portalInput definition window



OMNeT++ user portalSimulation execution window



OMNeT++ user portalResult download window



OMNeT++ developer portalCertificate management



OMNeT++ developer portalSimulation manager window



OMNeT++ developer portalInput definition



Status of services

• OMNET “demo” and advance portal services are currently in final testing phase

• Portal services will be available in a few weeks• Currently 1 CE and 1 SE supports the service• Direct feedback from OMNET users

– “Enabling OMNET++ Simulations on the Grid” – talk and paper at Annal forum of OMNET Users

• More information at– EGEE Application Porting Group

http://www.lpds.sztaki.hu/gasuc

– P-GRADE Grid Portal http://www.portal.p-grade.hu

EGEE-III INFSO-RI-222667


www.eu-egee.org

Thank youQuestions?

Gergely [email protected]

www.lpds.sztaki.hu/gasucwww.portal.p-grade.hu

egee-iii infso-ri-222667 enabling grids for e-science enabling omnet++ simulations on the grid...

Documents