GINI on a Cloud

GINI on a CloudCloud computing for internet emulator1Professor Muthucumaru Maheswaran

Team MembersMia HocharSimon FoucherDavid El AchkarMarc AtieGINI on a Cloud November 092David El Achkar, Simon Foucher, Mia Hochar, Marc AtieProfessor Muthucumaru Maheswaran

Resource ManagerProposed ImprovementsOverviewDispatcherCurrent State of GINIObjectivesMia HocharSimon FoucherDavid El AchkarMarc AtieGINI on a Cloud November 093David El Achkar, Simon Foucher, Mia Hochar, Marc Atie

ConclusionSummary and AdvantagesRecommendationsCurrent State of GINIWhat is GINI?GINIs purpose, features, & componentsDrawbacks

GINI on a Cloud November 094David El Achkar, Simon Foucher, Mia Hochar, Marc AtieCurrent State of GINIWhat is GINI?Toolkit for creating virtual micro InternetsCreate midsize networksProcess creates virtual instances of network elements

GINI on a Cloud November 095David El Achkar, Simon Foucher, Mia Hochar, Marc AtieGINI Snapshot

GINI on a Cloud November 096David El Achkar, Simon Foucher, Mia Hochar, Marc AtieCurrent State of GINIGINIs purpose:Teaching and learning toolSuitable to many levels of knowledgeFuture applications

GINI on a Cloud November 097David El Achkar, Simon Foucher, Mia Hochar, Marc AtieCurrent State of GINIGINI Features:Simple to use GUIFully open-source systemStandard compliant router Ability to implement additional protocols or new network elementsGINI on a Cloud November 098David El Achkar, Simon Foucher, Mia Hochar, Marc AtiegRouterGiniLinuxuSwitchWGINIgLoadergBuilderCurrent State of GINIGINI Components:gBuildergLoadergRouterGiniLinuxuSwitchWGINIGINI on a Cloud November 099David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDrawbacksComplicated Installation process

GINI on a Cloud November 0910David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDrawbacksOS Compatibility issues

Network protocol compatibility issues

GINI on a Cloud November 0911David El Achkar, Simon Foucher, Mia Hochar, Marc AtieProposed Improvements DispatcherOverviewDispatcher Flow 1 Request/ReplyDispatcher Flow 2i Connection EstablishedDispatcher Flow 2ii Connection RecordedWhy Twisted?GINI on a Cloud November 0912David El Achkar, Simon Foucher, Mia Hochar, Marc AtieImprovements OverviewGINI on a Cloud November 0913David El Achkar, Simon Foucher, Mia Hochar, Marc AtieClientWorkerFront EndBack EndImprovements OverviewGINI on a Cloud November 0914David El Achkar, Simon Foucher, Mia Hochar, Marc AtieClientWorkerFront EndBack EndImprovements OverviewGINI on a Cloud November 0915Front EndDispatcherDatabaseSchedulerBack EndBack EndBack EndBack EndServerWorkersClientDavid El Achkar, Simon Foucher, Mia Hochar, Marc AtieDispatcher Flow 1Request/ReplyFront EndDispatcherDatabaseI need a workerWorkers IPLowest CPU UsageGINI on a Cloud November 0916David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDispatcher Flow 1Request/ReplyDispatcherDNSIPW_CPU%Lab2_17@cs.mcgill.ca134.204.2.565Lab2_18@cs.mcgill.ca134.204.2.218Lab2_29@cs.mcgill.ca134.204.2.3712Lab2_20@cs.mcgill.ca134.204.2.11218Return IP or host nameQuery min()GINI on a Cloud November 0917David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDispatcher Flow 2iConnection EstablishedFront EndBack EndSSH TunnelGINI on a Cloud November 0918David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDispatcher Flow 2iConnection RecordedDispatcherDatabaseCreate host IP entryTime StampGINI on a Cloud November 0919David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDispatcher Flow 2iiConnection RecordedDispatcherClientConnected toTime Stamp14.89.2.44134.204.2.561:03168.141.71.9134.204.2.211:21191.24.2.56134.204.2.371:56134.13.22.121134.204.2.11212:12GINI on a Cloud November 0920David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDispatcherNetwork Programming modelsHandle connections in a separate OS processHandle connections in a separate threadUse non-blocking system calls to handle all connections in one thread.

GINI on a Cloud November 0921David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDispatcher- Why Twisted?GINI already in PythonAvailable Win/Linux Networking librariesFlexibilityAvailable source codeStabilityHigh-level language

GINI on a Cloud November 0922David El Achkar, Simon Foucher, Mia Hochar, Marc AtieSchedulerPurposeDatabaseTime OutUser InterfaceGINI on a Cloud November 0923David El Achkar, Simon Foucher, Mia Hochar, Marc AtiePurposeManage workers and their connectionsExamine CPU usageGINI on a Cloud November 0924David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDatabase StorageWhat will store all the information ?Database Links scheduler and dispatcherDispatcherDatabaseSchedulerGINI on a Cloud November 0925David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDatabase StorageDB keeps history of 10 last CPU usages for every workerWorkersUsageHistoryW134%12158045W249%70331028W357%2887865DatabaseGINI on a Cloud November 0926David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDatabase StorageHow does the scheduler determine the usage?Pipe $PS dataExtract CPU usage

SchedulerWorker 1CPU Usage 26%

Worker 2Worker 3GINI on a Cloud November 0927David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDatabase UpdateQuery database for worker entry Extract previous ten CPU usagesCompute new weighted average Store new weighted averageGINI on a Cloud November 0928David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDatabase UpdateDatabaseSchedulerWorker 1New Usage 26%

3WorkersNew UsageHistoryW126%W249%4Request Worker 1 Entry112, 15, 80, 45, 2GINI on a Cloud November 0929David El Achkar, Simon Foucher, Mia Hochar, Marc AtieTime OutTimer value must be inserted by user When time limit expires: user gets a popup messageHostTime15.141.123.4 43:27122.131.4.10 60:01192.168.2.12507:13DatabaseSchedulerHostIP 122.131.4.10

Are you still there?GINI on a Cloud November 0930David El Achkar, Simon Foucher, Mia Hochar, Marc AtieUser InterfaceScheduler process runs in backgroundUpdate $PATH file on server Add few commands to communicate with scheduler$ gtimeout $ gkill $ gaddworker $ gremoveworker $ showWorkers$ showActiveSessionsGINI on a Cloud November 0931David El Achkar, Simon Foucher, Mia Hochar, Marc AtieDynamic UpdateUpdate worker boot/shutdown sequenceGINI on a Cloud November 0932SchedulerWorkerWorkerWorker$ gAddWorker$ gRemoveWorkerDavid El Achkar, Simon Foucher, Mia Hochar, Marc AtieConclusionSummaryAdvantagesRecommendationsGINI on a Cloud November 0933David El Achkar, Simon Foucher, Mia Hochar, Marc AtieSummaryInitiating a connection

ClientDispatcherDatabaseWorkerClient contacts dispatcherDispatcher sends IP address of worker to the clientDispatcher queries database for worker, updates database accordinglyClient connects to worker through SSH tunnelGINI on a Cloud November 0934David El Achkar, Simon Foucher, Mia Hochar, Marc AtieSummaryKilling a connection ManualClient shuts down connectionSends message to dispatcher Polling (time out):Scheduler periodically polls clientNo response: scheduler terminates connection

GINI on a Cloud November 0935David El Achkar, Simon Foucher, Mia Hochar, Marc AtieAdvantagesNo need to install back end Easier installation (less packages) Saves user trouble of software maintenance / update Cross-platform compatibility Back end can only run on Linux Front end supported by Linux and Windows

GINI on a Cloud November 0936David El Achkar, Simon Foucher, Mia Hochar, Marc AtieAdvantagesMobility Back end runs on remote server Users can run GINI from wherever they are

Resource usage Managed, automated distribution of computing resources among users Easy to monitor and to add more workers

GINI on a Cloud November 0937David El Achkar, Simon Foucher, Mia Hochar, Marc AtieRecommendationsMove to a public cloud:Make software more accessibleProvide better educational platform for studentsSupport for additional platforms:Many different OS on market Support more platforms for expansion

GINI on a Cloud November 0938David El Achkar, Simon Foucher, Mia Hochar, Marc AtieThank you!Questions?

GINI on a Cloud November 0939