Download - Network simulator survey
![Page 1: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/1.jpg)
Qualitative Comparison Qualitative Comparison of Network Simulation of Network Simulation
ToolsTools
Author: Björn SchillingAuthor: Björn Schilling
Supervisor: Jörg HähnerSupervisor: Jörg Hähner
Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 2: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/2.jpg)
ContentsContents
1.1. IntroductionIntroduction
2/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 3: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/3.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
2/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 4: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/4.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
3.3. ComparisonsComparisons• NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler
2/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 5: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/5.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
3.3. ComparisonsComparisons• NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler• Simulators vs. RealWorld testbedSimulators vs. RealWorld testbed
2/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 6: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/6.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
3.3. ComparisonsComparisons• NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler• Simulators vs. RealWorld testbedSimulators vs. RealWorld testbed
4.4. Results & DiscussionResults & Discussion
2/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 7: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/7.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
3.3. ComparisonsComparisons• NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler• Simulators vs. RealWorld testbedSimulators vs. RealWorld testbed
4.4. Results & DiscussionResults & Discussion
5.5. Trade-off with simulation detailsTrade-off with simulation details
2/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 8: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/8.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
3.3. ComparisonsComparisons• NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler• Simulators vs. RealWorld testbedSimulators vs. RealWorld testbed
4.4. Results & DiscussionResults & Discussion
5.5. Trade-off with simulation detailsTrade-off with simulation details
6.6. Summary & ConclusionsSummary & Conclusions
2/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 9: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/9.jpg)
About SimulationAbout Simulation
• Experiments can be expensive, impossible, complexExperiments can be expensive, impossible, complex
3/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 10: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/10.jpg)
About SimulationAbout Simulation
• Experiments can be expensive, impossible, complexExperiments can be expensive, impossible, complex• Additionally, most measurements are not Additionally, most measurements are not
repeatablerepeatable
3/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 11: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/11.jpg)
About SimulationAbout Simulation
• Experiments can be expensive, impossible, complexExperiments can be expensive, impossible, complex• Additionally, most measurements are not Additionally, most measurements are not
repeatablerepeatable► We need simulatorsWe need simulators
3/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 12: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/12.jpg)
About SimulationAbout Simulation
• Experiments can be expensive, impossible, complexExperiments can be expensive, impossible, complex• Additionally, most measurements are not Additionally, most measurements are not
repeatablerepeatable► We need simulatorsWe need simulators
• Simulators model the real worldSimulators model the real world• Ease understanding of itEase understanding of it• Surge its behaviorSurge its behavior• Research its reactions on particular eventsResearch its reactions on particular events
3/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 13: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/13.jpg)
About SimulationAbout Simulation
• Experiments can be expensive, impossible, complexExperiments can be expensive, impossible, complex• Additionally, most measurements are not Additionally, most measurements are not
repeatablerepeatable► We need simulatorsWe need simulators
• Simulators model the real worldSimulators model the real world• Ease understanding of itEase understanding of it• Surge its behaviorSurge its behavior• Research its reactions on particular eventsResearch its reactions on particular events
► „„as real as possible“as real as possible“
3/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 14: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/14.jpg)
About SimulationAbout Simulation
• Experiments can be expensive, impossible, complexExperiments can be expensive, impossible, complex• Additionally, most measurements are not Additionally, most measurements are not
repeatablerepeatable► We need simulatorsWe need simulators
• Simulators model the real worldSimulators model the real world• Ease understanding of itEase understanding of it• Surge its behaviorSurge its behavior• Research its reactions on particular eventsResearch its reactions on particular events
► „„as real as possible“as real as possible“► Details play an important roleDetails play an important role
3/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 15: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/15.jpg)
Level of detail in simulationLevel of detail in simulation
Correct level of detail is one of the most challenging Correct level of detail is one of the most challenging problemsproblems
4/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 16: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/16.jpg)
Level of detail in simulationLevel of detail in simulation
Correct level of detail is one of the most challenging Correct level of detail is one of the most challenging problemsproblems
Pro:Pro:• More details -> more realismMore details -> more realism
4/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 17: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/17.jpg)
Level of detail in simulationLevel of detail in simulation
Correct level of detail is one of the most challenging Correct level of detail is one of the most challenging problemsproblems
Pro:Pro:• More details -> more realismMore details -> more realism• Too less details can lead to wrong or deluding resultsToo less details can lead to wrong or deluding results
4/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 18: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/18.jpg)
Level of detail in simulationLevel of detail in simulation
Correct level of detail is one of the most challenging Correct level of detail is one of the most challenging problemsproblems
Pro:Pro:• More details -> more realismMore details -> more realism• Too less details can lead to wrong or deluding resultsToo less details can lead to wrong or deluding results
Contra:Contra:• Time-consuming implementation & simulationTime-consuming implementation & simulation
4/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 19: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/19.jpg)
Level of detail in simulationLevel of detail in simulation
Correct level of detail is one of the most challenging Correct level of detail is one of the most challenging problemsproblems
Pro:Pro:• More details -> more realismMore details -> more realism• Too less details can lead to wrong or deluding resultsToo less details can lead to wrong or deluding results
Contra:Contra:• Time-consuming implementation & simulationTime-consuming implementation & simulation• MaintenanceMaintenance
4/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 20: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/20.jpg)
Level of detail in simulationLevel of detail in simulation
Correct level of detail is one of the most challenging Correct level of detail is one of the most challenging problemsproblems
Pro:Pro:• More details -> more realismMore details -> more realism• Too less details can lead to wrong or deluding resultsToo less details can lead to wrong or deluding results
Contra:Contra:• Time-consuming implementation & simulationTime-consuming implementation & simulation• MaintenanceMaintenance
In wireless networks two main points are important:In wireless networks two main points are important:• Algorithms & protocols have to be implemented detailedAlgorithms & protocols have to be implemented detailed
4/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 21: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/21.jpg)
Level of detail in simulationLevel of detail in simulationCorrect level of detail is one of the most challenging Correct level of detail is one of the most challenging
problemsproblems
Pro:Pro:• More details -> more realismMore details -> more realism• Too less details can lead to wrong or deluding resultsToo less details can lead to wrong or deluding results
Contra:Contra:• Time-consuming implementation & simulationTime-consuming implementation & simulation• MaintenanceMaintenance
In wireless networks two main points are important:In wireless networks two main points are important:• Algorithms & protocols have to be implemented detailedAlgorithms & protocols have to be implemented detailed• Simulation environment must be realisticSimulation environment must be realistic
4/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 22: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/22.jpg)
ComparisonsComparisonsWhy are they important?Why are they important?
• Significant differences between simulatorsSignificant differences between simulators
5/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 23: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/23.jpg)
ComparisonsComparisonsWhy are they important?Why are they important?
• Significant differences between simulatorsSignificant differences between simulators
• Only way to see which simulator is more accurate is Only way to see which simulator is more accurate is to make comparisonsto make comparisons
5/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 24: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/24.jpg)
ComparisonsComparisonsWhy are they important?Why are they important?
• Significant differences between simulatorsSignificant differences between simulators
• Only way to see which simulator is more accurate is Only way to see which simulator is more accurate is to make comparisonsto make comparisons
• Important for usersImportant for users Results can influence the choice of the simulatorResults can influence the choice of the simulator
5/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 25: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/25.jpg)
ComparisonsComparisonsWhy are they important?Why are they important?
• Significant differences between simulatorsSignificant differences between simulators
• Only way to see which simulator is more accurate is Only way to see which simulator is more accurate is to make comparisonsto make comparisons
• Important for usersImportant for users Results can influence the choice of the simulatorResults can influence the choice of the simulator
• Important for developersImportant for developers Results help to improve the simulatorResults help to improve the simulator
5/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 26: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/26.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
3.3. ComparisonsComparisons• NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler• Simulators vs. RealWorld testbedSimulators vs. RealWorld testbed
4.4. Results & DiscussionResults & Discussion
5.5. Trade-off with simulation detailsTrade-off with simulation details
6.6. Summary & ConclusionsSummary & Conclusions
Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 27: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/27.jpg)
OPNET ModelerOPNET Modeler
• Core is a finite state machineCore is a finite state machine• Analytical model is responsible for speeding up the Analytical model is responsible for speeding up the
simulationsimulation• Licences needed -> no open source productLicences needed -> no open source product• GUIGUI• Lots of documentationLots of documentation• Many pre-implemented algorithms and protocolsMany pre-implemented algorithms and protocols
6/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 28: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/28.jpg)
OPNET ModelerOPNET Modeler
• Core is a finite state machineCore is a finite state machine• Analytical model is responsible for speeding up the Analytical model is responsible for speeding up the
simulationsimulation• Licences needed -> no open source productLicences needed -> no open source product• GUIGUI• Lots of documentationLots of documentation• Many pre-implemented algorithms and protocolsMany pre-implemented algorithms and protocols
► Primal intention was network simulation for Primal intention was network simulation for companiescompanies
6/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 29: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/29.jpg)
OPNET ModelerOPNET Modeler
• Core is a finite state machineCore is a finite state machine• Analytical model is responsible for speeding up the Analytical model is responsible for speeding up the
simulationsimulation• Licences needed -> no open source productLicences needed -> no open source product• GUIGUI• Lots of documentationLots of documentation• Many pre-implemented algorithms and protocolsMany pre-implemented algorithms and protocols
► Primal intention was network simulation for Primal intention was network simulation for companiescompanies
► But comes along with some developer toolsBut comes along with some developer tools
6/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 30: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/30.jpg)
NS-2NS-2
• Second version able to deal with wireless networksSecond version able to deal with wireless networks• Combination of C++ & OTclCombination of C++ & OTcl
• Compromise between performance and user-friendly Compromise between performance and user-friendly designdesign
• Event-based simulatorEvent-based simulator• Open-sourceOpen-source• Less documentationLess documentation• Help can be found in one of the numerous user-Help can be found in one of the numerous user-
groupsgroups
7/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 31: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/31.jpg)
NS-2NS-2
• Second version able to deal with wireless networksSecond version able to deal with wireless networks• Combination of C++ & OTclCombination of C++ & OTcl
• Compromise between performance and user-friendly Compromise between performance and user-friendly designdesign
• Event-based simulatorEvent-based simulator• Open-sourceOpen-source• Less documentationLess documentation• Help can be found in one of the numerous user-Help can be found in one of the numerous user-
groupsgroups
► Mainly used among developersMainly used among developers
7/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 32: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/32.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
3.3. ComparisonsComparisons• NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler• Simulators vs. RealWorld testbedSimulators vs. RealWorld testbed
4.4. Results & DiscussionResults & Discussion
5.5. Trade-off with simulation detailsTrade-off with simulation details
6.6. Summary & ConclusionsSummary & Conclusions
Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 33: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/33.jpg)
NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler
1.1. Simple algorithm needed:Simple algorithm needed:► Flooding implemented in NS-2, OPNET, GloMoSimFlooding implemented in NS-2, OPNET, GloMoSim
8/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 34: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/34.jpg)
NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler
1.1. Simple algorithm needed:Simple algorithm needed:► Flooding implemented in NS-2, OPNET, GloMoSimFlooding implemented in NS-2, OPNET, GloMoSim
2.2. SetupSetup• 50 nodes, 10 of them initiating 100 broadcasts50 nodes, 10 of them initiating 100 broadcasts• 1km*1km area1km*1km area• 300 seconds runtime300 seconds runtime• Random Waypoint mobility model (controllable)Random Waypoint mobility model (controllable)• 802.11 MAC layer protocol802.11 MAC layer protocol• Freespace propagationFreespace propagation
8/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 35: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/35.jpg)
NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler
• Effective Effective transmission rangetransmission range
• Maximum Maximum difference of factor difference of factor 22
• Complete different Complete different behavior of behavior of simulator GloMoSimsimulator GloMoSim
9/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 36: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/36.jpg)
NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler
• Overhead, i.e. Overhead, i.e. produced produced duplicatesduplicates
• Again different Again different behaviorbehavior
• Difference of factor Difference of factor 2,52,5
10/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 37: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/37.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
3.3. ComparisonsComparisons• NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler• Simulators vs. RealWorld testbedSimulators vs. RealWorld testbed
4.4. Results & DiscussionResults & Discussion
5.5. Trade-off with simulation detailsTrade-off with simulation details
6.6. Summary & ConclusionsSummary & Conclusions
Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 38: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/38.jpg)
Simulators vs. RealWorld testbedSimulators vs. RealWorld testbedWhich simulator comes closest to reality?Which simulator comes closest to reality?
1.1. Simple (wired) Simple (wired) testbed:testbed:
• Possibility to create Possibility to create background trafficbackground traffic
• All the traffic has to All the traffic has to pass a 10Mbit linkpass a 10Mbit link
11/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 39: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/39.jpg)
Simulators vs. RealWorld testbedSimulators vs. RealWorld testbedWhich simulator comes closest to reality?Which simulator comes closest to reality?
1.1. Simple (wired) Simple (wired) testbed:testbed:
• Possibility to create Possibility to create background trafficbackground traffic
• All the traffic has to All the traffic has to pass a 10Mbit linkpass a 10Mbit link
2.2. Two different easy applications make up Two different easy applications make up simulation: CBR & FTPsimulation: CBR & FTP►CBR for simplicity, FTP for popularity & common usageCBR for simplicity, FTP for popularity & common usage
11/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 40: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/40.jpg)
Simulators vs. RealWorld testbedSimulators vs. RealWorld testbedCBR, 5MBit/s, Background = 6MBit/sCBR, 5MBit/s, Background = 6MBit/s
• Network testbed inaccurateNetwork testbed inaccurate• NS-2 more constant than OPNETNS-2 more constant than OPNET• Sudden drop of NS-2 curve after 60 secondsSudden drop of NS-2 curve after 60 seconds
12/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 41: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/41.jpg)
Simulators vs. RealWorld testbedSimulators vs. RealWorld testbedFTP, 10MB File, no background trafficFTP, 10MB File, no background traffic
• 2 simulations (normal / after simulator fine-tuning)2 simulations (normal / after simulator fine-tuning)• First results barely accurateFirst results barely accurate• Better results after fine-tuning, esp. OPNET ModelerBetter results after fine-tuning, esp. OPNET Modeler
13/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 42: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/42.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
3.3. ComparisonsComparisons• NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler• Simulators vs. RealWorld testbedSimulators vs. RealWorld testbed
4.4. Results & DiscussionResults & Discussion
5.5. Trade-off with simulation detailsTrade-off with simulation details
6.6. Summary & ConclusionsSummary & Conclusions
Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 43: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/43.jpg)
Results & DiscussionResults & DiscussionReasons for the differencesReasons for the differences
14/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 44: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/44.jpg)
Results & DiscussionResults & DiscussionReasons for the differencesReasons for the differences
• Main factor: Level of detail of physical and MAC Main factor: Level of detail of physical and MAC layer (1 and 2)layer (1 and 2) These layers are implemented in the simulatorThese layers are implemented in the simulator Other layers are implemented by the Other layers are implemented by the
developer/userdeveloper/user
14/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 45: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/45.jpg)
Results & DiscussionResults & DiscussionReasons for the differencesReasons for the differences
• Main factor: Level of detail of physical and MAC Main factor: Level of detail of physical and MAC layer (1 and 2)layer (1 and 2) These layers are implemented in the simulatorThese layers are implemented in the simulator Other layers are implemented by the Other layers are implemented by the
developer/userdeveloper/user
• Level of detail in simulation is decisive for the Level of detail in simulation is decisive for the resultsresults
14/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 46: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/46.jpg)
Results & DiscussionResults & DiscussionReasons for the differencesReasons for the differences
• Main factor: Level of detail of physical and MAC Main factor: Level of detail of physical and MAC layer (1 and 2)layer (1 and 2) These layers are implemented in the simulatorThese layers are implemented in the simulator Other layers are implemented by the Other layers are implemented by the
developer/userdeveloper/user
• Level of detail in simulation is decisive for the Level of detail in simulation is decisive for the resultsresults
• Identical implementation of algorithms in bothIdentical implementation of algorithms in bothsimulators is not possiblesimulators is not possible
14/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 47: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/47.jpg)
Results & DiscussionResults & DiscussionReasons for the differencesReasons for the differences
• Main factor: Level of detail of physical and MAC Main factor: Level of detail of physical and MAC layer (1 and 2)layer (1 and 2) These layers are implemented in the simulatorThese layers are implemented in the simulator Other layers are implemented by the Other layers are implemented by the
developer/userdeveloper/user
• Level of detail in simulation is decisive for the Level of detail in simulation is decisive for the resultsresults
• Identical implementation of algorithms in bothIdentical implementation of algorithms in bothsimulators is not possiblesimulators is not possible
• Bugs & failures can occurBugs & failures can occur Regular software updates, esp. NS-2Regular software updates, esp. NS-2
14/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 48: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/48.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
3.3. ComparisonsComparisons• NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler• Simulators vs. RealWorld testbedSimulators vs. RealWorld testbed
4.4. Results & DiscussionResults & Discussion
5.5. Trade-off with simulation detailsTrade-off with simulation details
6.6. Summary & ConclusionsSummary & Conclusions
Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 49: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/49.jpg)
Trade-off with simulation detailsTrade-off with simulation details
• Often integration is difficult & can have far reaching Often integration is difficult & can have far reaching consequences:consequences: DebuggingDebugging Later changeLater change
15/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 50: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/50.jpg)
Trade-off with simulation detailsTrade-off with simulation details
• Often integration is difficult & can have far reaching Often integration is difficult & can have far reaching consequences:consequences: DebuggingDebugging Later changeLater change
► Which details do make sense, which do not?Which details do make sense, which do not?► Compromise between performance & correctness Compromise between performance & correctness
must be found!must be found!
15/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 51: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/51.jpg)
Trade-off with simulation detailsTrade-off with simulation details
• Often integration is difficult & can have far reaching Often integration is difficult & can have far reaching consequences:consequences: DebuggingDebugging Later changeLater change
► Which details do make sense, which do not?Which details do make sense, which do not?► Compromise between performance & correctness Compromise between performance & correctness
must be found!must be found!
• Typically in todays simulators:Typically in todays simulators: Protocols rather detailedProtocols rather detailed Developers try to integrate as few details as possibleDevelopers try to integrate as few details as possible
15/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 52: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/52.jpg)
ExampleExample
One scenario simulated twice…One scenario simulated twice…• Without idle energy consumptionWithout idle energy consumption• With idle energy consumptionWith idle energy consumption
……with 4 different ad-hocwith 4 different ad-hoc
routing protocolsrouting protocols• AODVAODV• DSRDSR• DSDVDSDV• TORATORA
16/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 53: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/53.jpg)
ExampleExample
One scenario simulated twice…One scenario simulated twice…• Without idle energy consumptionWithout idle energy consumption• With idle energy consumptionWith idle energy consumption
……with 4 different ad-hocwith 4 different ad-hoc
routing protocolsrouting protocols• AODVAODV• DSRDSR• DSDVDSDV• TORATORA
► Deluding results in the first scenarioDeluding results in the first scenario
16/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 54: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/54.jpg)
ExampleExample
One scenario simulated twice…One scenario simulated twice…• Without idle energy consumptionWithout idle energy consumption• With idle energy consumptionWith idle energy consumption
……with 4 different ad-hocwith 4 different ad-hoc
routing protocolsrouting protocols• AODVAODV• DSRDSR• DSDVDSDV• TORATORA
► Deluding results in the first scenarioDeluding results in the first scenario► Idle energy consumption turns out to be an Idle energy consumption turns out to be an
important and necessary detail!important and necessary detail!
16/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 55: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/55.jpg)
ContentsContents
1.1. IntroductionIntroduction
2.2. The Simulators: OPNET Modeler & NS-2The Simulators: OPNET Modeler & NS-2
3.3. ComparisonsComparisons• NS-2 vs. OPNET ModelerNS-2 vs. OPNET Modeler• Simulators vs. RealWorld testbedSimulators vs. RealWorld testbed
4.4. Results & DiscussionResults & Discussion
5.5. Trade-off with simulation detailsTrade-off with simulation details
6.6. Summary & ConclusionsSummary & Conclusions
Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 56: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/56.jpg)
Summary & ConclusionsSummary & Conclusions
• There are differences between simulators and their There are differences between simulators and their simulation resultssimulation results
17/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 57: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/57.jpg)
Summary & ConclusionsSummary & Conclusions
• There are differences between simulators and their There are differences between simulators and their simulation resultssimulation results
• The simulator design influences the simulationThe simulator design influences the simulation
17/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 58: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/58.jpg)
Summary & ConclusionsSummary & Conclusions
• There are differences between simulators and their There are differences between simulators and their simulation resultssimulation results
• The simulator design influences the simulationThe simulator design influences the simulation
• Too few comparisons have been made to make Too few comparisons have been made to make statements about quality and accuracy of the statements about quality and accuracy of the simulatorssimulators
17/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 59: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/59.jpg)
Summary & ConclusionsSummary & Conclusions
• There are differences between simulators and their There are differences between simulators and their simulation resultssimulation results
• The simulator design influences the simulationThe simulator design influences the simulation
• Too few comparisons have been made to make Too few comparisons have been made to make statements about quality and accuracy of the statements about quality and accuracy of the simulatorssimulators
• Each of the simulators showed strengths and Each of the simulators showed strengths and enervationsenervations Usage of a specific simulator depending on application Usage of a specific simulator depending on application
areaarea
17/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 60: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/60.jpg)
Summary & ConclusionsSummary & Conclusions
• Behavior of simulation can depend on small detailsBehavior of simulation can depend on small details
18/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 61: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/61.jpg)
Summary & ConclusionsSummary & Conclusions
• Behavior of simulation can depend on small detailsBehavior of simulation can depend on small details
• Necessity of a detail is not known before simulation Necessity of a detail is not known before simulation is done. Solutions for this problem?is done. Solutions for this problem?►Use experiences made before for future simulationsUse experiences made before for future simulations►Share knowledge: User-groupsShare knowledge: User-groups
18/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
![Page 62: Network simulator survey](https://reader033.vdocument.in/reader033/viewer/2022061118/54698f1faf7959842c8b4f67/html5/thumbnails/62.jpg)
19/19Qualitative Comparison of Network Simulation Tools University of Stuttgart
Thank you for your Thank you for your attention!attention!
Are there any questions?Are there any questions?