boosting simulation performance with python
TRANSCRIPT
Boosting Simulation Performance with Python
Eran Friedman
How to use Discrete-Event Simulation
to run your system faster than
real-time?
About Me● Eran Friedman
● Team lead @ Fabric
● Nowadays developing
the Ground Robot
Outline● Simulations - why?
● How to use DES?
● How to use SimPy?
● What are the challenges?
● How to distribute?
Simulation
“An approximate imitation of the
operation of a process or system ...”
- Wikipedia
Simulation
Orders Stock Motion . . .
Backend
Simulation
Orders Stock Motion . . .
Backend
Importance of SimulationsCOVID-19
Importance of SimulationsAutomated regression tests
Importance of SimulationsAnalyze performance & compare algorithms
Importance of SimulationsRun in the cloud
Importance of SimulationsVerify warehouse layout
Importance of SimulationsInject failures & improve robustness
Importance of SimulationsSimulate a large facility
Discrete-Event Simulation (DES)● Operations are modeled as sequence of events
● Simulation jumps to the next event
● Simulation maintains its own clock
● Example: 2 m/s, 10 time-ticks/second
t=0
x=0cm
t=0.1
x=20cm
t=0.2
x=40cm
Discrete-Event Simulation (DES)● Operations are modeled as sequence of events
● Simulation jumps to the next event
● Simulation maintains its own clock
● Example: 2 m/s, 10 time-ticks/second
t=0
x=0cm
t=0.1
x=20cm
t=0.2
x=40cm
Discrete-Event Simulation (DES)● Operations are modeled as sequence of events
● Simulation jumps to the next event
● Simulation maintains its own clock
● Example: 2 m/s, 10 time-ticks/second
t=0
x=0cm
t=0.1
x=20cm
t=0.2
x=40cm
SimPy Library● Discrete-event simulation (DES) framework
● Created in 2002
● MIT license
● Pure Python
● No dependencies
SimPy Overview
Environment
t = 0
Processes:
r0 r1
Event queue
SimPy Overview
Environment
t = 0
Processes:
r0 r1
Event queue
r1
t=0
r0
t=0
SimPy Overview
Environment
t = 0
Processes:
r0 r1
Event queue
r0
t=0
r1
t=0
Executing -
SimPy Overview
Environment
t = 0
Processes:
r0 r1
Event queue
r0
t=0
r1
t=0
Executing -
r0
t=0.1
SimPy Overview
Environment
t = 0
Processes:
r0 r1
Event queue
r1
t=0
Executing -
r0
t=0.1
SimPy Overview
Environment
t = 0
Processes:
r0 r1
Event queue
r0
t=0.1
Executing -
r1
t=0
SimPy Overview
Environment
t = 0
Processes:
r0 r1
Event queue
r0
t=0.1
Executing -
r1
t=0
r1
t=0.1
SimPy Overview
Environment
t = 0
Processes:
r0 r1
Event queue
r0
t=0.1
Executing -
r1
t=0.1
SimPy Overview
Environment
t = 0.1
Processes:
r0 r1
Event queue
r1
t=0.1
Executing -
r0
t=0.1
SimPy Example - Robot Race● A robot’s speed is about 2-4 meters/second
SimPy Example - Robot Race● All SimPy processes run in a single thread
● Parameters that affect performance:
○ Number of simulated components
○ Time tick granularity
● Can run in ‘real-time’ mode
Benefits of DES● Accelerates development time and faster CI
Benefits of DES● Accelerates development time and faster CI
● Realistic and deterministic simulation
Benefits of DES● Accelerates development time and faster CI
● Realistic and deterministic simulation
● Simulate any date and time of the day
Multi-Threaded System
Orders Stock Motion . . .
Backend
Time Leak - Event-Driven Component● Not naturally tied to time
● SimPy supports event-driven processes
● Not suitable for multi-threaded systems
Time Leak - Event-Driven Component● Not naturally tied to time
● SimPy supports event-driven processes
● Not suitable for multi-threaded systems
Solution:
Inherit from Queue and create a SimPy process
that joins on itself in each time tick
Implementation● SimPy code runs in simulation only
● Can’t use the usual time-related functions.
Wrapping time-related functionality in our
own module
○ time.time()
○ time.sleep()
○ . . .
● Debugging - simulation timestamp in log
Distributed Simulation
Distributed Simulation
Distributed Simulation
create simpy process
start local simpy
do some work
ready
once all clients
are ready
approve
progress local simpy
loop
Distributed Simulation
create simpy process
start local simpy
do some work
ready
once all clients
are ready
approve
progress local simpy
loop
sim time freezes
Summary● Simulation is a powerful tool
● DES makes it more powerful
● is SimPle
● Time leak - synchronize all components time
● Easy to extend to a distributed simulation
Thank You!