![Page 1: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/1.jpg)
Supporting soft real time tasks in the Xen hypervisor
Min Lee
Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik
![Page 2: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/2.jpg)
2© 2009 Avaya Inc. All rights reserved.
Overview
Real time and Xen
Default Credit Scheduler
Experiments
– Instrumentation
Laxity-based scheduler
– Laxity (A)
– Boost with event (B)
– Simple Load Balance (L)
– Cache-aware Real-time load balancing (LL)
Result
Conclusion
![Page 3: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/3.jpg)
3© 2009 Avaya Inc. All rights reserved.
Real time and Xen
Near real-time applications pose challenges
– low-performance virtualization I/O
– scheduling latency
– shared-cache contention
Scheduler is central to all these issues
– scheduling latency as a first-class resource
– managing shared caches
![Page 4: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/4.jpg)
4© 2009 Avaya Inc. All rights reserved.
Deployment of Generic Enterprise Telephony system.
Hardware
Xen Hypervisor
Do
m0
Cal
l-C
Med
ia-S
Sip
-S
BackboneNetwork Local Area Network
.
.
.
IP Endpoint
.
.
.
IP Endpoint
Call-C and Sip-S(Call setup/tear down)
Gateway/ Media Server
Gateway/ Media Server(stream encode/decode)
Local Area Network
![Page 5: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/5.jpg)
5© 2009 Avaya Inc. All rights reserved.
Default Credit Scheduler
VCPU4 VCPU2 VCPU7 VCPU1 VCPU0 VCPU5CPU0
Simple Round Robin
![Page 6: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/6.jpg)
6© 2009 Avaya Inc. All rights reserved.
Default Credit Scheduler
Consumes credits to run
VCPU4 VCPU2 VCPU7 VCPU1 VCPU0 VCPU5CPU0
Overpriority
Underpriority
Every 30ms, distribute credits based on weights
– E.g. 20% CPU to VM 1, 40% CPU to VM 2
– Proportional distribution
– Default weight (256)
![Page 7: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/7.jpg)
7© 2009 Avaya Inc. All rights reserved.
Default Credit Scheduler
Boost up waking-up tasks
VCPU4 VCPU2 VCPU7 VCPU1 VCPU0 VCPU5CPU0
Overpriority
Underpriority
VCPU3
New incoming (waking-up) task
– Probably due to external event (packet arrival)
– E.g. Domain 0
![Page 8: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/8.jpg)
8© 2009 Avaya Inc. All rights reserved.
Default Credit Scheduler
Boost up waking-up tasks
Boostpriority
VCPU4 VCPU2 VCPU7 VCPU1 VCPU0 VCPU5CPU0
Overpriority
Underpriority
VCPU3
VCPU4 VCPU2 VCPU7 VCPU1 VCPU0 VCPU5CPU0 VCPU3
Only one time boost-up (<10ms)
![Page 9: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/9.jpg)
9© 2009 Avaya Inc. All rights reserved.
Default Credit Scheduler
Insufficient support for real-time tasks
RT-tasks (Media-S) competes with other tasks
– Treated as just CPU-bound task
– Missing its deadlines
![Page 10: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/10.jpg)
10© 2009 Avaya Inc. All rights reserved.
Credit Crisis
Credit scheduler
– Good for CPU task
CPU allocation(credit)
CPU-bound tasksBackground tasks(supported by credit)
System tasksInteractive tasks(i.e. Domain 0, supported byboost priority)
Low latency Multimedia tasks
(Soft real time)
Boost priority
– Boost waking-up task
– Short time (<10ms)
– Good for Dom0!
Bad for Media task
– Need both CPU & Low latency!
– Competing with others
![Page 11: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/11.jpg)
11© 2009 Avaya Inc. All rights reserved.
Credit Crisis
Now on, Laxity-based scheduler is introduced.
– Incremental (4 components)
Experiments
– Instrumentation
Laxity-based scheduler
– Laxity (A)
– Boost with event (B)
– Simple Load Balance (L)
– Cache-aware Real-time load balancing (LL)
![Page 12: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/12.jpg)
12© 2009 Avaya Inc. All rights reserved.
Experiments (Deployment)
PESQ
– Quality of voice
– Major metric
Enterprise Telephony system– Media server – ‘Media-S’
– Signaling server – ‘Call-C,Sip-S’
– Other VMs• Dom0
• Cdom [Computational domain]
• Two more domains [Licensing, management]
Two flavors– Standard (Cdom is empty)
– Cpuload (Cdom has 4 cpu-bound tasks)
![Page 13: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/13.jpg)
13© 2009 Avaya Inc. All rights reserved.
Experiments (Setup)
Dell 2950 server
– 2 quad-core Xeon processors
– 4 GB of RAM
2 cores from each socket
– So private cache
4cps, sample one out of 4calls
– G.711, 20ms packetization
– 30sec hold time
– Max 240 streams through Media-S
PESQ
– Compare the referencewith stream from Media-S
COMPACT
IP networkIP network
Server
SIPp and RTP Clients
Xen Hypervisor
Do
m0
Med
ia-S
Cal
l-C
SIP
-S
C-D
om …
tcpdump
COMPACTCOMPACT
IP networkIP network
Server
SIPp and RTP Clients
Xen Hypervisor
Do
m0
Med
ia-S
Cal
l-C
SIP
-S
C-D
om …
tcpdump
![Page 14: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/14.jpg)
14© 2009 Avaya Inc. All rights reserved.
Instrumentation
Custom events for xentrace
CPU utilization
Worst/average wait time
– Each priority
Time slice length
– Each priority
Cache misses
– By xenoprof
Average wait time
L2 cache misses
![Page 15: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/15.jpg)
15© 2009 Avaya Inc. All rights reserved.
Reading the plots
PESQ
– Quality of voice
– 0(bad)~4.5
– 4.0(toll quality)
Cumulative Density
Boxplots
– Min/Max
– 25%,75% percentile
– Median
Poor quality Good quality
![Page 16: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/16.jpg)
16© 2009 Avaya Inc. All rights reserved.
Performance with default credit scheduler
More weights (512, 1024)
– didn’t improve much
Only configuration it worked – pinning
Media-S/Call-C requires significant CPU
– Pinned Media-S/Call-C to CPU0,1 respectively
– Pinned others to CPU2,3
– Dom0 is floating
Underutilizing CPU!
![Page 17: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/17.jpg)
17© 2009 Avaya Inc. All rights reserved.
Laxity (A)
Kind of priority?
– Laxity!
– Target scheduling latency or deadline
– E.g. less than 5ms wait time in the run queue
– Parameter specified by user
Real-time task
– Has laxity value
Non-real-time task
– Doesn’t have laxity value (or conceptually infinite laxity)
![Page 18: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/18.jpg)
18© 2009 Avaya Inc. All rights reserved.
Implementation of laxity
Where to insert real-time tasks to meet their deadline
– In over priority, laxity value is ignored.
5us20us20us&boost
VCPU4(1us)
VCPU2(7us)
VCPU7(4us)
VCPU1(13us)
VCPU0(40us)
VCPU5(21us)CPU0
VCPU#(Length of
previous time slice)Boostpriority
Overpriority
Underpriority
![Page 19: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/19.jpg)
19© 2009 Avaya Inc. All rights reserved.
Prediction of wait time
Each VCPU maintains an expected run time
– Previous time slice length
The amount of CPU time it utilized in its previous run
Works reasonably well
– Min/max
– 25%,75% percentile
More sophiscated formula can be used
Average difference betweenexpected and actual wait times
![Page 20: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/20.jpg)
20© 2009 Avaya Inc. All rights reserved.
Laxity Result
Improved PESQ
![Page 21: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/21.jpg)
21© 2009 Avaya Inc. All rights reserved.
Boost with event (B)
Want to boost-up tasks receiving external event.
– Packet arrival.
But credit scheduler only boost up waking-up task!
– Media-S in run queue doesn’t get boosted
So, we boost it up in the run queue
VCPU4(1us)
VCPU2(7us)
VCPU7(4us)
VCPU1(13us)
VCPU0(40us)
VCPU5(21us)CPU0
(1) Receiving event
VCPU4(1us)
VCPU1(13us)
VCPU0(40us)
VCPU5(21us)CPU0
(2) Get boosted within queue
VCPU2(7us)
VCPU7(4us)
![Page 22: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/22.jpg)
22© 2009 Avaya Inc. All rights reserved.
Simple Load Balance (L)
VCPU4 VCPU2 VCPU7 VCPU1 VCPU0 VCPU5CPU0
VCPU10 VCPU15CPU1
(1) Over or idle task?
(2) Peek peer’s Q
(3) Steal higher priority task
Default Credit scheduler
![Page 23: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/23.jpg)
23© 2009 Avaya Inc. All rights reserved.
Simple Load Balance (L)
VCPU4 VCPU2 VCPU7 VCPU1 VCPU0 VCPU5CPU0
VCPU10 VCPU15CPU1
(1) Under, over or idle task?
(2) Peek peer’s Q
(4) If same priority(a) If mine is real time task, don’t steal(b) If peer’s is real time task, steal(c) Both non-real-time, compare entrance time into queue
- with some delay (2ms)
Laxity-based scheduler (Simple Load Balance)
VCPU17 VCPU11
(3) Steal higher priority task
![Page 24: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/24.jpg)
24© 2009 Avaya Inc. All rights reserved.
Simple Load Balance (L)
Media-S VCPU2 VCPU7 VCPU1 VCPU0 VCPU5CPU0
VCPU10 VCPU15CPU1
Laxity-based scheduler (Simple Load Balance)
VCPU17 VCPU11
(1) This effectively distributes real-time tasks over CPUs(2) Also prevents starvation
![Page 25: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/25.jpg)
25© 2009 Avaya Inc. All rights reserved.
Simple Load Balance (L)
Media-S
VCPU2
VCPU7 VCPU1 VCPU0 VCPU5CPU0
VCPU10 VCPU15CPU1
Laxity-based scheduler (Simple Load Balance)
VCPU17 VCPU11
(1) Kicks out non-real-time task if they waited for some time
![Page 26: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/26.jpg)
26© 2009 Avaya Inc. All rights reserved.
Simple Load Balance (L)
Media-S
VCPU2 VCPU7
VCPU1 VCPU0 VCPU5CPU0
VCPU10 VCPU15CPU1
Laxity-based scheduler (Simple Load Balance)
VCPU17 VCPU11
![Page 27: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/27.jpg)
27© 2009 Avaya Inc. All rights reserved.
Simple Load Balance (L)
Media-S
VCPU2 VCPU7 VCPU1
VCPU0 VCPU5CPU0
VCPU10 VCPU15CPU1
Laxity-based scheduler (Simple Load Balance)
VCPU17 VCPU11
![Page 28: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/28.jpg)
28© 2009 Avaya Inc. All rights reserved.
Cache-aware Real-time load balancing (LL)
Good, but…
– Ping-ponging tasks trashes cache
Bind RT-tasks to CPU
– Fix RT-tasks to its initial CPU
– Disable load-balancing for RT-tasks
Unbalance of multiple RT-tasks
– Need new load-balancer for RT-tasks
![Page 29: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/29.jpg)
29© 2009 Avaya Inc. All rights reserved.
Cache-aware Real-time load balancing (LL)
Don’t steal peer’s real-time tasks in L
– Prefer hot cache (to low wait time)
New x-sec-load balancer
– Balance of real time task’s cpu utilization via bin-packing
CPU0 90% utilized by one real time task
CPU1 80% utilized by three real time tasks
![Page 30: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/30.jpg)
30© 2009 Avaya Inc. All rights reserved.
Cache-aware Real-time load balancing (LL)
Improved PESQ
RT
I’m Happy!
I love you!
![Page 31: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/31.jpg)
31© 2009 Avaya Inc. All rights reserved.
Result (CPU utilization)
We’re fully utilizing CPUs!
0
2000
4000
6000
8000
10000
12000
14000
baseline(pinned) baseline A AL ALLPolicies
Am
ou
nt
of
wo
rk d
on
e b
y cp
uh
og
gin
g
pro
cess
![Page 32: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/32.jpg)
32© 2009 Avaya Inc. All rights reserved.
Result (Various laxity value)
Lower laxity more realtime better quality
various laxity values - standard configuration
![Page 33: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/33.jpg)
33© 2009 Avaya Inc. All rights reserved.
Result (Various laxity value)
Lower laxity more realtime better quality
various laxity values - cpuload configuration
![Page 34: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/34.jpg)
34© 2009 Avaya Inc. All rights reserved.
Result (Boost with event)
Some impact
Adding Boost with event
![Page 35: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/35.jpg)
35© 2009 Avaya Inc. All rights reserved.
Result (Load balance)
Load balancing is essential for multicore
PESQ improvement through load balancer in standard configuration
![Page 36: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/36.jpg)
36© 2009 Avaya Inc. All rights reserved.
Result (Cache misses)
We should consider cache
Cache misses for standard configuration
RT
You know,
I love you
0
500
1000
1500
2000
2500
3000
3500
4000
base
line A AL
ALL
Total misses
Mis
ses
(x10
000)
0
200
400
600
800
1000
1200
base
line A AL
ALL
base
line A AL
ALL
base
line A AL
ALL
base
line A AL
ALL
base
line A AL
ALL
C-dom Domain-0 Call-C Sip-S Media-S
![Page 37: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/37.jpg)
37© 2009 Avaya Inc. All rights reserved.
Conclusion
New soft real time aware scheduler for Xen
– Better support for real time applications without penalizing non-real time tasks
– Fully utilizing CPU resources
– Timeliness requirement expressed by laxity
Instrumentation to help design and measure performance
– Can also be used for other purposes
Thank you!
![Page 38: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/38.jpg)
Extra slides
![Page 39: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/39.jpg)
39© 2009 Avaya Inc. All rights reserved.
Data Centers
Problem:
– Server sprawl
– Underutilization
– Management
Solution: Consolidation
– Reduce resource wastage
– Reduced floor space
– Better power management
How?
(Adapted from ‘Xen and co.’ slides)
![Page 40: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/40.jpg)
40© 2009 Avaya Inc. All rights reserved.
Server virtualization
Ability to create multiple virtual servers from a single physical server
– Allows consolidation by hosting heterogeneous OS instances over the same hardware
Linux
Hardware Hardware
Windows
2-tiered
e-commerce
application
Single tier
streaming
server
Operating
system
Applications
VMM
(Adapted from ‘Xen and co.’ slides)
Why now?
– Emergence of highly efficient virtual machine monitors
• Xen, VMware etc
– Hardware support• Intel, AMD, IBM etc
– Real world example:• Amazon EC2
![Page 41: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/41.jpg)
41© 2009 Avaya Inc. All rights reserved.
Consolidation
Hardware Hardware
VMMVMM
Jboss mysql
Clients
.
.
.
Resource
underutilizedCPUintensive
VMs
10% 20%
Almost 100%
Server
Utilization
(Adapted from ‘Xen and co.’ slides)
![Page 42: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/42.jpg)
42© 2009 Avaya Inc. All rights reserved.
Real Time Tasks
Hardware Hardware
VMMVMM
mysql
Clients
.
.
.
CPUintensive
VMs
Almost 100%
Server
Utilization
(Adapted from ‘Xen and co.’ slides)
RT
NO!OMG!
Give my CPU back!
Just give him what he wants.
– Real time task want his CPU back!
![Page 43: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/43.jpg)
43© 2009 Avaya Inc. All rights reserved.
Xen Virtual Machine Monitor
Xen Hypervisor
Domain 0/Driver domain
ModifiedGuest OS
ModifiedGuest OS
ModifiedGuest OS
…Virtual
machines
I/O virtualization
VM scheduler
Virtual hardware (vCpu, vDisk, vNic, vMemory etc.)
Physical hardware (Cpu, Disk, Nic, Memory etc.)
ApplicationsApplications Applications
(Adapted from ‘Xen and co.’ slides)
![Page 44: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/44.jpg)
44© 2009 Avaya Inc. All rights reserved.
0
20000
40000
60000
80000
100000
120000
140000
160000
180000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17Time in 100sec
Tim
es
Media-S.0
0
2000
4000
6000
8000
10000
12000
14000
16000
18000
20000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17Time in 100sec
use
c
Media-S.0
(a) Count under queue (b) Scheduled time from underBase-Cpuload: Detailed queue metrics
Detailed queue metrics
![Page 45: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/45.jpg)
45© 2009 Avaya Inc. All rights reserved.
Detailed queue metrics
0
100
200
300
400
500
600
700
800
900
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17Time in 100sec
use
c
Media-S.0
0
50000
100000
150000
200000
250000
300000
350000
400000
450000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17Time in 100sec
use
c
Media-S.0
(c) Count under queue (d) Scheduled time from underA-Cpuload: Detailed queue metrics
![Page 46: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/46.jpg)
46© 2009 Avaya Inc. All rights reserved.
0
50
100
150
200
250
300
350
400
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17Time in 100sec
use
c
Domain-0.0Domain-0.1Domain-0.2Domain-0.3aes.0cm.0cobar.0ses.0udom.0udom.1udom.2udom.3utility_server.0
0
1000
2000
3000
4000
5000
6000
7000
8000
9000
10000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17Time in 100sec
use
c
Domain-0.0Domain-0.1Domain-0.2Domain-0.3aes.0cm.0cobar.0ses.0udom.0udom.1udom.2udom.3utility_server.0
Worst wait time in under queue (AL-standard)
Average wait time in under queue (AL-standard)
![Page 47: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/47.jpg)
47© 2009 Avaya Inc. All rights reserved.
0
500
1000
1500
2000
2500
3000
3500
4000
1 10 19 28 37 46 55 64 73 82 91 100 109 118 127 136 145 154Time in 10sec
Mis
se
s in
10
00
0
baselineAALALL
Total misses (standard)
0
200
400
600
800
1000
1200
1 7 13 19 25 31 37 43 49 55 61 67 73 79 85 91 97 103 109 115 121 127 133 139 145 151 157Time in 10sec
Mis
se
s i
n 1
00
00
baselineAALALL
Cobar’s cache misses (standard)
A = 77%AL = 72%ALL = 37%(of baseline respectively)
A = 86%AL = 89%ALL = 73%(of baseline respectively)
![Page 48: Supporting soft real time tasks in the Xen hypervisor Min Lee Joint work with A. S. Krishnakumar, P. Krishnan, Navjot Singh, Shalini Yajnik](https://reader036.vdocument.in/reader036/viewer/2022062800/56649e0d5503460f94af6a57/html5/thumbnails/48.jpg)
48© 2009 Avaya Inc. All rights reserved.
Result (Cache misses)
We should consider cache
Cache misses for cpuload configuration
0
500
1000
1500
2000
2500
3000
3500ba
selin
e A AL
ALL
Total
Mis
ses
in 1
0000
0
200
400
600
800
1000
1200
base
line A AL
ALL
base
line A AL
ALL
base
line A AL
ALL
base
line A AL
ALL
base
line A AL
ALL
C-dom Domain-0 Call-C Sip-S Media-S