2dfq: two-dimensional fair queuing for multi-tenant cloud … · 2016-08-26 · 2dfq:...
TRANSCRIPT
![Page 1: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/1.jpg)
2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services
Jonathan MaceBrown University
Peter BodikMicrosoft
Madanlal MusuvathiMicrosoft
Rodrigo FonsecaBrown University
Krishnan VaradarajanMicrosoft
![Page 2: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/2.jpg)
2
Containers / VMs
![Page 3: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/3.jpg)
2
Containers / VMs
Shared Systems:Storage, Database,
Queueing, etc.
![Page 4: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/4.jpg)
2
Containers / VMs
Shared Systems:Storage, Database,
Queueing, etc.
![Page 5: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/5.jpg)
Shared Process
3
![Page 6: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/6.jpg)
Shared ProcessTenants
Request Queues
…
3
![Page 7: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/7.jpg)
Shared ProcessTenants
Request Queues
time
Threads
…
3
![Page 8: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/8.jpg)
Shared ProcessTenants
Request Queues
time
Threads
…
3
![Page 9: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/9.jpg)
Shared ProcessTenants
Request Queues
time
Threads
…
FIFO or ad-hoc
3
![Page 10: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/10.jpg)
Shared ProcessTenants
Request Queues
time
Threads
…
4
![Page 11: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/11.jpg)
Shared ProcessTenants
Request Queues
time
Threads
…
Flows Packet
4
![Page 12: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/12.jpg)
Shared ProcessTenants
Request Queues
time
Threads
…
Flows Packet Switch
Link
4
![Page 13: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/13.jpg)
Shared ProcessTenants
Request Queues
time
Threads
…
Flows Packet Switch
Link
Weighted Fair Queueing (WFQ)
4
![Page 14: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/14.jpg)
Shared ProcessTenants
Request Queues
time
Threads
…
Weighted Fair Queueing (WFQ)
Multiple threadsMultiple concurrent requests
4
![Page 15: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/15.jpg)
…
5
![Page 16: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/16.jpg)
…
5
![Page 17: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/17.jpg)
…
Two-Dimensional Fair Queueing (2DFQ)
5
![Page 18: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/18.jpg)
6
![Page 19: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/19.jpg)
Asize =1
(fast database read)
6
![Page 20: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/20.jpg)
Dsize =10
Asize =1
(fast database read) (slow database scan)
6
![Page 21: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/21.jpg)
Dsize =10
Asize =1
One thread:
time
(fast database read) (slow database scan)
6
![Page 22: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/22.jpg)
Dsize =10
Asize =1
One thread:
time
(fast database read) (slow database scan)
6
![Page 23: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/23.jpg)
Dsize =10
Asize =1
One thread:
time
(fast database read) (slow database scan)
6
![Page 24: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/24.jpg)
Dsize =10
Asize =1
…
One thread:
time
(fast database read) (slow database scan)
6
![Page 25: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/25.jpg)
Dsize =10
Asize =1
…
One thread:
time
high-throughput burst
zero-throughput lull
thro
ugh
pu
t
(fast database read) (slow database scan)
6
![Page 26: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/26.jpg)
Dsize =10
Asize =1
…
One thread:
time
high-throughput burst
zero-throughput lull
Ideal:
thro
ugh
pu
t
(fast database read) (slow database scan)
6
![Page 27: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/27.jpg)
Dsize =10
Asize =1
…
One thread:
time
high-throughput burst
zero-throughput lull
Ideal:
thro
ugh
pu
t
(fast database read) (slow database scan)
6
![Page 28: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/28.jpg)
Dsize =10
Asize =1
…
One thread:
time
high-throughput burst
zero-throughput lull
Ideal:
thro
ugh
pu
t
(fast database read) (slow database scan)
6
![Page 29: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/29.jpg)
Dsize =10
Asize =1
7
![Page 30: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/30.jpg)
Dsize =10
Asize =1
CB
7
![Page 31: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/31.jpg)
Dsize =10
Asize =1
CB
time
7
![Page 32: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/32.jpg)
Dsize =10
Asize =1
CB
time
7
![Page 33: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/33.jpg)
Dsize =10
Asize =1
CB
time
7
![Page 34: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/34.jpg)
Dsize =10
Asize =1
CB
time
time
7
![Page 35: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/35.jpg)
Dsize =10
Asize =1
CB
time
time
7
![Page 36: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/36.jpg)
Dsize =10
Asize =1
CB
time
time
7
![Page 37: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/37.jpg)
Dsize =10
Asize =1
CB
time
time
7
![Page 38: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/38.jpg)
Dsize =10
Asize =1
CB
time
time
thro
ugh
pu
tth
rou
ghp
ut
7
![Page 39: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/39.jpg)
Dsize =10
Asize =1
CB
time
time
thro
ugh
pu
tth
rou
ghp
ut
WFQ, SFQ, …Weighted Fair Queuing
Start-time Fair Queueing
7
![Page 40: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/40.jpg)
Dsize =10
Asize =1
CB
time
time
thro
ugh
pu
tth
rou
ghp
ut
WF²QWorst-Case Fair
Weighted Fair Queuing
WFQ, SFQ, …Weighted Fair Queuing
Start-time Fair Queueing
7
![Page 41: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/41.jpg)
Dsize =10
Asize =1
CB
8
![Page 42: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/42.jpg)
Dsize =10
Asize =1
CB
time
8
![Page 43: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/43.jpg)
Dsize =10
Asize =1
CB
time
8
![Page 44: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/44.jpg)
Dsize =10
Asize =1
CB
time
8
![Page 45: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/45.jpg)
Dsize =10
Asize =1
CB
time
8
![Page 46: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/46.jpg)
Dsize =10
Asize =1
CB
time
time
8
![Page 47: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/47.jpg)
Dsize =10
Asize =1
CB
time
time
8
![Page 48: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/48.jpg)
Dsize =10
Asize =1
CB
time
time
8
![Page 49: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/49.jpg)
Dsize =10
Asize =1
CB
time
time
8
![Page 50: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/50.jpg)
Dsize =10
Asize =1
CB
time
time
Ideal:
8
![Page 51: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/51.jpg)
Dsize =10
Asize =1
CB
time
time
More threads → Opportunity to reduce burstiness
8
![Page 52: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/52.jpg)
Dsize =10
Asize =1
CB
time
time
More threads → Opportunity to reduce burstiness
WFQ, SFQ, WF²Q, …Weighted Fair QueueingStart-time Fair Queueing
Worst-case Fair Weighted Fair Queueing
8
![Page 53: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/53.jpg)
Dsize =10
Asize =1
CB
time
time
More threads → Opportunity to reduce burstiness
WFQ, SFQ, WF²Q, …Weighted Fair QueueingStart-time Fair Queueing
Worst-case Fair Weighted Fair Queueing
2DFQTwo-dimensional Fair
Queueing
8
![Page 54: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/54.jpg)
Challenges
9
![Page 55: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/55.jpg)
A size =1
Tenants with small requests are affected
10
![Page 56: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/56.jpg)
C size =10A size =1
Tenants with small requests are affected
Burstiness is proportional to size of large requests
10
![Page 57: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/57.jpg)
C size =10A size =1
Cloud services:
4+ orders of magnitude variation in cost
Tenants with small requests are affected
Burstiness is proportional to size of large requests
10
![Page 58: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/58.jpg)
C size =10A size =1
Cloud services:
4+ orders of magnitude variation in cost
Tenants with small requests are affected
Burstiness is proportional to size of large requests
size =10A size =1
Size is used by scheduler to make scheduling decisions
C
10
![Page 59: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/59.jpg)
C size =10A size =1
Cloud services:
4+ orders of magnitude variation in cost
Tenants with small requests are affected
Burstiness is proportional to size of large requests
A size =?size =?
Size is used by scheduler to make scheduling decisions
C
10
![Page 60: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/60.jpg)
C size =10A size =1
Cloud services:
4+ orders of magnitude variation in cost
Tenants with small requests are affected
Burstiness is proportional to size of large requests
A
Cloud services:
Estimation using model or moving averages
size =?size =?
Size is used by scheduler to make scheduling decisions
C
10
![Page 61: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/61.jpg)
Key
11
1st quartile 3rd quartile
distribution shape
1st percentilemedian 99th percentile
outliers
![Page 62: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/62.jpg)
Key
11
1st quartile 3rd quartile
distribution shape
1st percentilemedian 99th percentile
outliers
![Page 63: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/63.jpg)
12
![Page 64: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/64.jpg)
UnpredictabilityCost Variation
Quality OfService
12
![Page 65: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/65.jpg)
UnpredictabilityCost Variation
Quality OfService
12
![Page 66: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/66.jpg)
UnpredictabilityCost Variation
Quality OfService
12
![Page 67: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/67.jpg)
Two-DimensionalFair Queueing
13
![Page 68: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/68.jpg)
Dsize =10
Asize =1
CB
time
WFQ
14
![Page 69: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/69.jpg)
Dsize =10
Asize =1
CB
time
WFQ
14
![Page 70: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/70.jpg)
Dsize =10
Asize =1
CB
0 0 0 0
time
WFQ
14
![Page 71: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/71.jpg)
Dsize =10
Asize =1
CB
0 0 0 0
time
WFQ
15
![Page 72: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/72.jpg)
Dsize =10
Asize =1
CB
0 0 0 0
time
WFQ
15
![Page 73: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/73.jpg)
Dsize =10
Asize =1
CB
0 0 0 0
time
WFQ
15
![Page 74: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/74.jpg)
Dsize =10
Asize =1
CB
0 0 0 0
time
WFQ
15
![Page 75: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/75.jpg)
Dsize =10
Asize =1
CB
1 0 0 0
time
WFQ
16
![Page 76: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/76.jpg)
Dsize =10
Asize =1
CB
1 1 0 0
time
WFQ
17
![Page 77: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/77.jpg)
Dsize =10
Asize =1
CB
1 1 0 0
time
WFQ
18
![Page 78: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/78.jpg)
Dsize =10
Asize =1
CB
1 1 0 0
time
v(t)=½
WFQ
18
![Page 79: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/79.jpg)
Dsize =10
Asize =1
CB
2 2 0 0
time
v(t)=1
WFQ
19
![Page 80: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/80.jpg)
Dsize =10
Asize =1
CB
3 3 0 0
time
v(t)=1½
WFQ
20
![Page 81: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/81.jpg)
Dsize =10
Asize =1
CB
4 4 0 0
time
v(t)=2
WFQ
21
![Page 82: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/82.jpg)
Dsize =10
Asize =1
CB
5 5 0 0
time
v(t)=2½
WFQ
22
![Page 83: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/83.jpg)
Dsize =10
Asize =1
CB
6 6 0 0
time
v(t)=3
WFQ
23
![Page 84: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/84.jpg)
Dsize =10
Asize =1
CB
7 7 0 0
time
v(t)=3½
WFQ
24
![Page 85: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/85.jpg)
Dsize =10
Asize =1
CB
8 8 0 0
time
v(t)=4
WFQ
25
![Page 86: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/86.jpg)
Dsize =10
Asize =1
CB
9 9 0 0
time
v(t)=4½
WFQ
26
![Page 87: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/87.jpg)
Dsize =10
Asize =1
CB
10 10 0 0
time
v(t)=5
WFQ
27
![Page 88: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/88.jpg)
Dsize =10
Asize =1
CB
10 10 0 0
time
v(t)=5
WFQ
27
![Page 89: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/89.jpg)
Dsize =10
Asize =1
CB
10 10 10 10
time
v(t)=10
WFQ
28
![Page 90: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/90.jpg)
Dsize =10
Asize =1
CB
0 0 0 0
time
v(t)=0
WF²Q
29
![Page 91: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/91.jpg)
Dsize =10
Asize =1
CB
0 0 0 0
time
v(t)=0
WF²Q
29
![Page 92: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/92.jpg)
Dsize =10
Asize =1
CB
1 1 0 0
time
v(t)=½
WF²Q
30
![Page 93: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/93.jpg)
Dsize =10
Asize =1
CB
1 1 0 0
time
v(t)=½
WF²Q
30
![Page 94: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/94.jpg)
Dsize =10
Asize =1
CB
1 1 0 0
time
v(t)=½
WF²Q
30
![Page 95: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/95.jpg)
Dsize =10
Asize =1
CB
1 1 10 10
time
v(t)=5½
WF²Q
31
![Page 96: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/96.jpg)
Dsize =10
Asize =1
CB
2 2 10 10
time
v(t)=6
WF²Q
32
![Page 97: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/97.jpg)
Dsize =10
Asize =1
CB
3 3 10 10
time
v(t)=6 ½
WF²Q
33
![Page 98: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/98.jpg)
Dsize =10
Asize =1
CB
4 4 10 10
time
v(t)=7
WF²Q
34
![Page 99: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/99.jpg)
Dsize =10
Asize =1
CB
5 5 10 10
time
v(t)=7 ½
WF²Q
35
![Page 100: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/100.jpg)
Dsize =10
Asize =1
CB
6 6 10 10
time
v(t)=8
WF²Q
36
![Page 101: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/101.jpg)
Dsize =10
Asize =1
CB
7 7 10 10
time
v(t)=8½
WF²Q
37
![Page 102: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/102.jpg)
Dsize =10
Asize =1
CB
8 8 10 10
time
v(t)=9
WF²Q
38
![Page 103: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/103.jpg)
Dsize =10
Asize =1
CB
9 9 10 10
time
v(t)=9½
WF²Q
39
![Page 104: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/104.jpg)
Dsize =10
Asize =1
CB
10 10 10 10
time
v(t)=10
WF²Q
40
![Page 105: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/105.jpg)
Dsize =10
Asize =1
CB
11 11 10 10
time
v(t)=10½
WF²Q
41
![Page 106: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/106.jpg)
Dsize =10
Asize =1
CB
11 11 10 10
time
v(t)=10½
WF²Q
41
![Page 107: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/107.jpg)
Dsize =10
Asize =1
CB
11 11 10 10
time
v(t)=10½
WF²Q
41
![Page 108: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/108.jpg)
Dsize =10
Asize =1
CB
0 0 0 0
time
v(t)=0
2DFQ
42
![Page 109: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/109.jpg)
Dsize =10
Asize =1
CB
0 0 0 0
time
v(t)=0
2DFQ
42
![Page 110: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/110.jpg)
Dsize =10
Asize =1
CB
1 1 0 0
time
v(t)=½
2DFQ
43
![Page 111: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/111.jpg)
Dsize =10
Asize =1
CB
1 1 0 0
time
v(t)=½
2DFQ
43
![Page 112: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/112.jpg)
Dsize =10
Asize =1
CB
1 1 10 0
time
v(t)=½
2DFQ
44
![Page 113: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/113.jpg)
Dsize =10
Asize =1
CB
1 1 10 0
time
v(t)=½
2DFQ
44
![Page 114: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/114.jpg)
Dsize =10
Asize =1
CB
1 1 10 0
time
v(t)=½ 1 1
2DFQ
44
![Page 115: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/115.jpg)
Dsize =10
Asize =1
CB
2 1 10 0
time
v(t)=1
2DFQ
45
![Page 116: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/116.jpg)
Dsize =10
Asize =1
CB
2 1 10 0
time
v(t)=1
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
45
![Page 117: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/117.jpg)
Dsize =10
Asize =1
CB
2 2 10 0
time
v(t)=1½
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
46
![Page 118: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/118.jpg)
Dsize =10
Asize =1
CB
3 2 10 0
time
v(t)=2
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
47
![Page 119: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/119.jpg)
Dsize =10
Asize =1
CB
3 3 10 0
time
v(t)=2½
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
48
![Page 120: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/120.jpg)
Dsize =10
Asize =1
CB
4 3 10 0
time
v(t)=3
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
49
![Page 121: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/121.jpg)
Dsize =10
Asize =1
CB
4 4 10 0
time
v(t)=3½
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
50
![Page 122: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/122.jpg)
Dsize =10
Asize =1
CB
5 4 10 0
time
v(t)=4
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
51
![Page 123: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/123.jpg)
Dsize =10
Asize =1
CB
5 5 10 0
time
v(t)=4½
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
52
![Page 124: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/124.jpg)
Dsize =10
Asize =1
CB
6 5 10 0
time
v(t)=5
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
53
![Page 125: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/125.jpg)
Dsize =10
Asize =1
CB
6 6 10 0
time
v(t)=5½
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
54
![Page 126: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/126.jpg)
Dsize =10
Asize =1
CB
6 6 10 0
time
v(t)=5½
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
54
![Page 127: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/127.jpg)
Dsize =10
Asize =1
CB
6 6 10 0
time
v(t)=5½
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
54
![Page 128: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/128.jpg)
Dsize =10
Asize =1
CB
6 6 10 0
time
v(t)=5½
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
6 654
![Page 129: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/129.jpg)
Dsize =10
Asize =1
CB
7 6 10 10
time
v(t)=6
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
55
![Page 130: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/130.jpg)
Dsize =10
Asize =1
CB
7 7 10 10
time
v(t)=6½
Eligible 𝑟𝑗 , 𝑖 = Start 𝑟𝑗 − 𝑖𝑛× size 𝑟𝑗
2DFQ
56
![Page 131: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/131.jpg)
Unknown Costs
57
![Page 132: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/132.jpg)
Unknown Costs
57
![Page 133: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/133.jpg)
Unknown Costs
57
![Page 134: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/134.jpg)
Unknown Costs
57
![Page 135: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/135.jpg)
Unknown Costs
57
![Page 136: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/136.jpg)
Unknown Costs
58
![Page 137: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/137.jpg)
Unknown Costs
58
![Page 138: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/138.jpg)
Unknown Costs
Pessimistic cost estimation
58
![Page 139: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/139.jpg)
Evaluation
Compare 2DFQ to WFQ and WF²Q
Discrete event simulator with Azure Storage workloads
More experiment results in the paper, evaluating:• Burstiness
• Fairness
• Tail latency
59
![Page 140: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/140.jpg)
60
![Page 141: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/141.jpg)
A
50 tenants with size ≈ 1
60
![Page 142: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/142.jpg)
A
50 tenants with size ≈ 1
C
50 tenants with size ≈ 1000
60
![Page 143: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/143.jpg)
A
50 tenants with size ≈ 1
C
50 tenants with size ≈ 1000
16 threads1000 units/second
Costs known by scheduler
60
![Page 144: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/144.jpg)
CA
50 tenants with size ≈ 1 50 tenants with size ≈ 1000
16 threads1000 units/second
Costs known by scheduler
60
A’s
Ser
vice
Rat
e
![Page 145: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/145.jpg)
CA
50 tenants with size ≈ 1 50 tenants with size ≈ 1000
16 threads1000 units/second
Costs known by scheduler
60
A’s
Ser
vice
Rat
e
![Page 146: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/146.jpg)
CA
50 tenants with size ≈ 1 50 tenants with size ≈ 1000
16 threads1000 units/second
Costs known by scheduler
60
A’s
Ser
vice
Rat
e
![Page 147: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/147.jpg)
CA
50 tenants with size ≈ 1 50 tenants with size ≈ 1000
16 threads1000 units/second
Costs known by scheduler
60
A’s
Ser
vice
Rat
e
![Page 148: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/148.jpg)
CA
50 tenants with size ≈ 1 50 tenants with size ≈ 1000
16 threads1000 units/second
Costs known by scheduler
60
A’s
Ser
vice
Rat
e
![Page 149: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/149.jpg)
CA
50 tenants with size ≈ 1 50 tenants with size ≈ 1000
16 threads1000 units/second
Costs known by scheduler
60
A’s
Ser
vice
Rat
e
![Page 150: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/150.jpg)
250 Azure Storage tenants32 threads
1 million units/secondCosts known by scheduler
61
![Page 151: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/151.jpg)
250 Azure Storage tenants32 threads
1 million units/secondCosts known by scheduler
61
![Page 152: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/152.jpg)
250 Azure Storage tenants32 threads
1 million units/secondCosts known by scheduler
T1
61
![Page 153: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/153.jpg)
250 Azure Storage workloads32 threads
1 million units/secondCosts known by scheduler
T1
62
![Page 154: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/154.jpg)
250 Azure Storage workloads32 threads
1 million units/secondCosts known by scheduler
T1
62
![Page 155: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/155.jpg)
250 Azure Storage workloads32 threads
1 million units/secondCosts known by scheduler
T1
62
![Page 156: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/156.jpg)
250 Azure Storage workloads32 threads
1 million units/secondCosts known by scheduler
T1
62
![Page 157: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/157.jpg)
250 Azure Storage workloads32 threads
1 million units/secondCosts known by scheduler
T1
62
![Page 158: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/158.jpg)
250 Azure Storage workloads32 threads
1 million units/secondCosts known by scheduler
T1
62
![Page 159: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/159.jpg)
250 Azure Storage workloads32 threads
1 million units/secondCosts known by scheduler
T1
62
![Page 160: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/160.jpg)
250 Azure Storage workloads32 threads
1 million units/secondCosts known by scheduler
T1
62
![Page 161: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/161.jpg)
Unpredictable WorkloadsWidely Varying Costs
Quality OfService
63
![Page 162: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/162.jpg)
Unpredictable WorkloadsWidely Varying Costs
Quality OfService
63
![Page 163: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/163.jpg)
Unpredictable WorkloadsWidely Varying Costs
Quality OfService
63
![Page 164: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/164.jpg)
Unpredictable WorkloadsWidely Varying Costs
Quality OfService
63
![Page 165: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/165.jpg)
Predictable
2/3 predictable1/3 unpredictable
1/3 predictable2/3 unpredictable
T1
T1
T1
64
![Page 166: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/166.jpg)
Predictable
2/3 predictable1/3 unpredictable
1/3 predictable2/3 unpredictable
T1
T1
T1
64
![Page 167: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/167.jpg)
Predictable
2/3 predictable1/3 unpredictable
1/3 predictable2/3 unpredictable
T1
T1
T1
64
![Page 168: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/168.jpg)
Predictable
2/3 predictable1/3 unpredictable
1/3 predictable2/3 unpredictable
T1
T1
T1
64
![Page 169: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/169.jpg)
Predictable
2/3 predictable1/3 unpredictable
1/3 predictable2/3 unpredictable
T1
T1
T1
64
![Page 170: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/170.jpg)
Predictable
2/3 predictable1/3 unpredictable
1/3 predictable2/3 unpredictable
65
![Page 171: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/171.jpg)
Predictable
2/3 predictable1/3 unpredictable
1/3 predictable2/3 unpredictable
65
![Page 172: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/172.jpg)
Predictable
2/3 predictable1/3 unpredictable
1/3 predictable2/3 unpredictable
65
![Page 173: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/173.jpg)
Predictable
2/3 predictable1/3 unpredictable
1/3 predictable2/3 unpredictable
65
![Page 174: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/174.jpg)
Two-Dimensional Fair Queueing
66
![Page 175: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/175.jpg)
More threads → Opportunity to reduce burstiness
Two-Dimensional Fair Queueing
66
![Page 176: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/176.jpg)
More threads → Opportunity to reduce burstiness
Two-Dimensional Fair Queueing
Partitions requests across threads by size
66
![Page 177: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/177.jpg)
More threads → Opportunity to reduce burstiness
Two-Dimensional Fair Queueing
Partitions requests across threads by size
Co-locates unpredictable and expensive workloads
66
![Page 178: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/178.jpg)
More threads → Opportunity to reduce burstiness
Two-Dimensional Fair Queueing
Partitions requests across threads by size
Co-locates unpredictable and expensive workloads
Unpredictable WorkloadsWidely Varying Costs
Quality OfService
66
![Page 179: 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud … · 2016-08-26 · 2DFQ: Two-Dimensional Fair Queuing for Multi-Tenant Cloud Services Jonathan Mace Brown University Peter](https://reader034.vdocument.in/reader034/viewer/2022042200/5ea030d4a56a2c3daf334f51/html5/thumbnails/179.jpg)
More threads → Opportunity to reduce burstiness
Two-Dimensional Fair Queueing
Partitions requests across threads by size
Co-locates unpredictable and expensive workloads
Less burstiness
Reduced tail latency
Unpredictable WorkloadsWidely Varying Costs
Quality OfService
66