reliability security performance · dynodroid stamp cirruscloud developmen t and testing...

34

Upload: others

Post on 15-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 2: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 3: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

Developmen

t

and Testing

Pre-deployment

Certification

Post-deployment

Adaptation

Reliability Security Performance

program analysis

Page 4: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

Dynodroid Stamp CirrusCloud

Developmen

t

and Testing

Pre-deployment

Certification

Post-deployment

Adaptation

Reliability Security Performance

Page 5: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 6: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

event-driven program

. . .

e1s0 s1 s2 . . .e2 e3

Page 7: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

event-driven programe1s0 s1 s2 . . .

tap(305, 544)

e2 e3

Page 8: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 9: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 10: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 11: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

Dynodroid achieves higher coverage than Monkey

for 30 of the 50 apps.

Page 12: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

Automation Degree = C(Dynodroid ∩ Human)

/C(Human)

Range = 8-100%, Average = 83%, S.D. = 21%

Page 13: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 14: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 15: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

D. Ramos and D. Engler. Under-Constrained Symbolic

Execution: Correctness Checking for Real Code. USENIX

Security 2015.

I. Yun, C. Min, X. Si, Y. Jang, T. Kim, M. Naik. APISan:

Sanitizing API Usages through Semantic Cross-checking.

USENIX Security 2016.

Page 16: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 17: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

CPU

(GHz)

ScreenRes.

(thousand

pixels)

Rear

Camera

(MP)

Front

Camera

(MP)

SensorsBattery

(mAh)

iPhone 0.4 153 2 -3

(light, accelerometer,

proximity)

1,400

iPhone 3 0.6 153 3 -4

(light , accelerometer,

proximity, compass)

1,150

iPhone 4 0.8 614 5 0.36

(light, accelerometer,

proximity, compass,

gyroscope, infrared)

1,420

iPhone 51.3

dual core727 8 1.2

7(light, accelerometer,

proximity, compass,

gyroscope, infrared,

fingerprint)

1,560

iPhone 62.0

dual core1000 12 5.0

8(light, accelerometer,

proximity, compass,

gyroscope, infrared,

fingerprint, barometer)

1,715

Page 18: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

• Data growth trends: IDC's Digital Universe Study, December 2012

• Performance growth trends: Esmaeilzadeh, Blem, St. Amant, Sankaralingam, Burger.

Dark silicon and the end of multicore scaling. ISCA 2011.

Page 19: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

years

per

form

ance

4G

3G

2G

…Mobile Devices

Mobile Devices

Mobile devices resident on vehicles

Page 20: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

“Call Mary!”

Call (Mary)

“Dialing 123-456-7890”

Page 21: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

01010101

010101

11110101

110001

1. Interleaved I/O and computation

2. Network latency

010101010

11010100101

110000010

11010101101

3. Diverse and dynamic environments

Page 22: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

Interleaved I/O andcomputation

Remote State

Co

mm

un

icati

on

Patt

ern

Optimization Problem

Transient Persistent

Bi-directional

Uni-directional

ILP Min-Cut Network latency

Diverse and dynamicenvironments

Page 23: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

?

….

……

…………

……..

………..

…..

….

……

offload…………

……..

………..

resume…..

traces models

optimal and valid

offloading

Page 24: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

….

……

…………

……..

………..

…..

….

……

offload…………

……..

………..

resume…..

30 million instructions

> 8 hours

traces models

optimal and valid

offloading

Page 25: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

….

……

…………

……..

………..

…..

450 million instructions

< 5

seconds

Min-Cut

….

……

offload…………

……..

………..

resume…..

traces models

optimal and valid

offloading

Page 26: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 27: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 28: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

Sp

eed

up

Page 29: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

Fra

mes

Per

Seco

nd

Page 30: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance
Page 31: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

Sequential Concurrent Weakly consistent Partially consistent

Page 32: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

Application

Framework(e.g. Android) • Hard to analyze (e.g., native code,

reflection)

• Very large

• Mostly irrelevant to the analysis

Page 33: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

ApplicationProgram

Analysis Tool

Page 34: Reliability Security Performance · Dynodroid Stamp CirrusCloud Developmen t and Testing Pre-deployment Certification Post-deployment Adaptation Reliability Security Performance

ApplicationProgram

Analysis Tool

• Summarizes behaviors relevant to

analysis

• Built once and for all

• Improves scalability of analysis

Model of

Framework(e.g. Android)