a unified, low-overhead framework to support continuous profiling and optimization xubin (ben) he...
TRANSCRIPT
![Page 1: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/1.jpg)
A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization
Xubin (Ben) He ([email protected])
Storage Technology & Architecture Research(STAR) Lab
Department of Electrical and Computer Engineering
22nd IEEE International Performance Computing and Communications Conference (IPCCC’2003)
![Page 2: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/2.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 2
Outline
Introduction Architecture and Design Performance Evaluations Conclusions and Future Work
![Page 3: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/3.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 3
Introduction
![Page 4: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/4.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 4
Motivations
System profiling is an important mechanism to observe system activities.
Profiling-based optimization has become a key technique.
Continuous and online optimization is needed because of changed system usage patterns.
![Page 5: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/5.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 5
Current State-of-the-art
Traditional approaches bring high overhead to already overloaded system.
Profiling and optimization overhead: Raw Data Gathering Data Recording Data Processing Feedback
![Page 6: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/6.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 6
Introducing Unified, Low-overhead Framework (ULF)
Offload computing overheads from host processors to an embedded processor;
Continuous feedback loop model: 1. Low overhead profiling to gather system event
data; 2. Parallel processing raw data and policy
generation; 3. Apply policy to host;
HostULF
1
2
3
![Page 7: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/7.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 7
Introduction Architecture and Design
Performance EvaluationsConclusions and Future Work
![Page 8: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/8.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 8
Components
ULF board: an embedded processor with a sufficient amount of RAM
Host-side module: APIs as a library or kernel module
Board-side module:embedded os, a libray, plug-ins
![Page 9: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/9.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 9
ULF Board
Low cost, low power embedded processor.
Expandable with secondary PCI slot. Interface with host via standard PCI slot
![Page 10: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/10.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 10
Interaction between Plug-ins and Boards
Initial stage-->Running--->Cleanup
![Page 11: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/11.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 11
Example Applications
Low overhead profiling
On-line program optimizer
On-line file system cache optimizer
…
![Page 12: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/12.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 12
IntroductionArchitecture and Design
Performance EvaluaitonsConclusions and Future Work
![Page 13: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/13.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 13
Experimental Setup
Methodology Prototype using Intel IOP310 processor, Linux 2.4.16 I/O profiling tool: LTT(Linux Trace Toolkit)
Workloads Postmark of Network Appliances: throughput
20k initial files, transactions ranging from 150k to 300k. Iozone
4 configurations1) NTNR: Neither Traced Nor Recorded2) TNR: Traced but Not Recorded3) TDR: Traced and Disk Recorded4) TFR: Traced and ULF Recorded
![Page 14: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/14.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 14
PostMark Results
![Page 15: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/15.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 15
Different W/R ratio
![Page 16: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/16.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 16
Iozone results
![Page 17: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/17.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 17
IntroductionArchitecture and DesignPerformance Evaluations
Conclusions and Future Work
![Page 18: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/18.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 18
Conclusions
A unified, low-overhead framework helps profiling tools to save profiling data rapidly and perform run-time parallel processing.
Reduces profiling overhead LTT: 40%-->0.4%.
![Page 19: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/19.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 19
Future Work
Apply ULF to more case studies Performance:
Adaptively adjust system prefetching and caching policy;
Online code rewrite and recompilation; Security:
Monitor abnormal system access and high risk events.
Intrusion detection
![Page 20: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/20.jpg)
ULF Storage Technology & Architecture Research lab(STAR) T.T.U 20
Acknowledgements
Dr. Ken Yang Ming Zhang
NSF Manufacturing Center at T.T.U
![Page 21: A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization Xubin (Ben) He (hexb@tntech.edu) Storage Technology & Architecture Research(STAR)](https://reader034.vdocument.in/reader034/viewer/2022051401/56649e6f5503460f94b6c689/html5/thumbnails/21.jpg)
Xubin He ([email protected])http://www.ece.tntech.edu/hexb/starlab.htm
Storage Technology & Architecture Research(STAR) Lab
Department of Electrical and Computer Engineering
A Unified, Low-overhead Framework to Support Continuous Profiling and Optimization
IPCCC’2003