atropos latency diagnostics tool
DESCRIPTION
Atropos Latency Diagnostics Tool. COMP 415, Spring 2008. Table of Contents. Problem Formulation Solution Features Solution Architecture Major Systems Project Timeline Conclusion. Problem Formulation. Problem Formulation Solution Features Solution Architecture Major Systems - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/1.jpg)
AtroposLATENCY DIAGNOSTICS TOOLCOMP 415, Spring 2008
![Page 2: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/2.jpg)
TABLE OF CONTENTS
1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
![Page 3: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/3.jpg)
PROBLEM FORMULATION1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
![Page 4: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/4.jpg)
PROBLEM FORMULATION
Messages Take Time To Travel Across a Network
How Can We Find Bottlenecks? When Should We Cancel a
Message?
![Page 5: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/5.jpg)
PROBLEM FORMULATION | BASIC SOLUTION
Catch Messages Correlate Store Associations Retrieve Latencies Display System Map
![Page 6: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/6.jpg)
SOLUTION FEATURES1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
![Page 7: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/7.jpg)
SOLUTION FEATURES
Relocate-Ready Components Process Abstraction Encapsulated Optimization Points Variable Correlation Multiple Visualizations
![Page 8: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/8.jpg)
SOLUTION ARCHITECTURE1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
![Page 9: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/9.jpg)
SOLUTION ARCHITECTURE
Data Flow Scalability Data Recipient Correlation Engine
![Page 10: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/10.jpg)
DATA FLOW
DIAGRAM
o JPM Service
o Controller
o Database
o Manipulation
o View Client
![Page 11: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/11.jpg)
SCALABILITY DIAGRAM
o Data Mining
o Correlation
o Database
![Page 12: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/12.jpg)
DATA RECIPIENT DIAGRAM
o Possibilitieso Parsingo API Calls
o Batching
o Destinations
![Page 13: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/13.jpg)
CORRELATIO
N EN
GINE
DIAGRAM
o Data Reader
o Data Writer
![Page 14: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/14.jpg)
MAJOR SYSTEMS1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
![Page 15: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/15.jpg)
MAJOR SYSTEMS
Correlation Messaging View
![Page 16: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/16.jpg)
Correlation Engine
CORRELATION A correlation engine holds sets of messages and
performs matching between the sets.
Data Reader
Input Messages
Output Messages
Server Log
Data Reader
Input Messages
Output Messages
Server Log
Correlation Rules
AssociationStore
![Page 17: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/17.jpg)
ASSOCIATION GRAPH
Xml Configuration File Stores configuration of association graph Information about correlation rules to use Formats of data logs
Server A
Server B
Server C
In Out
In Out
In Out
![Page 18: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/18.jpg)
DESIGN CHOICES In-memory correlation
Correlation Rules can create their own data structures to expedite their matching
Sliding Time Window Features
Scalability Flexibility Efficiency
![Page 19: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/19.jpg)
MESSAGING
Components not colocated Ensure recoverability Handle large volumes of data
![Page 20: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/20.jpg)
VIEW
Eclipse RCP framework External graphing package Wireframes
![Page 21: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/21.jpg)
VIEW | ECLIPSE RCP FRAMEWORK
Integration with JPMorganChase Modular design Standardized system
![Page 22: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/22.jpg)
VIEW | EXTERNAL GRAPHING PACKAGE
![Page 23: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/23.jpg)
VIEW | W
IREFR
AMES
MULTIPLE SERVER VIEW
![Page 24: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/24.jpg)
VIEW | W
IREFR
AMES
SINGLE SERVER VIEW
![Page 25: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/25.jpg)
PROJECT TIMELINE1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
![Page 26: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/26.jpg)
PROJECT TIMELINE
Five Phases Phase 1: Due February 1st
Phase 2: Due February 15th Phase 3: Due March 1st
Phase 4: Due April 1st
Phase 5: Due May 1st
Front-Loaded Early Integration
![Page 27: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/27.jpg)
PROJECT TIMELINE
Full Interface Skeleton Stub Modules Admin API (Control) AddMessage API Correlation (Default Rules) View Path Latency
Phase I
Phase IIPhase IIIPhase IVPhase V
![Page 28: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/28.jpg)
PROJECT TIMELINE
Phase I
Phase IIPhase IIIPhase IVPhase V
![Page 29: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/29.jpg)
PROJECT TIMELINE
Admin Client (Control) Correlation (Arbitrary) Message Batching Message Datastore Association Datastore Real-Time View
Phase IPhase II
Phase IIIPhase IVPhase V
![Page 30: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/30.jpg)
PROJECT TIMELINE
Phase IPhase II
Phase IIIPhase IVPhase V
![Page 31: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/31.jpg)
PROJECT TIMELINE
Engine Scheduling Correlation Strength Data Client Admin API Graph Node Datastore View Graph Latency
Phase IPhase IIPhase III
Phase IVPhase V
![Page 32: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/32.jpg)
PROJECT TIMELINE
Phase IPhase IIPhase III
Phase IVPhase V
![Page 33: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/33.jpg)
PROJECT TIMELINE
Zero & Many Correlation Parsing Module Single Message View
Phase IPhase IIPhase IIIPhase IV
Phase V
![Page 34: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/34.jpg)
PROJECT TIMELINE
Phase IPhase IIPhase IIIPhase IV
Phase V
![Page 35: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/35.jpg)
PROJECT TIMELINE
Re-Correlation Recoverability Control Path Datastore Collapse Nodes (View)
Phase IPhase IIPhase IIIPhase IVPhase V
![Page 36: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/36.jpg)
CONCLUSION1. Problem Formulation2. Solution Features3. Solution Architecture4. Major Systems5. Project Timeline6. Conclusion
![Page 37: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/37.jpg)
CONCLUSION
What to Solve How to Solve It
ArchitectureConcepts
When to Solve It
![Page 38: Atropos Latency Diagnostics Tool](https://reader035.vdocument.in/reader035/viewer/2022062305/56815f05550346895dcdc5cf/html5/thumbnails/38.jpg)
AtroposCUT THROUGH THE TANGLED WEB…
Thank You For Listening!