5 august 2004 1 eclipse foundation - mike norman – ceo scapa® technologies eclipse test project...

5 August 2004 1Eclipse Foundation - www.eclipse.org

Mike Norman – CEO Scapa® Technologies

Eclipse Test Project Lead

Eclipse Test & Performance Tools Platform ProjectOverview for LinuxWorld


Eclipse Test and Performance Project

■ Open Source project for test and performance software– Covers testing, tracing/profiling, tuning, logging,

monitoring, analysis, autonomics, administration, etc.

■ Provides integration infrastructure and exemplary extensible tools which work out of the box

■ Extends the Eclipse Open Source technologies■ Integrates with other Open Source software■ Supports a spectrum of standalone-through-distributed

and embedded-through-enterprise systems■ Drives tool interoperability & leverages open standards ■ Being adopted as a base by leading tools vendors■ Open contribution model – seeking additional

participation


Design Development Integration Rollout Production

Hyades & the Lifecycle

Test Specification

Stack / Heap / Instruction System-wide

Unit Functional Integration Load/Performance SLA Probe

• Consistent user interface• Consistent Artefact management and re-use• Fine-grained interoperability• Enables new tool capabilities

Test

Trace / Profile

Monitor / Log


Hyades Reference Tooling Examples

■ Trace Java programs– Class, method, object, package, instance, heap stats– Execution flow

■ Analyze and correlate various logs– 3.0 provides Apache and CBE– 3.1 will provide Linux syslogd & Microsoft® event

■ Monitor system performance data from multiple sources– 3.0 provides Windows® Perfmon– 3.1 will provide Linux, various Unixes, and JMXes

■ Create, manage and run tests– Junit, Simple http, Manual


Open Source Integration Points

■ Application Server: JBoss™– Test execution via JUnit or http– Java trace, server log, JMX monitor (3.1)

■ Operating System: Linux– System metrics, /proc and others (3.1)– Generic syslogd log adapter (3.1)– Test execution – JUnit, http, or manual– Java trace– User interface

■ Web server: Apache– http test execution– Access and error log analysis

■ Database: MySQL®– Logging and tracing (JDBC™) (3.1 planned)

■ Version Control: CVS


Project StructureEclipse Foundation

Test & Performance Tools Platform - Top Level Project

Project Management Committee

Requirements Group

Architecture Group

Planning Group

Opportunities to contribute to project leadership, design, development, test, and documentation

Opportunities to contribute to project direction / oversight

Membership defined by committer group

Membership defined by participating organizations

Hyades Platform

Project

Project Lead

Committers

Hyades Test

ProjectProject Lead

Committers

Hyades Tracing &

Profiling Project

Project Lead

Committers

Hyades M

onitoring

Project

Project Lead

Committers


Eclipse Contribution/Value-Add

■ EPL licensing model (non-infectious)– Vendor tooling extends/leverages framework– Vendor tooling can be paid-for– Contributors compete with each other in paid-for tools

■ Hyades infrastructure is not monolithic– Phased adoption by existing vendors– Interoperability benefits accrue at various levels

■ Roadmap set by community requirements and available contributions– Open process, publicly accountable– Commitments made to build, support, document & test– Integrated with overall Eclipse processes


Contributing Organizations

■ Substantial, and growing, multi-vendor support

■ The following organizations are leveraging and/or contributing to the Hyades Platform– IBM® Scapa® Technologies– Intel® SAP®– Compuware® FOKUS

■ Rising community interest continues toward contributing to and/or leveraging Hyades Platform– Recruiting of additional organizations underway– All interested parties welcome to engage


Eclipse Platform

Test

Trace

EMF Data Models

Log

Statistical

Exec. History

XMIetc.

RealTime

Export

Runtim

eM

onitor / log

Trace Analysis

And Profiling

Test Creation

and Execution

Artifact

Managem

ent

Eclipse GUI

Standard Widgets andCore Plug-ins

Reference PerspectivesAnd Workflow

Hyades Platform Architecture Overview

Target System

Data C

ollection

ApplicationD

ata Collection

Interface

InjectionCorrelation

ExecutionEnvironment

Log Collection

Trace Collection

System ResourceMonitor

JVMPI Monitor

JSR 163Implementation

Data Loader

DistributedData Collection

Framework

Agent

Control Interface

Agent

Control Interface

DistributedControl

Framework

Testability Interface

Test Engine


Tentative Roadmap

Release Date Key Features

Hyades 3.0 6/30/04 Enhanced/extended data models, Java performance profiling, trace agents, and probe insertion kits, test execution samples, statistics performance data collection, Apache log collection agents, data model editors and viewers

Hyades 3.0.1 9/16/04 Bug fixes

Hyades 3.1* 9/30/04 Additional data collectors, documentation, tutorials, bug fixes, future feature specifications

Hyades 3.2* 12/30/04 Extensive data collection and communication enhancements, trace model enhancements, 64-bit support, Java 1.5, RCP, additional data collectors

Hyades 3.3* 3/30/05 JUnit derivatives support, test management enhancements, static code analysis, cross-model associations, additional data collectors, reliable data transport, C++/.Net trace model support

Hyades 4.0* 6/30/05 U2TP/UML2 adoption, additional data collectors, JVMTI, improved sample tools, UI interface, dynamic deployment/config, team support, generic test execution

* Final features and dates for releases 3.1+ pending resource confirmations and planning finalization.


Hyades 3.0 Release – June 2004■ Description

– An integration framework and extensible core tools for testing, tracing, profiling, logging, and monitoring application systems

– Support for the entire project lifecycle from development and deployment through production

■ Key Capabilities Delivered– Eclipse Modeling Framework based implementations of data models for trace,

log, statistical data, test execution history and tests (including early implementation of OMG U2TP Test Profile standard)

– Extensive Java performance profiling support for local and distributed applications

– Sample test execution engines for JUnit, http URL, and manual testing environments

– Statistical performance data collection agents for Microsoft environments – Apache log collection agents – Java trace agents and Java probe insertion kits– An integrated extensible framework of generic interoperable data model

editors and viewers


Log View


Log Correlation


Statistical Performance Data


Test Editor


Trace View


Eclipse Test and Performance Project

■ Eclipse Test and Performance– Key facilitator for Open Source enterprise readiness– Significant initiative – significant backing– Hyades Infrastructure – Driving tools integration, driving

standards, driving the state of the art

■ Hyades 3.0 delivered June 2004– Provides significant capability today– Download it from Eclipse.org, go test-drive

■ More coming – particularly for the Open Source community– And we welcome your feedback and contribution…

5 august 2004 1 eclipse foundation - mike norman – ceo scapa® technologies eclipse test project...

Documents

eclipse foundation

eclipse contributionvalue

project leadership

test execution junit

document test

jboss test execution

test execution samples

profiling test creation