MOME 001990http://www.ist-mome.org

MOME: An advancedmeasurement meta-repository

IPS-MoMe Workshop, Warsaw, PolandMarch 14, 2005Felix Strohmeier

Authors:Pedro A. Aranda Gutiérrez, Antal Bulanza, Marek Dabrowski, Baiba Kaskina, Jürgen Quittek, Carsten Schmoll, Felix Strohmeier, Attila Vidacs, Kardos Sandor Zsolt

2

Outline

| Motivation

| MOME approach

| Meta data models

| Database implementation

| Current status

| Conclusion

4

Motivation: The need for measurement data

| Developing new measurement and monitoring methods| Developing architectures of measurement and monitoring

systems| Developing algorithms for network and traffic control

functions supported by measurements| Developing and validating realistic traffic models| Validating the offered level of QoS

Easy access to the repositories of raw measurement data is highly desirable

Easy access to information about available measurement tools is highly desirable

The ultimate goal: „understanding the Internet”

5

The MOME approach

| Collecting and disseminating information about known measurement toolsmeasurement tools and available measurement datameasurement data

MOMEDATABASE

(Data)

INTEROP-ERABILITYDATABASE

(Tools)

Raw data

E2E QoSparameters

BGP topologydata

WW

W-G

UI

Search

Functio

nsmethods

algorithms

protocols

platform

interfaces

interop-erability

licensing

availability

maturity

metrics

contact

Packetcaptures

...

Me

ta-data E

xtraction

Raw datarepositories

networktype

capture platform

URI Link

capturescenario

dataformat

analysisresults

data type

Data

Ana

lysis

6

Meta-database paradigm (1)

| „Data about data”| Documentation of measurement environment and scenario | Statistical information about the captured traffic| Link to the repository, where data is actually stored

| „Data about tools”| Category| Measured metrics| Hardware and software platform

MOME assists researchers in finding and retrieving the measurement data and tools that are most appropriate for their purposes

7

Meta-database paradigm (2)

| Distributed storage of measurement data| As much storage as provided by the sources of the measurements

| Centralised 'directory' functionality to access the measurement data| Directory stores data about the remotely stored measurement data

| Projects contributing measurements can keep total control on them| When they withdraw data from public access

| They delete the entry in the MOME database| The MOME database itself detects when registered measurements have been

withdrawn from the Internet

| In a centralised design, this control would have been lost

| Examples| CAIDA's Internet Measurement Database (work in progress)| GRID technology based solar observatory

8

Definition of the database model

| A database model suited for heterogeneous measurements| Different kinds of measurements| Measurements produced by different tools

| Meta-data model| Describe the actual data of interest

| Trade-off: keep it generic – keep it specific

Packet traces Flow traces

QoS results

Routing data

HTTP traces

Web-based repositories

Monitoring and

Measurement data

9

The MOME meta-data model (1)

Packet traces

Raw data

10

The MOME meta-data model (2)

Flow traces

Raw data

11

The MOME meta-data model (3)

QoS measurements

Raw data

12

The MOME meta-data model (4)

Routing data

Raw data

13

The MOME meta-data model (5)

HTTP trace

Raw data

14

Data analysis

| Additional information about the characteristics of captured traffic| Automatic analysis by tools integrated in MOME| Results stored in the meta-database

15

Tools database

| E.g. different tool categories| Packet capturing| Traffic flow measurement| Packet monitoring| Connection monitoring| Service monitoring| Application-level monitoring| Intrusion detection| Sniffing| Performance measurement| Connectivity checking| Route detection| Topology detection| Traffic visualisation| Traffic generation

16

Implementation and deployment of the MOME system

| http://www.ist-mome.org| http://www.ist-mome.org/database/

DATABASE

WEBSERVER

THIRD PARTIES

USERGUI

mysql

„assoctiated“measurement

sites

http

mome

surveyor

www-data

www.ist-mome.org

shell.ist-mome.orgfile-

server

Publicrepositories

scp/sftp

http/ftp

dataanalysis

17

Current state of the MOME databases (1)

| Descriptions of exemplary datasets from public repositories| Proof of concept for definition of the MOME meta-data model| Covers most important measurement sites

| Descriptions of packet-level traces collected continuously at the „associated” measurement site in FH Salzburg| Traces stored locally at the MOME repository| So far about 480 1-hour long traces collected

| Analysis tools| Implemented framework, which allows for incorporating new

analysis tools| Currently allows for basic analysis of packet traces (libpcap)| Additional analysis tools planned to be added

18

Current state of the MOME databases (2)

| Framework| Implemented framework, which allows user registration and login| browsing and search open for all users| write access (add/modify) only available to registered users

| Tools descriptions| 57 MOME tools currently listed in database| Description (category, metrics, OS support) allows user

the selection of useful tools for his/her purpose

| Features| User comments for listed tools| Automatic URL checker| Search function| Database statistics

| Further improvements on the way…

19

Conclusion

| Database online:| http://www.ist-mome.org/database/| Unregistered access to all data| Free registration allows

| Adding new tools| Adding new meta-data| Start result analyses on own data

| Demo-PC available| Refreshment area| Visitors welcome

| Open for Co-operation| Encourage Projects to share measurement data

MOME 001990http://www.ist-mome.org

Thank you!

Questions?