data management j.m.nogiec (with comments by mjl) j.m.nogiec (with comments by mjl) april 2004

Data ManagementData Management

J.M.Nogiec(with comments by MJL)

J.M.Nogiec(with comments by MJL)

April 2004April 2004

Data Management at MTF April 2004, J.Nogiec 2

MTF Data StatusMTF Data StatusThe MTF data management status has been presented and discussed in various

forumsWhile some effort has been made to organize data and consolidate measurement

systems there still exists a significant diversity in data management:Data from different eras are stored in different waysData from different types of measurements are stored in different waysData are managed by several groups

Organization of MTF data, Tevatron or otherwise, is being given a high priority in FY05-6


Data From Existing Systems

Data From Existing SystemsMeasurement

systemRaw data On-line analysis

resultsOff-line analysis

resultsAnalysis reports

format location format location format location format location

MFM

Magnetic Meas. Vertical Dewar

SDS /vmtf/analysis SDS /vmtf/analysis multi-SDS,ASCII

/usr/analysis htmlXMGR

web

CHISOX

Conventional Mag. Circa Main Injector

RDB mdtf21 RDB mdtf21 ASCII /usr/analysis Excel MiniBooNE, NuMI, sy120: web

Htmlpostscript

FMI: webweb

EMS Mag. Meas. Circa LHC

OODB ? OODBRDB

? ? ? ? ?

SSW ASCII /usr/analysis ASCIIXMGR

/usr/analysis - - htmlXMGR

web

Managed by Systems Development & Support Group

Managed by othersManaged by Measurement & Analysis Group

Web pages are distributed among several file systems and accessible via different web servers

Managed by Test Operations and Instrumentation & Controls Group


Data Management [continued]Data Management [continued]

Measurementsystem

Raw data On-line analysis results

Off-line analysis results

Analysis reports


DMCS: quench CFS /vmtf/data CFS /vmtf/data ? ? ? ?

DMCS: quench antenna CFS /vmtf/data CFS /vmtf/data ? ? ? ?

EIEO binary mdtf34 ASCII mdtf34 -- -- -- --

DMCS: cryo CFS /vmtf/data CFS /vmtf/data ? private files -- --

DMCS: strain CFS /vmtf/data CFS /vmtf/data ? ? ? ?

Ray’s Tevatron quench info

- - ASCII /vmtf/data -- -- -- --





Data Management [continued]Data Management [continued]

Measurementsystem



Analysis reports


LabVIEW & DAQView:Tevatron Spool Corrector cavities thermometry on stand B

? ? ? ? ? ? ? ?

Control systems ? TD Server?

? ? - - - -





Data Management Decommissioned Systems

Data Management Decommissioned Systems

Measurement system



Analysis reports, documents, files


Tevatron spools NA NA text web text web NA NA

Tevatron Harmonics (Diploles)

NA NA textDB

UNIXSybase

textDB

UNIXSybase

NA NA

Tevatron Harmonics (Quadrupoles)

NA NA text UNIX text UNIX NA NA

Tevatron Quench NA NA text UNIX text UNIX NA NA

Conventional Magnet Data Files

Datatrieve VAX Datatrieve Sybasefiles

UNIX VAX

text UNIX text web

Source Code NA NA NA NA NA NA text UNIX

MTF Documents NA NA NA NA NA NA various formats

web


Status of Legacy DataStatus of Legacy Data• Spool Data

•See http://tdserver1.fnal.gov/tev-magnets/Spools/refmenu.htm

•JCT has done some work to get magnetic measurements into a standard text format.

• Tevatron Harmonics

•Exist in Text files

•Attempt to place in Sybase not completed

• Tevatron Quench still in text files on UNIX from Vax

• Pre-MI Conventional Magnet Data

•Data originating in Datatrieve has been moved to Sybase


ConclusionConclusion• Recent Conventional Data stored in Sybase

• Recent Quench and Mag. Meas. Tevatron Data stored in “LHC” format

• Exceptions are SSW and field angle measurements

• Legacy data from the 1980’s exists and is accessible

• Some data have been transferred to Sybase, others exist in text files of various levels of organization/ease of transfer to a data base

• MTF is in the process of planning a program to manage these data in a common data base.