stefan hild ilias wg1 meeting, hannover, september 2004 data tools ‚how can data exchange work?‘...

19
Ilias WG1 meeting, Hannover, Sep DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Upload: augustus-johns

Post on 30-Dec-2015

215 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

DATA TOOLS

‚how can data exchange work?‘

Max-Planck-Institut für Gravitationsphysik(Albert-Einstein-Institut)

Page 2: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Data acquisition

fast- 24-bit ADC interface:

32 + (2*) 16 channels up to 16kSample/sec

slow- 12-bit ADC interface:

64 channels with 512 Sample/s

control- LabView system acquires

~ 1000 channels @ ~1Hz

ca . 60 GB/day

Page 3: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Data collection

DCU (alchemist)

DCU (alchemist)

vDCU (control)

vDCU (control)

central

DCU (pandora)

DCU (pandora)e

ast

DCU (thot)

DCU (thot) n

orth

Datacollecto

rRaw data

server

coch32f/64s chans 1 MB/s

16f 500 kB/s 16f 500 kB/s

1000us 5 kB/s

To f

ram

e-m

ake

r and

the r

est

of

the w

orl

d

Fast data access for commissioners

Page 4: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

File formats

• Raw data files (1 second duration)– fs <= 16384 Hz

• Frame files (1 minute duration)– fs <= 16384 Hz– 60 frames per file, one second per frame– All channels in one file

• Hour trends files (1 hour duration)– fs = 1 Hz– Min, max, av

• Day trend files (1 day duration)– fs = 1/60 Hz– Min, max, av

20 days of data

20 days (Han)100 days (Golm)

1 year of data

1 year of data

Page 5: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

DAQS web interface

• Informations about the current DAQS setup• Channel configuration (sampling, filters)

Page 6: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

GEO++ and Triana

• Developed at Cardiff University

• Idea: To get a tool that can deal with a large amount of data

Software environment - GEO++– Process large number of

channels with many algorithms – Store faithful summary – Triana Tools for retrieval of

results from the database

GEO++ Monitors

SaturationsPower fluctuationsLinesGlitchesCross-correlationsTime-frequency

Raw Frame Data

Environmental sensorsInstrumental monitorsMain h(t) channel

Data Mining using Triana

Display results stored in the database

Page 7: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

GEO++ Main Monitors

• InspiralSenseMon

• GlitchMon

• HACRMon

• LineMon

• PowerTrackerMon

• SaturationMon

• AmplitudeCouplingMon

• PhaseCouplingMon

• CoherenceMon

• BicoherenceMon

Used for ‚real‘ data analysis

Online running monitors, that can be used for

detector charaterisation

For various reasons we do not often use GEO++ / Triana for commissioning (?)

Page 8: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Monitors

Not ‚real‘ data tools, but can give us useful hints for commissioning

• Alarm.vi

• Vacuum.vi

• Drift.vi

• Temperature.vi

Page 9: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Labview Oscilloscope

Page 10: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Data access with Matlab

Page 11: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Noise projections

102

103

10-22

10-21

10-20

10-19

10-18

10-17

Frequency [Hz]

hP(f)MID IM FBMID AA ROTMID AA TILTMID CAL InjMID elec FBMID FB HVAHPD darkSRC FB MSRShot DC IPDPR ampPDOHP amp

Page 12: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Tracking lines

Page 13: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Spectrograms

Page 14: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Transfer functions

Page 15: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Sensitivity per frequency band

Page 16: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

General Tool: Matlab Dataviewer

Matlab-compiler => Stand alone version

Page 17: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Possible data exchange (discussion)

At the moment data access for the use of commissioning seems only to be sensible, if the

commissioners are personally at the site (???)

In future maybe data access for the use of commisioning should also be possible

from a different antenna site(???)

Page 18: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Data access at the site

1. Use one of the computers at the site:

No problem

No problem at all• Everything is in place

2. Use of your personal computer:

• You need to install the software on your computer

• We provide all tools (matlab-files, oscilloscope.vi)

• Access to raw data and frame server

Stand alone data viewer

Page 19: Stefan Hild Ilias WG1 meeting, Hannover, September 2004 DATA TOOLS ‚how can data exchange work?‘ Max-Planck-Institut für Gravitationsphysik (Albert-Einstein-Institut)

Stefan Hild Ilias WG1 meeting, Hannover, September 2004

Data access from outside the side (need ?)

No problem

Allow server access for your personal IP adress

• Probably only access to the hannover frame server available (due to our security philosophy no access to the raw data server in Ruthe)

But now you are outside our domain and behind several firewalls!

• Only use your personal computer (???)

• You need software

• We provide all tools (matlab-files, labview oscilloscope)

Stand alone data viewer