![Page 1: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/1.jpg)
© 2013 Paul Scherrer Institut Slides available at http://people.web.psi.ch/ischebeck
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner, Helge Brands, Rasmus Ischebeck
>The Past
>Accelerator Data Acquisition
>Design Ideas
!
>The Present
>Available Tools
>Demo
!
>The Future
>Data Acquisition with Large Data Sets at 100 Hz
�1
P A U L S C H E R R E R I N S T I T U T
DATA
Compute-Node
Results
Results+Data
IOC
AFS
EPICS Control+Preview
camera
workstation
control room
![Page 2: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/2.jpg)
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
What Came Before…(my personal collection of accelerator data acquisition)
>TESLA Test Facility at DESY, Hamburg
>Access to accelerator process variables from MATLAB, C++ (read/write)
>Easy to write data acquisition software, scan parameters, record variables…
>Data stored in .MAT, ASCII & ROOT files
>No common data format
>Experts required to set up scan, analyze data…
>SLAC LINAC at Stanford, California
>VAX-based control system
>Scan software to determine the dependency of a variable on a parameter
>On-line display & fits
>Writes MATLAB 4 files for further analysis
�2
![Page 3: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/3.jpg)
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
Design Goals>Have a universal scan and data acquisition software
>Well-tested scan core
>Universal GUI to set up scan easily
>Specialized GUIs for easy access for regularly performed scans
>Error checking and treatment
>Common HDF5-based file format for easy access from any data analysis code
>Automatic generation of logbook entries
>Link to auxiliary information on accelerator configuration
>Synchronized data acquisition
�3
![Page 4: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/4.jpg)
Rasmus Ischebeck
Data File Format>Hierarchical format to store Instruments >Based on HDF5 >Readable from Matlab, Root, Mathematica…
�4www.nexusformat.org
![Page 5: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/5.jpg)
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
Accelerator Data AcquisitionMany accelerator measurements consist of the following tasks: >Control 0…N actuators >Acquire 1…M measurements >Analyze data !
Important features >On-line analysis >Reasonable error handling >Robust code for use by other
persons than the programmer
�5
Accelerator
Actuator
Measuring
Devices
Input
Output
Controllers
Ethernet
Operator Console
EPICS
![Page 6: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/6.jpg)
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
ADAQA Layers>ADAQA consists of several
separate building blocks >Applications, written by different
programmers, make use of the same data acquisition code
>Instruments gather connected devices
>Logbook >Common data storage format >Online model* >Device information server* >Synchronized data acquisition !
!
!
!
* ongoing work, not yet ready for prime time
�6
ADAQA
daq.m
Epics
Device Servers
Instruments
Application
Layer
Data
Acquisition
Layer
Device
Layer
Logbook
Data Storage
Device
Information
Server
Synchronous
Data
Acquisition
Online Model
![Page 7: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/7.jpg)
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
ADAQA Layers >Tree-like structure:
>Many devices (roots) >One data acquisition core (trunk) >Many applications (branches) !
>Building blocks can be exchanged
�7
Devices
Data Acquisition
Applications
Wikipedia
![Page 8: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/8.jpg)
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
Synchronized Data Acquisition>All VME crates for diagnostics are equipped
with an Event Receiver >Connected with a star topology network to
the Event Generator >Supported for:
>BPMs, Bunching monitor, RF, … >Ongoing work:
>Laser shutter, oscilloscopes, cameras
�8Sven Nordquist
![Page 9: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/9.jpg)
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
•ScreenMonitorTool!•General Purpose Scan Tools!•Specialised Scan Tools!–Slice Emittance!–Optics Matching!–Slit Scan!–…!!
• “Do it yourself! - Scan Tools
ADAQA Applications
![Page 10: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/10.jpg)
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
•General purpose camera display and analysis tool!• In every day use for different kinds of cameras and screen monitors
ScreenMonitorTool
Dione and Saturn http://www.ciclops.org
![Page 11: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/11.jpg)
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
General Purpose Scan Tool
![Page 12: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/12.jpg)
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
the future…
![Page 13: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/13.jpg)
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
•Scans can be stored in Template files!•The last scan is always stored as template!–“Repeat Last Scan…”-Button!•Data files are scan templates as well!–All scans can be exactly repeated!!
•Templates can handed over to the scan tool at startup!–example: extracted charge vs. gun phase scan
Scan Templates
![Page 14: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/14.jpg)
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
Specialised Scan Tools
![Page 15: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/15.jpg)
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
Specialised Scan Tools
![Page 16: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/16.jpg)
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
Automatised logbook entries
![Page 17: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/17.jpg)
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
•General and specialised scan tools are possible with ADAQA!–a wide variety of tools is available!!
•Common data format!•Templates!–data files are templates – for all tools!•Actions!–e.g. automatic screen insertion or background subtraction!•Analysis functions!!
•Automatic logbook entries
Scan Tools Summary
![Page 18: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/18.jpg)
+ SwissFEL+ SwissFEL
SwissFEL Meeting 24.1.2013
knob{1} = LoadKnobDefinition('ManagementKnob'); % setup Knob and Instrument knob{1}.SetpointValues = [1, 2.4, 3, 3.78, 92]; % scan setpoints !
instrument{1} = LoadInstrumentDefinition('SwissFEL_Meeting_Demo'); !
Setup.Function = 'scan'; % define scan setup Setup.Repeat = 10; % “shots” per scan step !
Info.Author = 'Beutner'; % human readable info Info.Title = 'SwissFEL Meeting Demo'; Info.Purpose = 'this is a small scan tool for demo...'; !
[DAQFileName, Setup, knob, instrument, Info] = ... daq(Setup,knob,instrument,Info); % execute scan !
% …insert your analysis code here…
Do it yourself! - Scan Tools
![Page 19: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/19.jpg)
Image based measurements: today
IOC
AFS
EPICS Control+Data
cameraworkstation
Helge Brands
control room
![Page 20: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/20.jpg)
Image based measurements: today
Problems: • available buffers on IOC are not used • „lost“ of measured data • high frequencies can‘t be reached • high CPU load on workstations
Helge Brands
IOC
AFS
EPICS Control+Data
cameraworkstation
control room
![Page 21: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/21.jpg)
Image based measurements : future
DATA
Compute-Node
Results
Results+Data
IOC
AFS
EPICS Control+Preview
cameraworkstation
Helge Brands
control room
![Page 22: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/22.jpg)
Why?
•less radiation
•higher recording speed (10Hz/100Hz)
•independent of the workstation (CPU and memory)
•system is similar to SLS (Tomcat, in operation, 1* PCO Edge)
Helge Brands
![Page 23: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/23.jpg)
Why?
•less radiation
•higher recording speed (10Hz/100Hz)
•independent of the workstation (CPU and memory)
•system is similar to SLS (Tomcat, in operation, 1* PCO Edge)
BUT
Helge Brands
![Page 24: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/24.jpg)
Technical values
example: ~30TB/week
more storage needed
Helge Brands
![Page 25: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/25.jpg)
Specs
storage size/speed
network (camera IOC)
IOC local memory
compute nodes
WHLA Test-Injector
558 GB/50MB/s
1Gb/s 16GB ~3000 pic
1-2
SwissFEL (?)/(?) 10Gb/s (?) min. 5-10
Helge Brands
![Page 26: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/26.jpg)
Current situation
•WHLA: each Camera-IOC has 1GB/s (enough for 10Hz) •3 PCO Edge in operation + 1 PCO Edge in preperation
•upload to AFS max 50MB/s
•software is ready for 100Hz
•needed network speed 10GBit/s for 100 Hz
•other GIGE cameras can be used too
•additional compute nodes should be planned
•storage policies are needed
Helge Brands
![Page 27: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/27.jpg)
>Project started in 2008, always between 5 and 10 developers >Written mostly in Matlab >89093 lines of code (including code sourced from MathWorks Central and other external sources) >Performed 22775 scans, resulting in 558 GB of data >A joint project between the Controls, Beam Dynamics & Diagnostics Sections at PSI
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
ADAQA
�27
ADAQADiagnostics Controls Beam Dynamics
![Page 28: P AUL SCHERRER INSTITUT ADAQA An Accelerator Data ... · Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner,](https://reader030.vdocument.in/reader030/viewer/2022040713/5e19cd7228f8ca386f58d645/html5/thumbnails/28.jpg)
© 2013 Paul Scherrer Institut Slides available at http://people.web.psi.ch/ischebeck
Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA
Outlook> We are looking forward to many new
applications for SwissFEL!
!
> Thank You to:
> all ADAQA programmers and users, in particular Eduard Prat, Marta Divall, Peter Peier, Marc Guetg, Gian Luca Orlandi, Bennie Smit & Thomas Schietinger
> support from Jan Chrin & Babak Kalantari
�28Sven Nordquist