Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 1

Experimental Area Controlsand Data-Acquisition

Gunther Haller

Research Engineering GroupParticle Physics and Astrophysics Division

11 July 2007

v5

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 2

Outline

Hutch Assignments

LCLS versus LUSI Responsibilities

Main Control & DAQ Sub-System Component Descriptions

XES (X-Ray End Station) Control & DAQ Architecture & Components

Team/Organization

Schedule

Budget

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 3

Hutch Assignments

** **

**

AMO: LCLS

PP, XPCS, CXI: LUSI

** SXR Imaging, SXR Pump-Probe, HEDS are not funded at this time

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 4

LCLS & LUSICommon Controls and DAQ System Design for LCLS and LUSI

G. Haller is CAM for LCLS and LUSI Controls & DAQ, including XTOD Controls

LCLS Controls & DAQ W.B.S Common services for all hutches

PPS Laser PPS Accelerator timing interface120 Hz beam-quality data interface Machine protection system interface User safeguards Network interface

AMO experiment (NEH, hutch 2)All controls and DAQ

2-D detector Control and DAQ for detector itself only

LUSI Control & DAQ W.B.SX-Ray Pump Probe, XRPP (NEH, hutch 3)X-Ray Photon Correlation Spectroscopy, XPCS (FEH, hutch 1)Coherent X-Ray Imaging, CXI (FEH, hutch 2)

LCLS & LUSILocal data storage in halls

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 5

Controls & DAQ OrganizationOnline Systems organized into following main blocks

Controls Vacuum, motion, power supply, etc

Science Data-Acquisition Detector readout

Data-Management/Processing Online data movement, processing, feature extraction, filtering

Offline

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 6

Example: AMO Instrument Controls & DAQ

Main Systems

Cameras

Motion

Vacuum

Power Supplies

Detector Data-Acquisition

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 7

Main Controls Sub-Systems

Viewing/CamerasVacuumMotionBias SuppliesGasLaserAccelerator Interface Systems

Timing120 Hz beam data Machine protection system Personal protection system

Infrastructure (Racks, Cabling, Networking)Software Applications

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 8

Viewing/Camera System Block Diagram8 camerasPULNiX 6710CL (648x484, 9um x 9um)Up to 120 HzTriggered by timing signal from timing system event receiver PMC cardCentroid finding software running on VME IOC

Beam Line

EVR Timing PMC

EDT Frame Grabber PMC

VME IOCMVME6100

Ethernet

Devices

Controllers

EPICS IOC

From AcceleratorEVG Timing

Master

Trigger

EDT DV CameraLink PMC card

PULNiX 6710CL camera

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 9

Vacuum System Block Diagram

to MPS

Beam Line or Waveguide

GateValve

IonPump

CC P

Cold Cathodeand PiraniGauges

Hot FilamentGauges

J-Box +A-B PLC

Two Valve Control Panel

Gamma DigitalMultiple Pump

Controller

MKS 937AGauge

Controller

Granville-Phillips Gauge Controller

Allen-Bradley ControlLogix

PLC

Terminal Server

VME IOCMVME6100

Ethernet

Devices

Controllers

PLC

EPICS IOC

HF CP

Interface

2 Turbo-scroll pumps

5 Ion pumps

9 Cold cathode gauges

10 Pirani gauges

Gamma ion pump controller

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 10

Motion System Block Diagram

67 Stepper motors

Beam Line

LVDTStepperMotor

HytecSMDS4-BDriver & Encoder

NewportXCS

Controller

HytecTransition

Card & HytecIP Card &

VME Carrier Board

VME IOCMVME6100

Ethernet

Devices

Controllers

EPICS IOC

Interface

MM

Newport StepperMotor

Driver

HighlandLVDT VME

Module

SLAC LVDTBreakoutChassis

AcromagIP Card& VME

Carrier Board

SLAC 8-CHSolenoid Controller

In/Out Viewing Paddle

Hytec SMDS4-B driver

Newport XCS controller

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 11

Spectrometer Data AcquisitionUp to 8 GHz waveform sampling, 1 usec record or 1-GHz, 500-usec windowAt 120 Hz -> 100 Mbytes/secHigh performance to move or process data Waveform is time-stamped via EVRRespective beam-quality data is attached to each waveformAgilent Acqiris 8-GHz, 10-Bit DC282 cPCI Digitizer Module

Beam Line

Detector

TimingEVR PMC

cPCI IOC

Slow Controls Ethernet

Devices

Controllers

EPICS IOC

Interface

cCPI Acqiris8 GHz, 10-bit

DigitizercPCI Module

EPICS Time,Beam Code

Timing Fiber from

Accelerator EVG Waveform

1G Ethernet Science Data to Local Cache & SCCS

120-Hz Beam-Data from Accelerator

Trigger

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 12

2D Pixel Detector Data Acquisition312 Mbytes/sec raw pixel data at 120 Hz1 day: 27 TbytesData is moved from detector-specific front-end board to XES DAQ box via 4 x 2.5 Gbit/sec fibersXES DAQ box contains custom SLAC CE-board

Virtex-4 FPGA2 PowerPC processors

RLDRAM12 Gbytes/sec cpu-data memory interface10-G Ethernet science data interface1-G Ethernet control interfaceEVG timing fiber interface120-Hz beam-data interface

Realtime correction of raw pixel data

Beam Line

2D- Pixel Detector

TimingEVR PMC

Slow Controls Ethernet

Devices

Controllers

EPICS IOC

Interface

SLAC XES-DAQ Module with Cluster

Element Processor 10G Ethernet

Science Data to Local Cache & SCCS

120-Hz Beam-Data from Accelerator

Trigger

Front-End Electronics

EPICS Time, Beam-Code

Timing Fiber from EVG

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 13

Machine Interface

PPSStandard Allan-Bradley and Pilz PLC’s, implemented by machine PPS group

MPS Standard LCLS MPS pizza-box, inputs from valves, shutter

120 Hz Beam-Quality DataDedicated ethernet or reflective memory

Timing SystemEVR PMC card receiving fiber from LCLS EVG master module

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 14

Applications/Software/ArchiveRTEMS Operating System Tasks

Already ported to VME IOC (MVME6100)Porting to cPCI IOC in progress

EPICS Device Support Camera Motion Vacuum Hall Sensor Temperature VME

ISEG High-Voltage module

cPCI cPCI Acqiris waveform sampling module

Xantrex low-voltage supply (25V, 30A)

EPICS Databases and EDM Screens

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 15

Applications/Software/Archive (con’t)

ArchiveUse standard EPICS archiver for slow controlsDAQ archive requirements mostly completeCollaboration with LSST to decide on underlying tools

Xrootd, MySQL, Berkeley DB etc.Preliminary design started.

High Level ApplicationsCamera centroid findingChannel archiverArchiver viewer Alarm handlerSnapshot/compare/restore Integrated user interface for experiment Spectrometer waveform processing

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 16

Racks

Standard LCLS double-racks

Air-cooling

Plan to have all electronics in hutch

Exceptions are PPS & user-interface racks in control room area

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 17

XES Hutch

X-Ray Transport (Photon Beam)

SCCS

XESprivatesubnet

XesCon

Channel AccessGateway

Data Monitor

EELOG

Beam LineProcessor

XESData

Cache

Linux OS

VME SBC RTEMS

PC

Linux OSPC

EVR VME

Beam Line Data PMC

1 Gb E

1 Gb Enet

1 Gb Enet

TOFSpectrometer

2D PixelDetector

2 DAQ Channels

SBC DAQ

CE Module DAQ

PPC

10 Gb Enet

Experiment IOCs

Controls IOCs& ControllersVME SBC

RTEMS

1 Gb Enet

Experiment Chamber

cPCI ADC RTEMS

RTEMS

Front End Board

1 Gb E

1 Gb E

2.5 Gb Fiber

1 Gb E

1 Gb E

1 Gb E

SLAC WAN (Ethernet)

T-fiber

1 Gb E

cPCI SBC

120Hz Beam Data

Timing Strobe/TriggerTiming EVG (Fiber)

120Hz Data Exchange

Channel Access (Ethernet)

XES Hutch Controls & DAQ Architecture

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 18

Organization

XES Controls & DAQ Systems Manager: G. HallerSchedule/Budget: Bob SassOnline Manager: Amedeo Perazzo (REG)Controls Manager: David Nelson (REG)

Controls Software Lead: Sheng PengRacks/Cabling/AC: Ray Rodriquez (REG)

DAQ Manager: Chris O’Grady (REG)Data Management: Steffen Luitz (SCCS)

Tasks are allocated to control division engineers where appropriatePPS, MPS, EPICS

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 19

Schedule - Milestones

Preliminary Design Review Aug 08, 07Final Design Review Dec 01, 08Start Production Hardware Purchases Dec 01, 07Software Final Design Start Nov 01, 07Start Installation in NEH (L3 PO) Apr 16, 08First X-Ray into NEH (L3 PO) Sep 02, 08Start Installation in FEH (L3 PO) Aug 20, 08

(Gantt charts in review support documentation)

L3 PO: Level 3 Milestone, Project Office

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 20

Photon Systems Controls Budget (Before Contingency)L1 L3 L4 Baseline Re-Baseline

TEC 1.05.02 1.05.02.01 Controls - EPICS 1.05.02.01 Controls - EPICS 1,160 1,5381.05.02 Total 1,160 1,5381.06.02 1.06.02.01 Controls Management 1.06.02.01 Controls Management 502 2,241

1.06.02.07 AMOS Experiment Controls 1.06.02.07.01 AMOS Experiment Controls X1 148 1481.06.02.07.02 X-Ray Fluorescence Detector 130 1311.06.02.07.03 Ion Imaging & Electron TOF 397 4031.06.02.07.04 Sample Source 211 2151.06.02.07.05 Vacuum Controls & Mechanical Exp 1 181 1841.06.02.07.06 Refocus Optics 212 2161.06.02.07.07 Diagnostics 381 388

1.06.02.08 Particle Imaging Experiment Controls 1.06.02.08.01 AMOS Experiment Control X2 75 761.06.02.08.02 X2 Particle Imaging 59 60

1.06.02.10 Global Controls Systems 1.06.02.10.01 Network 261 2601.06.02.10.02 Machine Protection System 84 851.06.02.10.03 Personnel Protection System 348 3581.06.02.10.04 Laser PPS 180 1831.06.02.10.05 User Safeguards 123 1251.06.02.10.06 Timing System 105 1071.06.02.10.07 Data Management 577 5781.06.02.10.08 Global Cabling & Racks 99 1011.06.02.10.09 Laser Timing 1,410 1,0321.06.02.10.10 Experimental High Level Applications 322 322

1.06.02.11 Laser Controls 1.06.02.11 Laser Controls 182 1851.06.02.12 K Measurement Spectrometer Controls 1.06.02.12 K Measurement Spectrometer Controls 39 40

1.06.02 Total 6,026 7,440TEC Total 7,186 8,978OPC 2.06.02 2.06.02.04 Beamline Controls 2.06.02.04 Beamline Controls 607 976

2.06.02.08 R&D: 2D X-Ray Detector Controls 2.06.02.08 R&D: 2D X-Ray Detector Controls 39 382.06.02 Total 646 1,014

OPC Total 646 1,014Grand Total 7,831 9,993

Amounts in Thousands $WBS LEVELSCONTROL ACCOUNT

TEC: Total Estimated Cost

OPC: Other Project Cost

TPC: Total Project Cost

Dr. Gunther Haller

XES Controls & DAQ haller@slac.stanford.edu

11 July 2007 21

Summary

Described XES Controls & DAQ ArchitectureSelected Specific Controller Candidates for most AreasMoving and Processing Science Data is Key Data-Acquisition task

AMO data acquisition via 10-bit 8-GHz cPCI waveform sampling modules2D-Pixel detector acquisition via SLAC XES DAQ Module

Presented Budget and ScheduleNo Technical Risk ItemsControls and DAQ will be in place when required