ESE budget 2011-2012

Simon Kwan, Gustavo Cancelo

2011 numbers

Obligated Spent Obligated Spent Obligated Spent Obligated SpentDAQ/Eng Total % 92% 97%

Total $ & FTE 191650 175405 869172 781740 15.6 15.2 1060822 957145Licenses 38100 40543PC supplies 16000 9460New Equip 98500 100898Travel 25000 15000NOVA 2.42 2.76 14.0CMS 1.24 1.46 17.7Proj. X 0.84 0.24 71.4u2e- 1.31 1 23.7LLRF-NML 1.44 0.35 75.7LLRF Ctrls 55850 45356 0.34 0.265 22.1KA 15CCD R&D 10000 10801 75932 125217 0.6 1.08 80.0DAQ R&D 0.15 0.77 413.3VRTX Det 73744 56761 0.71 0.55 22.5MTest 81236 11692 0.72 0.12 83.3Opto R&D 88415 90653 0.74 0.83 12.2xTCA R&D 167496 87584 1.33 0.78 41.4Eng Tools 68102 48225 0.38 0.31 18.4PREP 20000 12000 252147 159318 2.35 1.58 32.8TeVAD Operations 9130 1743 0.07 0.013 81.4D0 0.41 1.12 173.2CDF 0.33 0.9 172.7DAQ INFRA 0 0.89TeV BPM 0 0.03ESE Mgmt 0.08 0.09 12.5COUPP Eng. 5230.21 1358.15 0.12 0.0125 89.6LBNE-LAr 0.01 0.01 0.0

Balance in %

Project Breakdown

M&S ($) SWF ($) SWF (FTE) Total budget ($)

2012 numbers

• a

Breakdown Obligated Spent EE Tech Scient. TotalDAQ/Eng Total %

Total $ & FTE 223100 10.38 7.17 0.5 18.05Licenses 46750PC supplies 16000Hardw. Comp 13500New Equip 75000Travel 25900Training 10000NOVA 0.86 0.99 1.85CMS 0.77 1.06 0.5 2.33Proj. X 0.43 0.32 0.75u2e- 1.5 0.5 2LLRF-NML 0.61 0.2 0.81LLRF Ctrls 0.2 0.14 0.34LLRF ILC 0.24 0.24

KA 15CCD R&D 13900 0.78 0.81 1.59DAQ R&D 0.15 0.15Eng Tools 0.38 0.38VRTX Det 0.64 0.25 0.89MTest 0.43 0.32 0.75Opto R&D 0.51 0.51xTCA R&D 0.24 0.33 0.57

PREP 20000 1.5 2 3.5New Initiatives 0.74 0.17 0.91ESE Mgmt 0.4 0.4PC Infra. 0.08 0.08DAQ INFRA 0.25 0.35 0.6LBNE-LAr 0 0

M&S ($) SWF (FTE)

Rick Kwarciany 4

2011 NOvA DAQ Hardware Accomplishments

• Hardware and Firmware development of DCM, MTDU, and STDU modules completed (DAQ and Timing modules).

• Prototype hardware deployed and working at NDOS detector.

• Work on hardware production run under way. Expect production quantities early calendar 2012.

• Abstract for CHEP paper on Timing System submitted.

• FTEs: 2.67

NOvA DAQ Hardware

Rick Kwarciany 5

NOvA DAQ Hardware Plan for 2012

• Oversee production of DAQ and Timing modules.

• Test and qualify production modules.

• Assist as needed with installation and integration.

• Address any integration issues at Near and Far detectors.

• Proposing upgrade to Timing System so NOvA can confirm or refute CERN’s Neutrino speed results.

• Travel to Ash River, MN foreseen for 2 – 3 people, 2 – 3 trips each.

NOvA DAQ Hardware

Rick Kwarciany 6

DCMs Installed at NDOS

DCM

FEB

NOvA DAQ Hardware

Mu2e - 2011

• Mu2e is in the proposal stage (pre-CD1).

• ESE and CET departments are collaborating on the DAQ system (~ 1 FTE during 2011).

• High rate DAQ system design (100 GBytes/sec).

• Work involved DAQ System Conceptual Design, Project Cost and Scheduling.

Mu2e - 2012

• Looking at ways to reduce costs to meet TPC goal.

• Project CD-1 Review is now planned for mid-year.

• Reduction in beam power → lower DAQ data rate (~30 GBytes/sec).

• 80% of DAQ cost is labor, so we will be limited to 2 FTE for hardware development (more reliance on commercial components) and 2 FTE for software (more reliance on scientific labor) during project implementation.

Detector

DAQ

Slow Control

Fast ControlClockControl

EVB Network

DTC

Processor

Gen

eral

Pur

pose

Net

wor

k

…Readout

Controller

Accelerator

Beamline, Control Room (WH), Offline Processing

& Storage (FCC)

……

……

……

Timing

ROC DTC

EVB

Network

Processor

Detector

Mu2e Detector and DAQ (proposed)

LBNE - 2012

• If Liquid Argon technology is selected for LBNE, the DAQ and Timing systems could be based on current NOvA hardware.

• LBNE may request help (< 0.5 FTE in 2012) to evaluate and modify (if necessary) the NOvA hardware.

ILC LLRF 2011• Long bunch train with heavy beam loading experiment at DESY-FLASH.

– 1.2 GeV, electron beam up to 9mA of DC current.– 15 x 8 hr shifts in Feb 2011.– Focus on LLRF control and individual cavity tilts (FNAL lead).– LFD and microphonics compensation with fast piezo-tuners (DESY lead).– Lots of data analysis. 16 TB of data.– Extensive analytical modeling and simulations.

• Collaborators: DESY, KEK, FNAL, SLAC, ANL.• 2nd Workshop on long bunch trains with heavy beam loading.

– ESE: Gustavo Cancelo. Two talks, management, planning.

• Several publications in LLRF workshop 2011.• Publication in ILC News and Fermi Today.• ESE workload: 0.25 FTE.

DESY – FLASH layout

ILC LLRF 2012

• Goal: Continue working to determine a safe state space for running at high energy and heavy beam loading with energy stability of 0.1% and VS phase better that 0.02 degrees.

• Next test: February 2012.• 3rd workshop planned in 2012.• ESE workload: 0.25 FTE.• ILC EDR by end of 2012.• 9mA program to continue beyond 2012.

NML LLRF 2011

• Plan: LLRF control of CC2 and cryomodule CM1.– Alignment to Project X 3-8 GeV pulsed LINAC.– Demonstrate long pulse operation.

• Major challenge: cavity resonance control (LFD and microphonics).• Achieved in 2011: 8ms pulse, 4ms cavity filling and 4ms flattop at HTS (Meson).

• ESE workload: 1.5 FTE.– ESECON firmware development and operation.– Analytical developments and simulations.

• Accomplishments: Novel proposal for setting RF accelerator parameters.

• Publications: LLRF 2011 and 2nd workshop on LBT Operation.• Education and outreach: summer student from Pisa.

NML LLRF 2012

• Goal: LLRF control of CC2 and cryomodules CM1 and CM2.– Alignment to Project X 3-8 GeV pulsed LINAC.– Demonstrate long pulse operation.

• Major challenge: cavity resonance control (LFD and microphonics).

• 8 and 30ms pulse.

• Very important for Project X. Could eliminate the recycler and inject directly into the main Injector. $$$ savings and reliability ↑↑.

• ESE workload: 1.5 FTE.– ESECON firmware development and operation.– Analytical developments and simulations.– Tests.

Project X 2012• Goals:

– Design HLRF and LLRF for low energy (CW) and high energy (pulsed) Linacs.

– Low energy Linac challenges:• 3 different RF frequencies.• Small cavity bandwidths. 650 MHz is the most critical system.• Beam longitudinal dynamics stability up to 5mA.

– 3-8 GeV Linac challenges:• Stability of the longitudinal dynamics at 1 and 2 mA and several pulse length scenarios.• 30ms pulses would allow direct injection into the Main Injector bypassing the recycler.• The recycler injection is 8GeV +- 30KeV. Lots of issues (higher cost).• Main injector injection is 6 to 8 GeV.

• ESE workload: 0.75 FTE.– ESECON firmware development and operation.– Analytical developments and simulations.

PREP 2011• Tactical plan: Provide & Support Electronic Instrumentation for HEP research experiments

according to agreements (MOU's) approved by management. • Statistics:

– PREP currently has ~45k HEP electronics items in the inventory for a value of ~60M$ and a replacement value in excess of 100M$.

– 20% of these items are presently signed out to users. – Another 10% are now being returned to the pool from the collider– Users include: running experiments, a large number of "test stands" used for detector

development, maintenance and repair. PREP also currently supports 53 offsite loans. – The present level of activity is 50-100 new items per month signed out by non-collider

users.• The number of ESE/PREP technicians has shrunk precipitously over the past two years from 6

to 1 when Rick Mahlum retires on 12/6/2011. • Accomplishments and difficulties:

– The impact of the tevatron shutdown, together with the startup of multiple test beam experiments, has overextended our capacity to keep up with demand. Increasingly, we have resorted to asking experimenters to test basic issued equipment.

• The Minerva Incident Root Cause Analysis led the implementation of several recommendations including the improvement of several PREP manager tools and a CD homepage PREP link.

PREP 2012• Finalize the work of the advisory PREP taskforce and generate a

report to division and sector management.• 2012 PREP staffing:

– Generate an opening for one entry level electrical technician for PREP (now). – Work with PPD/EED in a loan of two technicians who can each work half time with

ESE to deal with the immediate work load and mentor the junior tech.– Pursue hiring a second new entry level electrical tech to join the team. – Once the work load is under control the PPD techs can return to full time PPD

work. – Goal:

• Management: Forster (full time, to cover other management functions besides PREP). Cooper (half time)

• Technicians 3 (full time).

• Tactical plan:– Continue supporting running and future experiments.– Tight interface with PREP counter/pool.– Help in decommissioning of TeV and TeV experiments.

Detector R&D (KA15) 2011-2012

• DAQ: CAPTAN, xTCA.• CCD.• Vertex Detector.• Optoelectronics.• ESETOOLS.• Future experiments.

• Budget 2011: SWF ~$500, M&S ~$15K.

• Budget 2012: SWF ~$600 (~5 FTEs) , M&S ~$100K– Major increases in 2012 for CCD R&D SWF: $200K, M&S $13.5K and

Vertex Det. SWF $150K

CCD R&D 2011• Low noise readout: 0.5e- of noise achieved (x4 better than CDS).

– FPGA estimator implementation achieved for 16 modes. Noise <1e-.– What is the benefit of a sub electron noise readout?

• DAMIC: number of WIMP recoils grow exponentially at lower detection energies.• Coherent neutrino scattering: Can beat the large background.• Telescope’s area is inversely proportional signal to noise ratio.

– Spectroscopy: very low signal.

• Neutron Imager: we took > 500 images with two different CCD-Boron-Cd packages.• Collaborators: Fermilab, U.Chicago, Purdue, Spain, Argentina, Brazil, Paraguay, Mexico.• Publications: 4 papers submitted to Experimental Astronomy.• Two Detector R&D Research Technique Seminars.• Students: Fermilab international Fellow, x2 summer (Italy), Master student UIC, 2 high school

students.• Outreach: Instrumentation schools Bariloche and Buenos Aires (Argentina).

X-ray image taken with FPGA (Ted Zmuda).

CCD 2012

• Low noise readout: can the 0.5e- of noise be lowered?– New electronics for Monsoon.– Improve estimator in FPGA.

• DAMIC: New dewar for 10 CCDs.• Neutron Imager: Take neutron imager to Bariloche, Arg.• Coherent neutrino scattering: Build a 10 CCD dewar and take it to a reactor in

Illinois or Angra, Brazil.• Students: Continue working with students.• Outreach: Instrumentation school at FNAL Feb. 2012.

• New opportunities for cosmic frontier: Microwave Kinetic Inductance detectors (MKID) for Dark Energy.

CAPTAN DAQ

21

Pixel Test Beam TelescopeAt FTBF

T980 Crystal Collimation Installation at E0

Also…1. QIE10 Single Event Upset Testing at Massachusetts General Hospital2. Customer Deliveries and Support to INFN (Milano, Lecce), Purdue, Colorado

Objective: Utilize Modular CAPTAN DAQ Technology in a Variety of ApplicationsPresentations: T980 and Test Beam Telescope Results presented at TIPP2011.Collaborators: INFN (Milano, Lecce), Purdue, Colorado, FNAL (AD, PPD)Student Participation: Jennifer Ngadiuba (INFN-Milano)Outreach: Simon was a professor at the EDIt2011 school at CERN. Ryan Rivera demo’ed CAPTAN at SuperComputing 2010 (New Orleans)

xTCA

22

Objective: Migrate Modular DAQ Technology to High Reliability mTCA StandardCurrently being tested with commercial mTCA shelf and low cost Module Management

Controller

Advanced Mezzanine Card (AMC) as mTCA Carrier for CAPTAN NPCB

mTCA and CAPTAN Integration

• xTCA work group, led by SLAC and FNAL, completed two specifications in 2011,– PICMG 3.8 - RTMs for ATCA and MTCA.4 - RTMs for uTCA.

• The group also had started work on a timing distribution specification for ATCA but has shelved that effort for lack of proponents. The specifications were ratified by PICMG early in FY2012. For this year the group expects to quickly address Change Requests and then go dormant.

Simplified Schematic (Complete)

Compact Layout (In progress)

Common POH (BPIX and FPIX)

Pixel OptoHybrids for CMSPhase 1 Upgrades

Analog OptoHybrid Testing at 400 Mbps

Objective: Develop Common (for FPIX and BPIX) Pixel OptoHybrid for Phase I UpgradesCollaborators: CERN, PSI, Purdue, FNAL (PPD).

23

Versatile Link Common Project

24

Parallel Optical Engine Evaluation Optical Engine Mezzanine Card Design

OMARx Sens

ER_Tx

Eye_Tx

1/Rise_Tx1/Fall_Tx

1/TJ_Tx

1/DJ_Tx

1/TJ_Rx

1/DJ_RxAv1Av2Fin 2Finr 1Finr 2Finr 3Finr 4Finr 5Opt 1Opt 2Sum 1Target

SFP+ CharacterizationSFP+ Component SpecificationParallel Optical Channel Specification

Objective: Identify and Characterize Off Detector Components for Optical Data CommunicationsPresentations: Parallel Optics Results presented at TIPP2011, TWEPP2011.Collaborators: CERN, SMU, Oxford. Partnerships with multiple vendors of optical technology

have been formed to support this work.Visitor Participation: Melissa Winchell (U.S. CMS Teaching Fellowship) with NSF funding.

Phase Control

Vmod

3dB Optical Splitter

10-40Gbps Data Rate

InP substrate

Input Fiber:

CW laser

Output Fiber:

10-40Gbps signal

Rad Hard Optical Links Collaborations

Silicon Detector

Silicon Detector

Silicon Detector

10 Gb/s Optical Transmitters at

different wavelengths MEMS

Steerable Mirrors

10Gb/s Optical Receivers

350 mm

550 mm

1100 mm

Beam Line Center

Objective: Collaborative Effort to Develop Low Power/Low Mass MultiGigabit Data Readout for HEP (based on indirect modulation, free space optics, or rad hard VCSEL arrays)

Collaborators: Argonne, U Chicago, Vega Wave Systems, U Minnesota, SMU, Ohio StateCollider Detector R&D Program Proposal Submitted in March, 2011.

Rad Hard Mach Zehnder Modulator Free Space Optical Links On Detector

25

Summary

• ESE continues being one of the most respected EE Departments in the world of HEP. Providing:– Quality electronics hardware and firmware.– Science: Detector and Accelerator R&D.– Leading several fields in HEP with innovative concepts and ideas, and publications.– Servicing the HEP community with new developments and the PREP.– Keeping strong ties with most FNAL engineering and physics Departments.– Maintaining close collaborations with Univ. and Labs around the world.– Educating students and outreaching the community.– Participating of Lab wide committees, review panels.– Collaborating with DOE reviews, publication refereeing, other lab advisory programs, conference organization, etc.

• Our way of collaborating and a commitment to high quality and safety is what keeps ESE strong.• Deficit: Lack of a software engineer for R&D projects (Detector and Accelerator).

– Project X tests at NML and Meson– Fast and high precision A/D conversion R&D for Detector R&D.– Some test stands.

Thank you for your attention!