glast lat infn...•hodoscopic csi calorimeter(cal) array of 1536 csi(tl) crystals in 8 layers....

Frascati 5 aprile 2007 F.Longo

GLAST LAT GLAST INFN

GLAST LAT INFNGLAST LAT INFNScientific Data Analysis

Francesco LongoUniversity and INFN, Trieste, [email protected] behalf of the Italian collaboration

Gamma-ray LargeGamma-ray LargeArea SpaceArea SpaceTelescopeTelescope



GLASTGLAST

Two GLAST instruments:LAT: 20 MeV – >300 GeVGBM: 10 keV – 25 MeV

Launch Readiness Date14/12/2007



The systems work together to identify and measure the flux ofThe systems work together to identify and measure the flux ofcosmic gamma rays with energy ~20 cosmic gamma rays with energy ~20 MeVMeV ~ ~300 300 GeVGeV..

Components of the LATComponents of the LAT

e+ e–

γ

ACD[surrounds4x4 arrayof TKRtowers]

Calorimeter

Tracker•• Precision Si-strip Tracker (TKR)Precision Si-strip Tracker (TKR)

18 XY tracking planes with tungstenfoil converters. Single-sided siliconstrip detectors (228 µm pitch, 900kstrips) Measures the photondirection; gamma ID. (INFN key role)

•• HodoscopicHodoscopic CsICsI Calorimeter(CAL) Calorimeter(CAL)Array of 1536 CsI(Tl) crystals in 8layers. Measures the photon energy;image the shower.

•• Segmented Anticoincidence DetectorSegmented Anticoincidence Detector(ACD)(ACD) 89 plastic scintillator tiles.Rejects background of chargedcosmic rays; segmentationmitigates self-veto effects at highenergy.

•• Electronics SystemElectronics System Includes flexible,robust hardware trigger and softwarefilters.



OutlineOutline

• Data from the LAT– the ISOC– L0 processing– Automated Science Processing– Catalog generation

• Scientific Performance– The role of the Calibration and Analysis WG– Data Monitoring– Performance Definition & Monitoring– Background Monitoring

• Science Working Group Activities– GLAST SWG– AGN– DM– GRB– PSR/SNR– Solar System

GLAST sky



ISOC Data AnalysisISOC Data Analysis



GLAST MISSION ELEMENTSGLAST MISSION ELEMENTS

GN

HEASARCGSFC

-

-

DELTA7920H •

White Sands

TDRSS SNS & Ku

LAT InstrumentScience

Operations Center

GBM Instrument Operations Center

GRBCoordinates

Network

• Telemetry 1 kbps•

-•

S

Alerts

Data, Command Loads

Schedules

Schedules

Mission Operations Center (MOC)

GLAST ScienceSupport Center

• µsec•

•

•

GLAST Spacecraft

Large Area Telescope& GBMGPS

GLAST MISSION ELEMENTS



ISOC OperationsISOC Operations• LAT commanding & interactions with the Mission Operation Center

– all uplink rates for commanding and downlink rates for telemetry– FSW messaging control– Real-time telemetry and Level-0 files will be sent to the ISOC

• Orbit Timeline and Activity Planning– LAT 60-day outline plan is incorporated into Observatory Timeline

• LAT FSW update• Data Processing

– L1 pipeline• Now incorporating interpretation of pointing, location information from

spacecraft• The L1 pipeline tasks now register their data sets (by run number) with

the Data Catalog.– ASP (Automated Science Processing) (INFN Pisa, Perugia, Trieste)

• ASP processing for GRBs• ASP algorithms for flaring source detection and monitoring• Need confirmation by Shifters and WG experts

• Assume 450 Hz effective data rate– L0 downlink (1.2 Mb/sec) is 5 TB/yr

• Assume all downlinked events kept– ~1-2% good photons!

• Data Volume ~ 150 TB per year



ISOC Science OperationsISOC Science Operations• Monitoring

– Fast Monitoring• The architecture for a 'fast monitoring' system to interpret pre-

digi LAT data (INFN Pisa)• Heritage from tools developed for the beam test

– IRF Monitoring Working Group• Monitoring the effective area, PSF and energy dispersion

(INFN Perugia, INFN Padova)– The background monitoring working group has used recent large

background simulations to investigate how the primary protonand albedo lepton (at low and high energies) backgrounds couldbe monitored (INFN Bari)

• Optimization– Impacts of (simulated) failures of LAT hardware on the science

data quality and rates are being investigated (INFN Bari)• Operations

– Daily Operations Group working on Control Room tools anddocumentation.

• Next ISOC workshop at SLAC: 30 April – 2 May 2007– Intended focus on operations planning



Data PortalData Portal

• Provide collaboration access to both summary“photon” data and full digi/recon/(MC) data

– Provide data in both FITS and Root format

• Main components– Astro Data Server

• select events based on position in the sky,energy, time, or event class

– Data Pruner• Select events based on “TCut” able to

access full merit tuple (200+ columns)– Data Peeler

• Access full data for list of runs/events– Event Display (WIRED)

• View detailed detector response for list ofruns/events

• New Data Catalog Available now– Web interface

• Link to data server– Pipeline II interface

•http://glast-ground.slac.stanford.edu/DataCatalog/



IN2P3

SLAC

Pipeline II InfrastructurePipeline II Infrastructure

PipelineServer

OraclePipeline Web

Interface

CommandClient

Job Control

Job Control

Data CatalogCatalog Web

Interface BatchFarm

BatchFarm

INFNJob Control

BatchFarm

Data Portal

Test Beam data L1 data processing

High Level Data AnalysisSimulations

INFN Trieste, INFN Pisa



Catalog GenerationCatalog Generation

• Source detection– The three most successful so far are image based methods

(MR_filter is the current front runner, PGWave and theoptimal filter are also faring well), called on several areas ofthe sky and several energy bands. (INFN Perugia)

• Source characterization– Likelihood package, called repeatedly over many areas of

the sky and several iterations run in parallel.• Source identification

– This uses a versatile Science Tool developed for thatpurpose (gtsrcid).



LAT source LAT source catalogcatalog timeline timeline

Launch One-yearLAT catalog4 months 8 months 15 m

Science ToolsEvent selectionIRFs

Diffuse emission model

Science groups

3-month catalogBasic list of sources

6-month catalogBands, light curves,

automatic IDs

AOExtended sourcesGRB positionsValidated IDsNew figures of merit



INFN key rolesINFN key roles

• Data fast Monitoring– Mapping “Electronics” Space

• Performance Monitoring– Impact of failures (ACD, TKR, CAL)– IRFs high level monitoring (PSF, Aeff, Energy Resolution)– Background and Trigger Monitoring

• Data Processing– Pipeline Management

• Science Operations Coordination• Source Detection Methods development



Scientific PerformanceScientific Performance



Trigger and OnboardFilter (wrapped FSW)

Components of the AnalysisComponents of the Analysis

Particle Generation and Tracking

Instrument Response(Digitization), Formatting

background fluxes

Event Classification

Performance

High-levelScienceAnalysis

DetectorCalibration

Event Reconstruction

gamma-ray sky model



The BackgroundThe Background total flux galactic CR proton flux He+CNO flux galactic CR e+/e- flux albedo p+pbar flux albedo e+/e- flux yellow is the albedo gamma fluxaverage rate (Hz/m^2) 8531

e+ Annil. Event

Irreducible: 63% Reducible: 37%



Event Analysis

Structure much simpler: only 7 CTs

Sections focus attention on critical sub-system components Greatly improved flexibility for defining events classes Results in 3 probability variables - 1 per section All events retained to facilitate event class definition and improve efficiency. Energy reconstruction selection

select best energy method (among 3) PSF- Image control

select best gamma direction

INPUT

OUTPUT



GLAST LAT PERFORMANCESGLAST LAT PERFORMANCES

Pass 5 v0 v1

UpdatedUpdated Performance Update TimelinePerformance Update Timeline

March April May June July Aug

Merit variables completed and tested by April 6• irreducible tags• multi-gamma event variables• DOCA to screw holes•Fix errors in Active Distance calc.'s

Proto RUN: 2-3B bkg. events, plus AG and diffuse1st Flight RUN: 20-50B bkg. events plus AG and diffuse

Pre-launchanalysisbase-lined

Simulation Fidelity•CAL per channel peds/gains/zero-suppression thresholds• CAL recon robustness tweaks• Spacecraft and other geometry updates• OBFs & Trigger

Beam Test Feedback• Tracker Clusters• CAL Normalizations• ACD?• Backgrounds: Hadronic Interactor

Proto RUN 1st FLIGHT RUN

Mostly Completed

Iterate andcheck P5

analysis. FINALby 1 Aug

Reprocess for new CTBvariables, start 1 May. InterimP5 IRFS by mid-May

Completed

Upgrade toGR v10r1Root 5.14



Data Set SummaryData Set Summary

EnergyParticle

1, 1.5GeV/n, + Xe on targetC, Xe

20GeVπ

6, 10GeV (also throughMMS), 20,100 GeV

p

1GeV (through MMStarget)

e+

1, 5,10,20,50,100,200,280GeV

e-

0-2.5 GeV γ

4 weeks at CERN-PS/T9, 26/7-23/811 days at CERN-SPS/H4, 4-15/91 week at GSI60 people active in data taking

330configurations

CU registerconfigurations

Rate

impact point

Incoming angle

100M evts1800 runs

survivors packing the CU after final data taking campaign at GSI



Beam Test Data Analysis outcomeBeam Test Data Analysis outcome

• New TKR digitization algorithm for MIP and ions• New CAL calibration procedure for the LAT• Detector model material review

– W thickness– Honeycomb– Interfaces (glues, CF mechanics …)

• Elements for on-orbit calibration of CAL and ACD• Improved hadronic physics list• BT data available for testing different algorithms (E recon,

trigger)• Timeline for changes coordinated with C&A group

– Envisage several iterations– Should provide final implementations by end of may




• Event Analysis– Geant4 simulations– TKR digitization– Bkg rejection & Classification– IRF Modeling

• Beam Test Data analysis– TKR hits– CAL showers– G4 validation

• EM & Hadronic Physics– PSF, Classification Trees

• General Analysis Coordination



Service Challenge ActivityService Challenge Activity



Service ChallengeService Challenge



The group pictureThe group picture

• 7596 sources + Galactic and extragalactic diffuse + Dark mattersources

• Some Stationary, some transient, some quasi-periodic, some extended

An all-sky counts map, false color (red: 100-400 MeV, green: 400-1600 MeV, blue: >1600 MeV)




• Sky Model generation and Validation– INFN Pisa, INFN Padova, INFN Perugia, INFN Trieste– GRB– PSR/SNR– DM– Solar– AGN

• Observation Simulation Pipeline generation (INFN Pisa)• L0 simulation and data check (INFN Bari)• Data analysis (all)• Distributed MC generation (INFN Trieste, INFN Pisa)



Science Working GroupsScience Working Groups



GLAST LAT ScienceGLAST LAT Science

• Science Working Groups– Calibration and Analysis Methods (L.Latronico, P,Bruel)– Blazars and other AGNs (G.Tosti, B.Lott)– Diffuse and Molecular Clouds (T.Porter I.Grenier)– Catalogs (S.Digel, I.Grenier)– Pulsars, SNR and Plerions (R.Romani, A.Harding)– GRB (N.Omodei, V.Connaughton)– Sources in the Solar System (G.Share, F.Longo)– Unidentified sources, populations and other galaxies

(P.Caraveo, O.Reimer)– Dark Matter and new physics (J.Conrad, R.Johnson) (just rotated A.Morselli, E.Bloom)

• Satellite groups– Multiwavelength– GeV-TeV connection



General ActivitiesGeneral Activities

• Organize meetings– VRVS every ~ 2 weeks– F2F meeting (during collaboration meetings, GLAST

workshops,…)• Drive the science activities and analysis• Organize multi-wavelength Campaign

– preparing proposals to be submitted to other observatories• Organize Conference participations

– GLAST LAT Speaker’s Bureau athttp://glast.pi.infn.it/SB/SBmain.html

• Identify papers to publish



Analysis related to science groupsAnalysis related to science groups• Simulations (input for the sky model)

– lot of data in real format (up to 1 year of simulated data)– Realistic Data analysis in preparation of first year science

• Science Tools:– The science tools development is driven by the Science Groups, that

provides with• Test algorithms implemented in ST (binned and unbinned likelihood…)• New algorithms (wavelet for source Id, Bayesan Block for GRB light

curve decompositions, Voronoy Tessellations, Pulsar Blind search…)– New Science Tools development

• Mostly internal to LAT collaboration (e.g source detection algorithms)– Analysis of the different Data/Service challenges in Science Groups.

• ISOC (Science Operations)• Automated Science Processing (GRB, AGN)• Daily operations (Full GRB analysis done in few hours)• Catalog definition (GRB, LAT source,…)

• Dedicated IRFs.– Scientific impact of a new IRF set– GRB and pulsars “tailored” IRFs



GRB analysisGRB analysis

• The numbers depend onthe assumed model: herewe are extrapolating fromBATSE to LAT energies!(MeV- GeV- TeV)

• Reasonable model: LATcan detect promptemission from GRB (someper year)

All-sky countmap of the

simulation of55 days for

DC2

E>200MeVROI with R=3°Periodic at C.L.> 99.99%

E>100 MeVROI with R=1°Periodic at C.L.> 99.85%

E>100MeVROI with R=3°Periodicat C.L. > 99.99%



E>300MeVROI of R=1.5°Periodic at C.L.> 99.99%

PULSARANALYSIS



SNR simulations & analysis

Example: Vela Junior

Galactic backgrounds

Vela

Residual components

Extragalacticbackground

PSR0904-5008

Vela Jr



AGN analysisAGN analysis

flux (8h bin)

- 1 Swift proposal- 7 RXTE proposals- 2 Spitzer proposals- 2 Suzaku proposals- 1 Chandra proposal



DM analysisDM analysis

A.Cesarini et al. 2004 [astro-ph/0305075]

Galactic center

G. Bertone et al. [astro-ph/0612387]

DM particle with mass mχ = 150 GeVannihilating into b ̄b, after a 2 monthsobservation period

DM Point Sources




• Science Working Group coordination– GRB– DM– Solar– AGN– C&A

• Data analysis Development– GRB detection & Theory– PSR analysis & simulation– AGN Multiwavelength– DM theory and Data Analysis– Solar Flares detection and interpretation



SummarySummary• INFN has key responsibilities in GLAST data analysis

– From the Instrument Characterization to the High LevelData Analysis

– Demonstrated by Test Beam, Data Challenges, ServiceChallenge, I&T data analysis

• INFN is coordinating many SWG - contributed to keysimulations and analysis methods in all areas



Miniworkshop all’interno dellariunione internazionale del DarkMatter and New Physic WorkingGroupa Roma Tor Vergata del 2 e 3Aprile.Slides delle presentazioni inhttp://www.roma2.infn.it/mw_heap07/



http://www.roma2.infn.it/SciNeGHE07/



GLAST WorkshopGLAST Workshop

• Organizzato da ASI, INFN & INAF• Lo scopo di questo primo Workshop e’ quello di riunire, a pochi mesi dal lancio, la collaborazione italiana

GLAST assieme al resto della comunita’ nazionale potenzialmente interessata all’astronomia gamma,anche in vista della disponibilita’ dei dati di archivio dopo il primo anno di osservazione.

• L’incontro avra’ luogo all’ ESRIN (www.asdc.asi.it) nei giorni 2 e 3 luglio 2007.• Lunedi' 2 pomeriggio: La missione GLAST

– Lo strumento LAT– Le calibrazioni a terra– Le simulazioni– Science Working Groups– La collaborazione del LAT– I dati GLAST: policy

• Martedi' 3 mattina: La scienza di GLAST– Sky survey: catalogo delle sorgenti e loro identificazione– Blazar e AGN– GRB– Pulsar,– SNR e Plerioni– Sorgenti nel sistema solare– Studio dell’emissione diffusa della galassia– Materia Oscura e Fisica di frontiera– Campagne multi-lunghezza d’onda– Calibrazione e metodi di analisi

• Martedi' 3 pomeriggio: Sfruttamento scientifico di GLAST– Primi dati della missione AGILE e sinergie con GLAST– Science tool di GLAST per analisi e simulazioni– Modelli di partecipazione alla scienza di GLAST– Ruolo ASDC nel programma GLAST



Backup SlidesBackup Slides



PapersPapers

Papers associated primarily with a particularinstrument subsystem

Authorship: determined by SubsystemManagers of particular subsystem

Papers that describe the overall instrument, itsperformance, calibration, etc.

Authorship: all active collaboration membersare eligible; affiliated scientists andothers considered on a case-by-case basis

Instrument Papers

Papers involving specialized in-depth analysisor interpretation

Authorship: collaboration members (oraffiliated scientists) who have substantiallycontributed to the scientific ideas oranalysis done in paper.

Papers reporting a substantially new scientificresult, obtained either during the all-skysurvey or from Collaboration KeyProjects during subsequent phases;papers that require broad participation bycollaboration (e.g., catalog)

Authorship: all active collaboration membersare eligible; affiliated scientists andothers considered on a case-by-case basis

Analysis & ScientificPapers

Category IICategory I



OpportunitiesOpportunities

• Preparation for real data analysis on simulated data– Useful for undergraduate and PhD student

• Work together with astrophysical community– E.g ASI/INAF (eg. optical astronomers for DM, Swift team)

• Sinergies with AGILE and MAGIC in progress– Common projects (eg. GRB, SNR, AGN, DM)



ISOC/GRBISOC/GRB

• ISOC, preparation for the launch– Joint meeting during last Collab Meeting (ISOC and GRBs)

• Main topics:– GRB tasks connected with ISOC activities:

• ASP GRB Blind Search• ASP Afterglow Search• GRB analysis (LAT and LAT+GBM)• GCN notices delivery• GRB catalog

– GBM interaction very important



ISOC WorkshopISOC Workshop

• Next ISOC workshop at SLAC: 30 April – 2 May 2007• Intended focus on operations planning

– Review ISOC Flight Operations and Science Operationsprocesses and tools, and interactions between FO and SO

– Talks e.g.• Mission planning process• Shift-taker duties• Data processing• First two months activities and analyses

– Tutorials/hands-on exercises in afternoon sessions, e.g.• Real-time monitoring• Message logging, operations logbook• Web tools for LAT monitoring and data processing

monitoring• Config building tools



Processing NumerologyProcessing Numerology

• From DC2 background runs – GR v7r3p5– Events that pass Onboard Filter

• Assume equal MC to data (totallyarbitrary)

• L0 downlink (1.2 Mb/sec) is 5 TB/yr• ~80 2006-era CPUs to turn around one

downlink (≡ 3 hrs data) in one hour

7 TB

19GB

0.5kB

Meritsize

12121252Peryear

333581100

650Hrs

Perday

Perevent 8.61.5280.06

sec

Recon sizeDigisize

MCsize

ReconCPU

Clearly we want to filter a lot of thebackground out very early in theprocess!

• Assume 450 Hz effective data rate• Assume all downlinked events kept

•~1-2% good photons!• Must process all events to make selections



Improvements to GeometryMore Space Craft detailsMounting holes in ACD Tiles

Etc.

Incorporation of Beam Test Results

Tracker - Cluster widths and - Hit countCalorimeter - Normalization Issues - "Real" Calibrations

Hadronic Physics - Which Hadronic Interactor is best (for us)

Path Forward



IRFIRF“All Gamma”

Sample“Background”

Sample

MCSimulation

MCSimulation

ClassificationTree

“Processedbackground”

Event selectioncuts

Processed “GammaEvents”

Selected “Gamma Events”

Aeff PSF DE/E



GRB analysisGRB analysis

Selecting the data

Binning the data inEnergy

Binning the data inTime

Binning the data inLocation

(ra, dec or l,b)

Compute theDRM

Development of scripts (python, bash,…) to drive the analysis

Integration with ftools and heasarc software

Light Curves

Sky Maps

Spectralanalysis

GBM data,rsp and back



Pulsar analysis stepsPulsar analysis steps

Selecting the dataBinning the data in

Energy (es. creatingPHA files)

Binning the data insky position

(ra, dec or l,b)

Compute theDRM (e.g. theXSpec RMF)

Spectrum

Development of scripts (python, bash,…) toautomatic processing of large amount ofpulsars using ephemerides

Lightcurves

CountsMaps

TS mapsand flux

Barycentering

Extracting data fromD4 pulsar database

Blind search

Periodicity tests Phaseassignment


GLAST LAT GLAST INFNPoint sources analysisPoint sources analysis

Selecting the dataBinning the data in

Energy

Binning the data inTime

Point sourcelocalization(Likelihood,

Wavelet, etc..)

Compute theDRM

Spectralanalysis

LightCurves

Sky Maps

External Data(timing,

counterparts)

SourceIdentification

glast lat infn...•hodoscopic csi calorimeter(cal) array of 1536 csi(tl) crystals in 8 layers....

Documents