gsc-ii plate processing pipeline status

10
GSC-II Plate Processing Pipeline Status C. Loomis, C. Sturch, F. Guglielmetti

Upload: livana

Post on 18-Jan-2016

35 views

Category:

Documents


0 download

DESCRIPTION

GSC-II Plate Processing Pipeline Status. C. Loomis, C. Sturch, F. Guglielmetti. Pipeline Status Update. GSC2 export activities. POSSI IIIaE processing. Database recalibration-load-match. Future processing activities. Pipeline Export Activities. GSCII2.1.1 release - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: GSC-II Plate Processing Pipeline Status

GSC-II Plate Processing Pipeline Status

C. Loomis, C. Sturch, F. Guglielmetti

Page 2: GSC-II Plate Processing Pipeline Status

Pipeline Status Update

• GSC2 export activities.

• POSSI IIIaE processing.

• Database recalibration-load-match.

• Future processing activities.

Page 3: GSC-II Plate Processing Pipeline Status

Pipeline Export Activities

• GSCII 2.1.1 release

• 1893 2nd epoch Schmidt plates

• 1.1 x 109 detections

• Comprehensive list and detailed information

http://www-gsss.stsci.edu/gsc/compass/compass_home.Html

Page 4: GSC-II Plate Processing Pipeline Status

Pipeline Export Activities-Recalibration pipeline tasks

Catalog staging Photometric& astrometric calibrations

ftp transfer of recalibrated

headers to NT

Apply Calibrations run

on NTEXPORT

Page 5: GSC-II Plate Processing Pipeline Status

Recalibration (Cont…) Photosol

Page 6: GSC-II Plate Processing Pipeline Status

POSSI Pipeline Processing

• 99 % of POSSI red fields completed.

• Processing extends down to –30 degree zone.(Includes new 15 scans for plates south of –18 degrees that were not scanned for DSS1).

• Pipeline changes for POSSI survey.1. Tasks requiring area inputs scaled to match the lower

resolution of POSSI scans.2. Detection threshold above sky raised from 3 to 4 to

eliminate false detections from higher grain noise.3. Cubic model for plate solution (telescope configuration).

Page 7: GSC-II Plate Processing Pipeline Status

Recalibration and database loading• Short term goal: 2 colors all sky (roughly 3510

fields, excluding equatorial overlap fields)• Surveys: POSSII IIIaF, POSSII IIIaJ, SES IIIaF, SES equatorial

extension IIIaF, SES galactic plane IIIaF (4 min exposure), SERC IIIaJ, SERC galactic plane IIaD (5 min exposure)

• Photometric and astrometric recalibration for remaining fields.

• Combined database loading and matching to run sequentially upon release to database.

• Coupled with image and processing file loading into HSM(OOP, CIM, FPA, SKY, MCO…)

Page 8: GSC-II Plate Processing Pipeline Status

Recalibration and Database Loading (Cont…)

• Since mid-August recalibrated loaded and matched 663 plates.

• Total plates in COMPASS to 2556.

Database plates by survey

Page 9: GSC-II Plate Processing Pipeline Status

Recalibration and database loading

Improve efficiency by running concurrent processing and automation of data handling processes.

Weak link is need for human intervention and decision about calibrations.

Restore and process on

VMS (30 to 60 min per

plate)

QA and Accept

?

ftp,HSM ingest, database load, plate matching. 60 min per plate (depends on detections and number of overlap regions).Vms backup

OopindexFindcat, act,ty2,ppm,toc, gp2,

Refraction,Photosol, plate_solution,

Apply_calibrations

Daemon process written in Perl and running c++ and fortran

Under WINNT

Page 10: GSC-II Plate Processing Pipeline Status

Future activities

-Processing:

1. Additional surveys such as POSSII IV-N, SES IV-N,POSSI IIIaO, Palomar quickV IIaD

2. Ingest of image and processing data into HSM for future reprocessing.

3. Global database recalibrations, iterating over the whole sky.