spirit – database and data access andrey a. perzov, sergey v. kuzin, sergey a. bogachev, vladimir...

27
SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Upload: spencer-weaver

Post on 05-Jan-2016

217 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

SPIRIT – database and data access

Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V.

Shestov, Oleg I. Bugaenko

Page 2: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

SPIRIT is a space complex of telescopes that works at the Earth orbit from August 2001 and includes the following instruments …

SPIRIT data types

4 channels

Page 3: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

TELESCOPE 2 2 channels

TELESCOPE 1 4 channels

IMAGING SPECTROGELIOGRAPH Mg XII 8.42 A 2 channels

XUV SPECTROGELIOGRAPH2 channels

Page 4: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

TELESCOPE 1171 A channel195 A channel284 A channel304 A channel

TOTAL: ~ 14 000 images during 4.5 years (12 Gb)

Page 5: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

TELESCOPE 2175 A channel304 A channel

TOTAL: ~ 81 000 images during 4.5 years (50 Gb)

Page 6: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

IMAGING SPECTROGELIOGRAPH

Mg XII 8.42 A

TOTAL: ~ 191 000 images during 4.5 years (200 Gb)

Page 7: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

XUV SPECTROGELIOGRAPH177-207 A285-335 A

TOTAL: ~ 9 000 images during 4.5 years (10 Gb)

Page 8: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

TOTAL NUMBER OF THE SPIRIT IMAGESTOTAL NUMBER OF THE SPIRIT IMAGES

TELESCOPE 1

171 A 2 800 195 A 4 500

284 A 3 500 304 A 3 100

TELESCOPE 2

175 A 40 500 304 A 40 500

IMAGING SPECTROGELIOGRAPH Mg XII

Mg 1 87 500 Mg 2 104 000

XUV SPECTROGELIOGRAPH

XUV 190 3 400 XUV 304 5 000

TOTAL: 295 000 images of the Sun during 4.5 years of work

Page 9: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Full cycle of SPIRIT data processing1. On-board registration and processing

2. Data analysis and improvement

3. Converting data to FITS and filling the database

Page 10: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

On-board processing

Page 11: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Data analysis and improvement

Automatic software:– Lost data filling

– Flat field correction

User software:– Background

subtraction– Finding of

coordinates

Full package of SPIRIT software will be available in SSW from January-February 2006

Page 12: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Methods of the lost pixel reconstruction:a) Comparison with the

same pixels in the adjacent images

b) bilinear interpolation from the adjacent rows

Lost data recovering

Page 13: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Method of the reconstruction (3 steps):1. We synthesize the mask of

damage (one mask for one SPIRIT channel)

2. We multiply the data matrix by this mask of damage

3. Places of most strong damage are reconstructed by the bilinear interpolation as the lost pixels

Recovering of the places with filter damage

Page 14: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Methods of the mask calculationa) Averaging of the long series of one channel images

b) Method of Kuhn-Lin-Loranz (PASP, 1991, V. 103, P. 1097)

Flat field mask

Flat field correction

Page 15: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

F1 F20F3F2

FaaBackgroundi

i

20

10

Background subtraction

Page 16: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Background subtraction

Page 17: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Description of the problem– Axe of the satellite varies

slowly in time that leads to some uncertainty in the position of the Sun disk in the image

– For correct analysis of the data, it is necessary to compensate this shifting with the precision of about 1 pixel

Orientation problem and its solving

Page 18: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Method We find the position of the Sun disk in the image with our own method based on the successive approaches to the Sun limb

Result (in CCD pixels)X=253.5Y=301.2R=182.5Итерация 1Итерация 2Итерация 3

Orientation problem and its solving

Page 19: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

An example of SPIRIT data after the finishing of full processing cycle

Page 20: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Converting the data to FITS format

The upper part coincides with the SOHO/EIT header. It allows to directly apply all the EIT programs for

processing of the SPIRIT fits files.

Header of the SPIRIT fits files consists of the two main parts

The lower part includes an additional information on the SPIRIT data. This information is necessary for more

detail processing – for example, for decision of ballistic tasks.

Page 21: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Upper part of the header

SPIRIT HEADER SOHO/EIT HEADER

coincides with the SOHO/EIT

Page 22: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Lower part of the header(provides additional information on the SPIRIT data)

Ballistic information

Page 23: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Structure of the SPIRIT data base

SQL Database Management System

HTMLSPIRIT home page

FTP base of images

Direct FTP access

Accessthrough web site

Request

Request

Page 24: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

SPIRIT FTP server

Address: ftp://serv99.lebedev.ru/dataLogin: xrasuserPassword: userxras

Now are acceptable through FTP:• Telescope 1

4 channels, all the images, free access

• Telescope 22 channels, all the images, free access

• XUV-Spectrogeliograph2 channels, all the images, free access

Page 25: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

SPIRIT web page

Address: http://spirit.xras.lebedev.ru/

Page 26: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

FTP access through web page

Address: http://spirit.xras.lebedev.ru/data-access-ftp.html

Page 27: SPIRIT – database and data access Andrey A. Perzov, Sergey V. Kuzin, Sergey A. Bogachev, Vladimir A. Slemzin, Sergey V. Shestov, Oleg I. Bugaenko

Access through SQL based data search system

Address: http://spirit.xras.lebedev.ru/data-access.php