china-vo and lamost database chenzhou cui naoc, cas

China-VO and LAMOST Database

Chenzhou CUI

NAOC, CAS

Chinese Virtual Observatory

KIAA-Cambridge Workshop


•2001.11 1st VO workshop in China•2002.7 “China-VO” kicked off•2002.10 “China-VO” became a member of the IVOA•2003.9 the 2nd VO workshop•2003.11 IVOA Small Projects Meeting•2004.5 VOFilter 1.0 released•2004.12 China-VO 2004•2005.11 China-VO 2005•2006.12 China-VO 2006•2007.5 IVOA interoperability meeting•2007.11 China-VO 2007•2008.11 China-VO 2008

History and Events


R&D Focuses China-VO Platform

中国虚拟天文台系统平台的开发 Unified Access to On-line Astronomical Resources

and Services 国内外天文研究资源的统一访问

VO-ready Projects and Facilities 支持 VO的项目与观测设施

VO-based Astronomical Research Activities 基于 VO的天文研究示范

VO-based Public Education 基于 VO的天文科普教育


Two XSLT transforms VOFilter

an XML filter for OpenOffice.org Calc to open VOTable files

http://services.china-vo.org/vofilter/ VOTable2XHTML

a stylesheet to transform VOTable data into HTML/XHTML format

http://services.china-vo.org/votable2xhtml/

http://services.china-vo.org/vofilter/

http://services.china-vo.org/votable2xhtml/


Touch the sky with your mouse An intelligent client for VO

services A commodity for astronomers and

students

A Smart On-line Astronomical Information Collector


FitHAS: FITS Header Archiving System

An useful assistant tool for FITS providers and managers

Importing FITS keyword records for one or more FITS files under a given directory into a database by several mouse clicks

FITS filesFITS files

User Interface Layer

Wizard

Core Transaction Layer

DatabaseFITS files

Header analysisMetadata Mapping

and Archiving Database controller

Header viewer

Database browser

Config-uration

Configuration filesArchive

moniter


VO Data Access Service (VO-DAS)

An OGSA-DAI based service system to provide unified access to astronomy data, including catalogs, images and spectra.

Goals of VO-DAS Supporting high volume data query Interlinking distributed and heterogeneous archives

catalogs, images, spectrums Providing a software that works for astronomersworks for astronomers


AstroBox A plug-in package for MATLA

B to provide an astronomical data mining application service, supporting VO protocols and tools.

A high-level data analysis environment supporting:PLASTICVOTableLocal DBVO-DAS clientAstronomical algorithms

VO-DAS

MATLAB VO-DAS Client

MA

TL

AB

D

ata

base

Too

lbox

Local DBJa

vaLi

brar

ies

VO

Tab

les

PLASTIC

VO Tools(Aladin, TOPCAT)

AstroBoxAstroBox


First Science Paper from China-VO

Candidate Milky Way satellites in the Galactic halo（ Liu et al., 2008, A&A)

SDSS DR5 photometric data were searched for new Milky Way companions or substructures in the Galactic halo.

Data analysis procedures were based on the VO-DAS. Five candidates are identified as over-dense faint stellar sources th

at have color-magnitude diagrams similar to those of known globular clusters, or dwarf spherical galaxies.


Goals of the China-VO

Building the cyber-infrastructure

Leading the e-Science

for Astronomy in China


VO-enabled LAMOST

VO-enabledLAMOST dataLAMOST Spectral Analysis Pipeline

LAMOST Database


SDSS Mirror


LAMOST Obs. Mode and Data Size

4000 / 250 => 16 spectroscopes => red & blue parts =>32 CCD cameras => 4K*4K pixels => 16 bits color deep

For each sky area, 3 times exposure, 30 minutes each. 5 sky area (plate) can be observed for a night (7.5~9 hours)

Scientific data per night: 4K*4K*2*32*5*3= 15.36 (GB)

All the collected data is about 20 GB/night 20*200= 4,000 GB per year (ideal condition) 4*5 year = 20 TB for the LAMOST 5 years life period


Data Products

2-D multi-fiber spectrum images (pravite) 1-D spectra (to the public 18 months later) Catalogs (to the public 24 months later)

No image (in principle)


OCS

TCS

SSS

DHS

ICS

Archive

34

6

8

5

7

11

1

9

10

2

12

WIS

ASS

13

14

16

15

17

LAMOST Dataflow


DB components Tables

scientific data tables metadata tables log tables admin tables

ID System Global unique targetID

sourceID: source catalog ID, for “SDSS” it is “SDSS”, for “GSC 2.3” it is “GSC23”, etc.

sourceTargetID: the original ID for a source in the source catalog targetID: a unique ID for each object of LAMOST observation plateID: telescope pointing ID, i.e. sky area ID runID: exposure ID obsID: observation ID, an observation comprises one plate and multiple exposure spectrographID: spectrograph ID chipID: CCD chip ID fiberID: fiber ID


sci_repository

PK targetID

ID RA DEC GLON GLAT Epoch oType magFK1 sourceID sourceTargetID htmID ...

sci_runsAll

PK runID

IDFK1 plateID startTime endTime expType ...

sci_specBest

PK,FK1 targetID

ID

sci_specAll

PK,FK3 targetID

IDFK3 obsID parameters ...

sci_platesAll

PK plateID

ID WCSinfo ...

sci_spectrographsAll

PK spectrographID

ID ...

sci_chipsAll

PK chipID

IDFK1 spectrographID ...

sci_fits1D

PK targetID

ID filePathFK3 obsID ...

sci_fits2D

ID filePathFK3 obsIDFK3 spectrographIDFK3 chipIDFK3 fiberIDFK3 targetID ...

sci_fibersAll

PK fiberID

IDFK1 chipIDFK1 spectrographID ...

sci_targetSource

PK sourceID

ID sourceName sourceMeta ...

sci_objCross

PK,FK1 targetID

TWOMASS_data GSC_data UCAC_data PanStarrs_data ...

sci_LAMOSTConstants

name value unit description

sci_sppParams

PK,FK5 targetID

FK4,FK5 obsID feha teffa logga rva ...

sci_observationsAll

PK obsID

IDFK2 plateIDFK2 runIDFK1 spectrographIDFK1 chipIDFK1 fiberIDFK3 targetID ...

sci_spec2D

IDFK1 obsID spectrographID chipID fiberID targetID parameters ...

Scientific Data Tables


meta_Columns

FK1 tableName colName dataType unit ucd description

meta_Indexes

indexIDFK1 tableName colList defination type indexGroup

meta_Views

viewName parentTables defination

meta_Glossary

name ucd description

meta_Tables

PK tableName

type engine description

meta_Plugins

pluginName version status type typeVersion library libraryVersion author description license

Metadata Tables


Archive platform and interfaces

Open Source SystemLAMP (Linux+Apache/Tomcat+MySQL+PHP)JavaPerl/C/Python

Web Browser Interface VO service interface

TAPSSASIA


LAMOST archive management VOSpace+iRODS based data m

anagement system

VO compliant VOTable TAP(coneSearch) SAMP (PLASTIC) UCD SSA STC (WCS) RM VOSpace FootPrint ADQL GoogleSky&WWT (KML)

MetaDBSci DB

DB Administration Moduler

Data Query & Retrieving Moduler

Usage Statistic Moduler

Archiving Moduler

AdmDB

DPSUsers & Clients

LogDB


AstroGrid DSA


On-line Collaboration Environments

Collaboration Enviroments

LAMOST DBs

Project Scientists

ObservationDB

SciDB (internal)

SciDB (public)

Scientific WGs

Papers

Public Users

Data Processing

Research Projects

User & Group management Data access Proposal preparation Call for collaborators Mailing lists & Forums Data & Docs Share


Q & A

?http://www. .orgMore information is available at:

china-vo and lamost database chenzhou cui naoc, cas

Documents