gavo – after one year h.-m. adorf & the gavo team

GAVO – after one year

H.-M. Adorf & the GAVO team

ADA III - 29-04-2004

GAVO’s Pillars

Publication and federation of datasets including theoretical ones

Spatial matching & classification & visualization (NGSE)Grid computing

ADA III - 29-04-2004

The GAVO Team

PI: Wolfgang Voges, MPE, GarchingCoI: Matthias Steinmetz, AIP, PotsdamHans-Martin Adorf, MPEHarry Enke, AIPGerard Lemson, MPE

ADA III - 29-04-2004

Collaborations

MPE, Garching (Peter Schuecker)AIP PotsdamCanadian Virtual Obs. (CVO), VictoriaUniversitaetssternw. Muenchen (USM)MPA, Garching (Planck, …)

ADA III - 29-04-2004

GAVO Work Areas

Publication of ROSAT datasets REST-based SCS service (HTTP GET in;

XML, CSV, HTML out) SOAP-based SCS service

MCMCS Download ManagerFuzzy spatial matcherGrid-based detection of galaxy clustersROSAT matcher/classifier service

ADA III - 29-04-2004

ROSAT All-Sky Survey (RASS)

BSC, FSC & Photons VO-compatibility: Input: Simple cone search Output: VOTable, …

New features Exposure times Galactic & Cartesian coordinates Healpix indices

ADA III - 29-04-2004

SCS

ADA III - 29-04-2004

Result

ADA III - 29-04-2004

VOTable

ADA III - 29-04-2004

MCMCS Download Manager

Tool … … accesses registry at JHU

User … … selects up to 70 distributed catalogues … specifies one or more sky-locations

Tool … … queries remote catalogues … retrieves datasets (VOTables) for further

processing

ADA III - 29-04-2004

MCMCS Download Manager

ADA III - 29-04-2004

MCMCS Download Manager

ADA III - 29-04-2004

Workflow

ADA III - 29-04-2004

Fuzzy spatial matcher

Essential for data miningPrototype features

Performs “fuzzy” match between pairs of source lists from different catalogues

Computes probability of real match based on astrometric uncertainties

Moving matcher into production use Currently exported to Canadian Virtual

Observatory Feeding matches to ClassX classifier

Long-term goal: assemble an SED

ADA III - 29-04-2004

Fuzzy spatial matcher (ctd)

ADA III - 29-04-2004

Grid computing

What is Grid-computing? Globus Toolkit, SGE, EJBs WebServices

Detection of galaxy clusters using RASS photons, SDSS

RASS source classification using RASS B/FSC, SUMSS, NVSS,

USNO

ADA III - 29-04-2004

Workflow

ADA III - 29-04-2004

Galaxy-cluster detection

Search for galaxy clusters in heterogeneous databases RASS photons SDSS

Software FORTRAN 90 code (data analysis) Perl scripts (data/grid management) Globus Toolkit

ADA III - 29-04-2004

Galaxy-cluster detection

Components Setup script

Sets up the directory structure Distributes the software across the grid

Execution script Triggers the parallel execution on the

compute nodes Data collection script

Retrieves the results from the compute nodes

ADA III - 29-04-2004

GAVO Mini-GRID

ADA III - 29-04-2004

Status

Perl scriptsUpgrading the RASS Photon DBSoon integrate the SDSS mirror copy

ADA III - 29-04-2004

RASS-source classifier

ClassX: international collaboration T.A. McGlynn, A.A. Suchkov, E.L. Winter, R.J.

Hanisch, R.L. White, F. Ochsenbein, S. Derriere, W. Voges, M.F. Corcoran

Requires data from several sky-surveys X-ray: ROSAT BSC+FSC Optical: USNO, (SDSS) Infrared: (2MASS) Radio: FIRST, NVSS, SUMSS

Distributed multi-wavelength VO-application

ADA III - 29-04-2004

Data Flow

ADA III - 29-04-2004

PoseQuery

ADA III - 29-04-2004

DisplayQueryResult

ADA III - 29-04-2004

DisplayMatchResult

ADA III - 29-04-2004

The matching problem

ADA III - 29-04-2004

DisplayXMatchResult

ADA III - 29-04-2004

DisplayClassXResult

ADA III - 29-04-2004

RASS-source classifier

State & session management Using Java Servlet session mechanism Internal abstract state machine

Strong points End-to-end VO-application Works with lists of objects / sky-coordinates Accesses several distributed databases Uses deterministic matcher (at Vizier and SDSS) Uses probabilistic matcher (at GAVO) Uses data analysis service (at NASA)

ADA III - 29-04-2004

RASS-source classifier

Future work Use IVOA-standards or protocols

VOTable WSDL, SOAP-based Web Services Add graphics

Multi-threaded Modularize, generalize and make S/W

configurable

ADA III - 29-04-2004

RASS-source classifier

Open questions Is an HTML form-based GUI

sufficiently powerful to control a complex grid application?

What are the user expectations wrt the workflow?

Is there a standard workflow that one could use / agree upon?

ADA III - 29-04-2004

Conclusion

GAVO is a small, but ambitious projectTwo Grid applications Detection of galaxy clusters

Globus Toolkit Classification of ROSAT sources

Based on WebServices

ADA III - 29-04-2004

References

GAVO Mid-Term Report, 90 pages, http://www.g-vo.org (soon)

Detection of X-ray Clusters of Galaxies by Matching RASS Photons and SDSS Galaxies within GAVO, P. Schuecker, H. Boehringer, W. Voges, A&A (submitted)

Automated classification of ROSAT sources using heterogeneous multiwavelength catalogs, T.A. McGlynn et al., ApJ (submitted)