tap standards and feedback

The VAO is operated by the VAO, LLC.

TAP Standards and FeedbackDeoyani Nandrekar-HeinisJohns Hopkins University

April 22, 2023Deoyani Nandrekar-Heinis, JHU

2

Points of Discussion

Upload tables Authentication VOSpace integration ADQL and spatial queries Other issues

April 22, 2023Deoyani Nandrekar-Heinis, JHU

3

Upload Tables

Scope of tables Life of uploaded table Access Usage and query edit

April 22, 2023Deoyani Nandrekar-Heinis, JHU

4

Authentication

Upload access to only authorized user User query and result access

April 22, 2023Deoyani Nandrekar-Heinis, JHU

5

VOSpace Integration

Store results in user’s vospace Store job.xml and result in vospace

April 22, 2023Deoyani Nandrekar-Heinis, JHU

6

ADQL and Spatial Queries

Generic Queries? Spatial constraints

e.g. Using HTM ids Complex Queries Parsing Difficulties Suggestions and Options

April 22, 2023Deoyani Nandrekar-Heinis, JHU

ADQL Example7

• ADQL (Spatial)

SELECT o.ra, o.dec FROM photoobjall as o WHERE CONTAINS( POINT('J2000', o.ra, o.dec), Region('CIRCLE J2000 180 0 0.3')) = 1

• SDSS SQL Query:

Select o.ra, o.dec From photoobjAll as o inner join dbo.fSphGetHtmRanges(dbo.fSphSimplifyString('CIRCLE J2000 180 0 0.3')) h on o.HtmID between h.HtmIdStart and h.HtmIdEnd Where dbo.fSphRegionContainsXYZ(dbo.fSphSimplifyString('CIRCLE J2000 180 0 0.3'), o.cx ,o.cy,o.cz) = 1

April 22, 2023Deoyani Nandrekar-Heinis, JHU

8

ADQL and Spatial Queries

SELECT a.objid, a.ra, a.dec, b.objid, b.ra, b.dec FROM CatalogA AS a INNER JOIN CatalogB AS b ON CONTAINS(CIRCLE(a.ra, a.dec, 0.1), POIN T(b.ra, b.dec)) WHERE (some condition)

circle has to be calculated for every row in A in order to evaluate the query

HTM based optimization (not sufficient?) Solution::

temporary tables, generate the HTM ranges, put an index on them and then do the BETWEEN query.

April 22, 2023Deoyani Nandrekar-Heinis, JHU

9

ADQL and Spatial Queries

CREATE TABLE ##htmtemp (ObjID bigint, HtmStart bigint, HtmEnd bigint) -- +

create the indices here: PK on ObjID, cover index on HtmStart/End INSERT ##htmtemp WITH (TABLOCK) (ObjID, HtmStart, HtmEnd) SELECT ObjID, htm.Start, htm.End FROM CatalogA CROSS APPLY dbo.fHtmCoverCircleEq(Ra, Dec, 0.1) AS htm

SELECT a.objid, a.ra, a.dec, b.objid, b.ra, b.dec FROM CatalogA AS a

INNER JOIN ##htmtemp htm ON htm.ObjID = a.ObjID INNER JOIN CatalogB AS b

ON dbo.fGetHtmEq(b.Ra, B.Dec) BETWEEN htm.HtmStart AND htm.HtmEnd WHERE ...

April 22, 2023Deoyani Nandrekar-Heinis, JHU

10

ADQL and Spatial Queries

CREATE TABLE ##htmtemp (ObjID bigint, HtmStart bigint, HtmEnd bigint) -- +

create the indices here: PK on ObjID, cover index on HtmStart/End INSERT ##htmtemp WITH (TABLOCK) (ObjID, HtmStart, HtmEnd) SELECT ObjID, htm.Start, htm.End FROM CatalogA CROSS APPLY dbo.fHtmCoverCircleEq(Ra, Dec, 0.1) AS htm

SELECT a.objid, a.ra, a.dec, b.objid, b.ra, b.dec FROM CatalogA AS a

INNER JOIN ##htmtemp htm ON htm.ObjID = a.ObjID INNER JOIN CatalogB AS b

ON dbo.fGetHtmEq(b.Ra, B.Dec) BETWEEN htm.HtmStart AND htm.HtmEnd WHERE ...

Multiway joins are

slow!!

April 22, 2023Deoyani Nandrekar-Heinis, JHU

11

Special Spatial

Objects bright in Optical and invisible in UV Query:

SELECT ...FROM SDSS AS a INNER JOIN Galex AS b ON NOT CONTAINS(CIRCLE(a.ra, a.dec, 0.1), POINT(b.ra, b.dec))

Ugly where clauses

WHERE CONTAINS(CIRCLE(POINT(a.ra, a.dec), 0.5), POINT(b.ra, b.dec) OR     CONTAINS(CIRCLE(POINT(a.ra + 0.2, a.dec + 0.2), 0.5), POINT(b.ra,b.dec)

• Multiple conditions where clause

WHERE CONTAINS(CIRCLE(POINT(a.ra, a.dec), 0.5),

POINT(b.ra, b.dec) AND type= galaxy OR     CONTAINS(CIRCLE(POINT(a.ra, a.dec), 0.5), POINT(b.ra, b.dec) AND type= star

April 22, 2023Deoyani Nandrekar-Heinis, JHU

12

Suggestions

Spatial region: only constant values

Spatial constraints: Outside where clause

CROSS MATCH : handling separately

April 22, 2023Deoyani Nandrekar-Heinis, JHU

13