sdss web servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · coding against the universe....
TRANSCRIPT
![Page 1: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/1.jpg)
SDSS Web Services
Tamás BudaváriJohns Hopkins University
Coding against the UniverseCoding against the Universe
![Page 2: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/2.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 2
OutlineSDSS Primer
Technology
Web ServicesData Access• Images• Spectra• Catalog
Higher Level
![Page 3: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/3.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 3
SDSS Imaging Survey2.5m telescope
Apache Point, NM5 photometric bandsDrift scan operation
Photo pipeline100,000,000 galaxiesAutomated reductionCatalog archive server
![Page 4: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/4.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 4
NGC 2068
![Page 5: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/5.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 5
UGC 3214
![Page 6: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/6.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 6
NGC 6070
![Page 7: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/7.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 7
SDSS SpectropscopyTwo spectrographs
Red and blue partOptical fibers 640 in each bundlePlugged manually
Automatic reduction2D and 1D pipelinesCatalog archive server
![Page 8: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/8.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 8
![Page 9: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/9.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 9
Developing Web ServicesWe chose the .NET Framework
The C# programming languageExtensive class library (for free)Simple and efficient database accessFast imaging and graphics routinesRapid development in Visual StudioVery easy Web Services programming
Use CVS for versioning
![Page 10: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/10.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 10
Custom Tools and PackagesWrapper for CFITSIOCFITSIO by Vivek Haridas (JHU)
Access to FITS tables and images from C#XML Web Services return FITS in attachment
Scientific PlottingUsing TeeChart LiteFast plotting of online data
![Page 11: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/11.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 11
Available Web ServicesSDSS Web Services
Field Finder and SIAPSDSS Image CutoutSpectrum and Filter ServicesScientific Catalog ArchiveDensityMap Services
Other Relevant ServicesNED Services WrapperCosmic Distances
![Page 12: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/12.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 12
SDSS Fields and SIAField Images
Search for fields (HTM)Get all info, e.g. WCSReturns links to FITS
Simple Image AccessWrapper on top of FieldsReturns links in VOTable
![Page 13: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/13.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 13
SDSS Image CutoutBuild JPEG mosaics
For given (RA, Dec)Arbitrary zoom levelsOverplot catalog dataOverplot geometryMapQuest like navigationList of objects
Proper WSJPEG returned in DIMEor byte array
![Page 14: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/14.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 14
Spectrum ServicesPublic repository
500,000 spectra (2B row)Spatial search and moreRegister & submit yours
Web siteOn-the-fly plottingBuilding composites
Web servicesMore options and tools
![Page 15: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/15.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 15
SDSS Catalog ServicesCasJobs
Access to a 1TB of data80M unique galaxiesQueue system for SQLMyDB• 500MB remote DB• Upload and extract
Web servicesWeb site interfaceCommand-line client
![Page 16: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/16.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 16
SDSS DensityMap ServicesA SQL query to image converter
Select x,y,f and build color coded f(x,y) image
![Page 17: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/17.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 17
Other ServicesWrapper for NED
Name resolver functionSearch by coordinate
Available from
Cosmic DistancesVarious distance measuresUsing ΛCDM cosmology
NED ned = new NED();ObjInfo o = ned.ObjByName(“m101”);/* Use o.ra, o.dec, etc… */
Distance d = new Distance();float z=0.1, h=0.7, m=0.3, l=0.7;float r = d.Luminosity(z,h,m,l);
http://www.voservices.org
![Page 18: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/18.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 18
Consuming Web Services
![Page 19: SDSS Web Servicesrgm/sc4devo/sc4devo1/sc4devo1_09budavari.pdf · Coding against the Universe. SC4DEVO-1 Tamás Budavári (JHU) 2 Outline SDSS Primer Technology Web Services Data Access](https://reader034.vdocument.in/reader034/viewer/2022050308/5f7005db3990215f3f49556b/html5/thumbnails/19.jpg)
SC4DEVO-1 Tamás Budavári (JHU) 19
ConclusionsSDSS Web Services……provide access to scientific data and tools…are (very) easy to consume…are being used :-)
Development coordinated w/ IVOAOpen SkyQuery for federating archivesSDSS Open SkyNode