the integrated data viewer

Unidata Seminar SeriesUnidata Seminar SeriesIDV/THREDDS/VGEEIDV/THREDDS/VGEE

March 17, 2003March 17, 2003

The Integrated Data Viewer: The Integrated Data Viewer: A tool for scientific analysis A tool for scientific analysis

and visualizationand visualization

Don MurrayDon MurrayUnidata Program CenterUnidata Program Center

March 17, 2003March 17, 2003


March 17, 2003March 17, 2003

OutlineOutlineOverview of the Integrated Data Viewer (IDV)Overview of the Integrated Data Viewer (IDV)•• What is it?What is it?•• Historical perspectiveHistorical perspective•• Development by leveraging existing resourcesDevelopment by leveraging existing resources

IDV FeaturesIDV Features•• Unique featuresUnique features•• Web enabled featuresWeb enabled features

IDV as an IntegratorIDV as an Integrator•• UCAR CollaborationsUCAR Collaborations•• NonNon--UCAR CollaborationsUCAR Collaborations

Current/Future developmentCurrent/Future developmentSummary/Acknowledgements/LinksSummary/Acknowledgements/Links


March 17, 2003March 17, 2003

What is the IDV?What is the IDV?Freely available JavaFreely available Java™™framework and framework and reference application reference application for scientific analysis for scientific analysis and visualizationand visualizationProvides 2Provides 2-- and 3and 3--D D displays of data displays of data (grids, in(grids, in--situ, radar, situ, radar, satellite)satellite)StandStand--alone or alone or networked applicationnetworked application


March 17, 2003March 17, 2003

Historical PerspectiveHistorical PerspectiveOutgrowth of the MetApps project at Outgrowth of the MetApps project at Unidata to provide new met tools in JavaUnidata to provide new met tools in JavaMetApps Project GoalsMetApps Project Goals•• Offer openOffer open--source, platformsource, platform--independent independent

applications for analysis and visualization of applications for analysis and visualization of geoscientific data by researchers, educators geoscientific data by researchers, educators and studentsand students

•• Create a componentCreate a component--oriented framework for oriented framework for construction of custom applicationsconstruction of custom applications

•• Enlist users and other developers in Enlist users and other developers in component design and developmentcomponent design and development


March 17, 2003March 17, 2003

Historical PerspectiveHistorical Perspective

Why develop new tools?Why develop new tools?Networked world creates opportunities for:Networked world creates opportunities for:•• remote data accessremote data access•• remote collaborationremote collaboration•• distance learning distance learning

New data sets (Level II NEXRAD, new New data sets (Level II NEXRAD, new instruments, new models (WRF), data from other instruments, new models (WRF), data from other geosciences) create opportunities for new views geosciences) create opportunities for new views of the atmosphere and earth systemof the atmosphere and earth systemExisting Unidata supported applications (McIDAS, Existing Unidata supported applications (McIDAS, GEMPAK) would require extensive modifications GEMPAK) would require extensive modifications to support all of the aboveto support all of the above


March 17, 2003March 17, 2003

Leveraging Existing ResourcesLeveraging Existing Resources

JavaJavaVisAD Component LibraryVisAD Component LibraryRemote data access protocolsRemote data access protocolsUnidata community of educators and Unidata community of educators and researchers to guide developmentresearchers to guide developmentExperience using and supporting Experience using and supporting existing viz/analysis packages existing viz/analysis packages (GEMPAK, McIDAS, Vis5D)(GEMPAK, McIDAS, Vis5D)


March 17, 2003March 17, 2003


Why Java?Why Java?Platform independence Platform independence –– supported on supported on most major operating systems and most major operating systems and browsersbrowsersNetwork enabled Network enabled -- allows development of allows development of collaborative applications and access to collaborative applications and access to network data holdingsnetwork data holdingsObjectObject--Oriented design Oriented design -- aids in aids in component development (e.g., reusability, component development (e.g., reusability, interactivity)interactivity)Java 3DJava 3D™™ -- provides ability to create new, provides ability to create new, innovative views of conventional datasets innovative views of conventional datasets on low cost hardwareon low cost hardware


March 17, 2003March 17, 2003


VisAD Component LibraryVisAD Component LibraryCreated by developer of premier 3D viz package Created by developer of premier 3D viz package used today in atmospheric science community used today in atmospheric science community (Vis5D) with ongoing development at U(Vis5D) with ongoing development at U--WI, WI, UCAR and NCSAUCAR and NCSAPowerful mathematical data model that embraces Powerful mathematical data model that embraces virtually any numerical data setvirtually any numerical data setGeneral display model that supports 2General display model that supports 2-- and 3and 3--D D displays, multiple data views, direct manipulationdisplays, multiple data views, direct manipulationAdapters for multiple data formats (netCDF, HDFAdapters for multiple data formats (netCDF, HDF--5, FITS, HDF5, FITS, HDF--EOS, McIDAS, Vis5DEOS, McIDAS, Vis5D……) and access ) and access to remote data servers.to remote data servers.Supports data sharing and realSupports data sharing and real--time collaboration time collaboration among geographically distributed usersamong geographically distributed users


March 17, 2003March 17, 2003


Remote Data AccessRemote Data AccessAbstract Data Distribution Environment (ADDE)Abstract Data Distribution Environment (ADDE)•• Java client included in VisADJava client included in VisAD•• Existing network of ADDE servers at Unidata sitesExisting network of ADDE servers at Unidata sites

Distributed Oceanographic Data System/Open Distributed Oceanographic Data System/Open source Project for a Network Data Access Protocol source Project for a Network Data Access Protocol (DODS/OPeNDAP)(DODS/OPeNDAP)•• Java client availableJava client available•• netCDF interfacenetCDF interface•• VisAD accessVisAD access•• Used in other geoscience disciplines as well as Used in other geoscience disciplines as well as

atmospheric scienceatmospheric science

HTTP/FTPHTTP/FTP•• Access to both data and documentsAccess to both data and documents


March 17, 2003March 17, 2003


MetApps Task ForceMetApps Task ForceUnidata community members who provided the Unidata community members who provided the vision for how evolving technology and changes vision for how evolving technology and changes in teaching and research approaches over the in teaching and research approaches over the next decade will influence overall requirements next decade will influence overall requirements for applications software.for applications software.UserUser--centered design allows greater usefulness centered design allows greater usefulness and usability of software and innovation in how and usability of software and innovation in how the software displays datathe software displays data•• Participating in the selection of development projects, Participating in the selection of development projects, •• Specifying user requirement through the development of Specifying user requirement through the development of

use cases, use cases, •• Testing each iteration and providing feedback to the Testing each iteration and providing feedback to the

developers. developers.


March 17, 2003March 17, 2003

IDV FeaturesIDV FeaturesIntegrated displays of a Integrated displays of a variety of data typesvariety of data typesSupport for a variety data Support for a variety data access methodsaccess methodsMultiple display typesMultiple display typesInteractive probesInteractive probesUser defined formulasUser defined formulasBundling of user Bundling of user preferencespreferencesIntegrated HTML viewerIntegrated HTML viewerEasy configurationEasy configurationIntegrated documentationIntegrated documentation


March 17, 2003March 17, 2003

Unique IDV FeaturesUnique IDV FeaturesInteractive probes for Interactive probes for dataset explorationdataset exploration•• Parameter readoutsParameter readouts•• Vertical profilesVertical profiles•• Model soundingsModel soundings•• Time/Height displaysTime/Height displays

QuickTimeQuickTime™™ capture capture and playbackand playbackIncorporation of Incorporation of educational materialseducational materialsUser defined formulasUser defined formulasExtensible frameworkExtensible frameworkExtensive use of Extensive use of network resourcesnetwork resources


March 17, 2003March 17, 2003

Web enabled featuresWeb enabled features

Client/Server data Client/Server data accessaccessXML ConfigurationXML ConfigurationXML PersistenceXML PersistenceIntegrated HTML Integrated HTML ViewerViewerUse of Java Web Use of Java Web StartStart


March 17, 2003March 17, 2003

Web Enabled FeaturesWeb Enabled Features

Client/Server Data AccessClient/Server Data AccessAccess data from Access data from DODS/OPeNDAP or ADDE DODS/OPeNDAP or ADDE servers, as well as local servers, as well as local files, HTTP and FTPfiles, HTTP and FTPAllows subsetting of large Allows subsetting of large datasetsdatasetsCan use THREDDS Can use THREDDS catalogs for discovery catalogs for discovery and usage metadataand usage metadataCatalogs can be indexed Catalogs can be indexed in digital librariesin digital libraries


March 17, 2003March 17, 2003


XML ConfigurationXML ConfigurationIDV uses XML to IDV uses XML to configure the user configure the user experienceexperienceConfiguration files can Configuration files can be local or distributed be local or distributed across one or more across one or more web serversweb serversOffers flexibility to Offers flexibility to adapt the interface to adapt the interface to different:different:•• learnerslearners•• taskstasks•• data sets data sets •• content areascontent areas


March 17, 2003March 17, 2003


XML PersistenceXML PersistenceState of the application State of the application (loaded data sources and data (loaded data sources and data depictions) can be saved in depictions) can be saved in XML XML ““bundlesbundles””Bundles can be loaded at Bundles can be loaded at startup or imported onstartup or imported on--thethe--flyflyDisplays can be annotated Displays can be annotated and these can be saved in the and these can be saved in the bundle as explanationsbundle as explanationsBundles can be distributed Bundles can be distributed around the Internet (on web around the Internet (on web servers or eservers or e--mail mail attachments)attachments)


March 17, 2003March 17, 2003


Integrated HTML ViewerIntegrated HTML ViewerIDV includes a IDV includes a customized HTML viewercustomized HTML viewerViewer can be used to Viewer can be used to provide context with provide context with associated data displaysassociated data displaysIDV displays can be IDV displays can be easily embedded in the easily embedded in the HTMLHTMLCan be used as a Can be used as a customized UI which customized UI which controls the IDVcontrols the IDV


March 17, 2003March 17, 2003


Use of Java Web StartUse of Java Web Start™™Java Web Start is Java Web Start is used to load in the used to load in the IDV from a web pageIDV from a web pageJNLP files can include JNLP files can include pointers to pointers to configuration files configuration files and bundles for and bundles for customization (VGEE)customization (VGEE)Web Start provides Web Start provides automatic updatesautomatic updates


March 17, 2003March 17, 2003

IDV as an IntegratorIDV as an Integrator

Data and configuration parameters can be Data and configuration parameters can be loaded from multiple, distributed serversloaded from multiple, distributed serversVisAD data model enables computations VisAD data model enables computations on disparate datasetson disparate datasetsMetadata (e.g., units, sampling topologies, Metadata (e.g., units, sampling topologies, error estimates and coordinate error estimates and coordinate transforms) is carried along through transforms) is carried along through mathematical operationsmathematical operationsFacilitates collaborations between Facilitates collaborations between disciplinesdisciplines


March 17, 2003March 17, 2003

IDV Collaborations in UCARIDV Collaborations in UCARATD ATD •• IHOPIHOP•• SPOL in the classroomSPOL in the classroom

DLESE and SCD DLESE and SCD •• Visual Geophysical Visual Geophysical

Exploration Environment Exploration Environment (VGEE)(VGEE)

NSDLNSDL•• Thematic Realtime Thematic Realtime

Environmental Data Environmental Data Distributed Services Distributed Services (THREDDS)(THREDDS)

RAPRAP•• VisAD development (as VisAD development (as

part of 4DWX)part of 4DWX)<your group here><your group here>


March 17, 2003March 17, 2003

IDV Collaborations outside UCARIDV Collaborations outside UCARAir Force Institute of TechnologyAir Force Institute of Technology•• GRIB readerGRIB reader•• Airborne Laser SystemAirborne Laser System

THREDDS communityTHREDDS community•• Catalog testingCatalog testing•• Component framework development (CDC)Component framework development (CDC)

University of IllinoisUniversity of Illinois•• VGEE development, IDV testingVGEE development, IDV testing

Space Science Engineering Center (SSEC) Space Science Engineering Center (SSEC) –– UWUW--MadisonMadison•• VisAD enhancementsVisAD enhancements•• VisBioVisBio

Australian Bureau of MeteorologyAustralian Bureau of Meteorology•• VisAD enhancementsVisAD enhancements


March 17, 2003March 17, 2003

Current/Future DevelopmentCurrent/Future DevelopmentNew Data TypesNew Data Types•• NEXRAD Level II dataNEXRAD Level II data•• WRF model outputWRF model output•• Support for additional geoscience data sets Support for additional geoscience data sets

(oceanographic, geophysical)(oceanographic, geophysical)•• GIS dataGIS data

New FeaturesNew Features•• Web publishing (blogs)Web publishing (blogs)•• Shared, collaborative displaysShared, collaborative displays


March 17, 2003March 17, 2003

SummarySummary

UnidataUnidata’’s IDV is a freely available, s IDV is a freely available, powerful analysis and visualization powerful analysis and visualization tool which can facilitate education tool which can facilitate education and research by:and research by:•• Integrating diverse datasetsIntegrating diverse datasets•• Allowing customized user experiencesAllowing customized user experiences•• Enabling collaborationsEnabling collaborations


March 17, 2003March 17, 2003

AcknowledgementsAcknowledgements

Unidata IDV component developers (Jeff Unidata IDV component developers (Jeff McWhirter, Stu Wier, Steve Emmerson, McWhirter, Stu Wier, Steve Emmerson, John Caron, Russ Rew)John Caron, Russ Rew)THREDDS developers (John Caron, Ethan THREDDS developers (John Caron, Ethan Davis, Robb Kambic)Davis, Robb Kambic)UCAR collaborators (ATD UCAR collaborators (ATD –– Chris Burghart, Chris Burghart, Susan Stringer, Mike Daniels; DLESE Susan Stringer, Mike Daniels; DLESE --Rajul Pandya SCD Rajul Pandya SCD –– Tim Schietlin; RAP Tim Schietlin; RAP ––Doug Lindholm; )Doug Lindholm; )


March 17, 2003March 17, 2003

For Further InformationFor Further Information

Integrated Data Viewer homepageIntegrated Data Viewer homepage•• http://my.unidata.ucar.edu/content/software/metappshttp://my.unidata.ucar.edu/content/software/metapps

VisAD homepageVisAD homepage•• http://www.ssec.wisc.edu/~billh/visad.htmlhttp://www.ssec.wisc.edu/~billh/visad.html

VGEE homepageVGEE homepage•• http://www.dlese.org/vgeehttp://www.dlese.org/vgee

THREDDSTHREDDS•• http://www.unidata.ucar.edu/projects/THREDDShttp://www.unidata.ucar.edu/projects/THREDDS

Answers to questionsAnswers to questions•• [email protected]@unidata.ucar.edu

http://my.unidata.ucar.edu/content/software/metapps

http://my.unidata.ucar.edu/content/software/metapps

http://www.ssec.wisc.edu/~billh/visad.html

http://www.dlese.org/vgee

http://www.unidata.ucar.edu/projects/THREDDS

the integrated data viewer

Documents