ESRIESRI’’ss Approach to Metadata Approach to Metadata and Portalsand Portals

Chris NorthChris NorthDirector of Technology, ESRI CanadaDirector of Technology, ESRI Canada

cnorth@esricanada.comcnorth@esricanada.com

GIS Portal EnablesGIS Portal Enables

•• SearchSearch,,discoverydiscovery, and , and brokeringbrokering of of access to access to geospatial geospatial resourcesresources–– DataData–– ApplicationsApplications–– Web sitesWeb sites–– DocumentsDocuments

Distributed Data and Services Distributed Data and Services …… Federated GIS Federated GIS PortalPortal

MetadataMetadata

PortalPortal

•• Data Data •• Data modelsData models•• MethodsMethods•• MapsMaps•• ServicesServices•• ApplicationsApplications

A Framework for Geospatial IntegrationA Framework for Geospatial Integration

Standards and Interoperability Standards and Interoperability Support Participation and UseSupport Participation and Use

GIS Portals Organize GIS Portals Organize Our KnowledgeOur Knowledge

What are users looking for?What are users looking for?

•• Data for use in GIS softwareData for use in GIS software•• GIS Services GIS Services -- mapping, geoprocessingmapping, geoprocessing•• Geospatial applicationsGeospatial applications•• Planned data acquisitionsPlanned data acquisitions•• Events, activities and informationEvents, activities and information

A metadata portal contains metadata A metadata portal contains metadata for all of the abovefor all of the above

Metadata documents describe content and relationships.Metadata documents describe content and relationships.

Metadata Fuels the GIS PortalMetadata Fuels the GIS Portal

Services &Services &ApplicationsApplications

Data SetsData SetsMapsMaps

Data ModelsData Models

CatalogCatalog

MetadataMetadata

Where to GIS Users Need Where to GIS Users Need Metadata?Metadata?

Created and Edited On the DesktopCreated and Edited On the Desktop……–– Make it easy to create and use metadataMake it easy to create and use metadata

•• Automatically stores and manages metadata as part of the Automatically stores and manages metadata as part of the datasetdataset

–– Need Support for FGDC and ISO metadata content Need Support for FGDC and ISO metadata content standards outstandards out--ofof--thethe--box box

Published (Attached) to servicesPublished (Attached) to services……–– Metadata ServicesMetadata Services

•• ArcIMS, Z39.50, CSW 2.0, ArcIMS, Z39.50, CSW 2.0, OAIOAI--PMHPMH

–– Metadata ExplorerMetadata Explorer

Discovered via PortalsDiscovered via Portals……–– Framework, Administration Publisher and Map Viewer Framework, Administration Publisher and Map Viewer

ModulesModules–– User Administration, Harvesting, Online SubmissionUser Administration, Harvesting, Online Submission

. . . Becoming More Distributed. . . Becoming More Distributed

Scalable Metadata SolutionsScalable Metadata Solutions

ProfessionalProfessionalProductivityProductivity

Desktop Tools Desktop Tools & Data& Data

Metadata Discovery Metadata Discovery Online SubmissionOnline Submission

Harvesting ManagementHarvesting Management

GIS Portal ToolkitGIS Portal Toolkit

ArcIMSArcIMSMetadata Metadata

ServerServer

MetadataMetadataSharingSharing

How does ESRI Support How does ESRI Support Metadata?Metadata?

•• Makes it easy to create and use metadataMakes it easy to create and use metadata•• Automatically stores and manages metadata Automatically stores and manages metadata

as part of the datasetas part of the dataset•• Supports metadata for all data formats Supports metadata for all data formats

supported by ArcGISsupported by ArcGIS•• Supports FGDC and ISO metadata standards Supports FGDC and ISO metadata standards

outout--ofof--thethe--box box •• Achieves all of our goals using open, flexible, Achieves all of our goals using open, flexible,

industry standard technologyindustry standard technology–– XML = XML = eXtensibleeXtensible Markup LanguageMarkup Language

ArcGIS DesktopArcGIS Desktop

•• ArcGIS Desktop ArcGIS Desktop includes Metadata includes Metadata tools in the boxtools in the box–– Editing metadataEditing metadata–– Automatic Automatic

populationpopulation•• Extent, projection, Extent, projection,

fields, etc.fields, etc.–– Easy displayEasy display–– StorageStorage–– Search interfaceSearch interface

ArcIMS Metadata ServerArcIMS Metadata ServerESRI software used to create a central, online metadata repositoESRI software used to create a central, online metadata repository ry

for organizing and managing metadatafor organizing and managing metadata

ArcCatalog

ArcSDE / Relational Database

Metadata ExplorerArcIMS

ESRI Portal ToolkitESRI Portal ToolkitPortal Web Site Templates and ToolsPortal Web Site Templates and Tools

•• Builds on ArcIMS Metadata CatalogBuilds on ArcIMS Metadata Catalog•• Collection of web pages, scripts and content: a Collection of web pages, scripts and content: a

functional draft of a GIS Portal websitefunctional draft of a GIS Portal website–– Framework ModuleFramework Module–– Administration ModuleAdministration Module–– Publisher ModulePublisher Module–– Map ViewerMap Viewer

•• Provides tools to carry out a number of tasks, Provides tools to carry out a number of tasks, including:including:–– Building a user interface to the siteBuilding a user interface to the site–– Hosting userHosting user--supplied content in the form of web pagessupplied content in the form of web pages–– Querying contentQuerying content–– Harvesting MetadataHarvesting Metadata–– Much MoreMuch More

ImplementationsImplementations

ESRI ParticipationESRI ParticipationCompleted ISO StandardsCompleted ISO StandardsDevelopment / ImplementingDevelopment / Implementing

implements the basic concepts through GML; implements the basic concepts through GML; participates on the project team for the participates on the project team for the development of the new amendment for this development of the new amendment for this standardstandard

ISO 19111:2003 ISO 19111:2003 -- Spatial Spatial referencing by coordinatesreferencing by coordinates

participating in several standards participating in several standards organizations to develop an encoding for organizations to develop an encoding for feature catalogs based on the concepts in this feature catalogs based on the concepts in this standard. Encoded catalogs can be used as standard. Encoded catalogs can be used as additional metadata. additional metadata.

ISO 19110:2005 ISO 19110:2005 -- Methodology for Methodology for feature cataloguing feature cataloguing

concepts used in metadata and wherever concepts used in metadata and wherever temporal information is appropriate temporal information is appropriate

ISO 19108:2003 ISO 19108:2003 -- Temporal Temporal schema schema

concepts used in development of ISO 19125 concepts used in development of ISO 19125 and ISO 19115, ArcGIS, and ISO 19115, ArcGIS, GeoDatabasesGeoDatabases, and , and the foundation for Simple Features GML the foundation for Simple Features GML

ISO 19107:2003 ISO 19107:2003 -- Spatial schema Spatial schema

ESRI is using the concepts in this standard to ESRI is using the concepts in this standard to produce user community profiles of metadata produce user community profiles of metadata and the simple features GMLand the simple features GML

ISO 19106:2004 ISO 19106:2004 -- ProfilesProfiles

Implemented in ArcSDE and ArcGIS Implemented in ArcSDE and ArcGIS Desktop. ESRI played a lead role in the Desktop. ESRI played a lead role in the development of this standarddevelopment of this standard

ISO 19125:2004 ISO 19125:2004 -- Simple feature Simple feature access access –– Part 1Part 1--22

ESRI is implementing the concepts in this ESRI is implementing the concepts in this standard in its implementation of the OGC standard in its implementation of the OGC W*S specifications and is testing W*S specifications and is testing implementation of the developing OGC implementation of the developing OGC ISO19115/ISO 19119 profile for Catalog ISO19115/ISO 19119 profile for Catalog Services Services –– Web (CSWeb (CS--W). W).

ISO 19119:2005 ISO 19119:2005 -- ServicesServices

implemented in ArcIMS Metadata Server implemented in ArcIMS Metadata Server ––9.1, Portal Toolkit 1.0, Portal Toolkit 2.0 and 9.1, Portal Toolkit 1.0, Portal Toolkit 2.0 and in ArcGIS Desktop. ESRI played a lead role in ArcGIS Desktop. ESRI played a lead role in the development of this standardin the development of this standard

ISO 19115:2003 ISO 19115:2003 -- MetadataMetadata

ESRI implements the concepts in these ESRI implements the concepts in these standards in PLTS and in database standards in PLTS and in database production servicesproduction services

ISO 19113:2002 ISO 19113:2002 -- Quality Quality principles &principles &ISO 19114:2003 ISO 19114:2003 -- Quality Quality evaluation proceduresevaluation procedures

ESRI implements the concepts defined in this ESRI implements the concepts defined in this standard in the implementation of gazetteers standard in the implementation of gazetteers and wherever spatial referencing by and wherever spatial referencing by geographic identifiers is usedgeographic identifiers is used

ISO 19112:2003 ISO 19112:2003 -- Spatial Spatial referencing by geographic referencing by geographic identifiersidentifiers

ESRI ParticipationESRI ParticipationCompleted ISO StandardsCompleted ISO StandardsDevelopment / ImplementingDevelopment / Implementing

ISO 19128 ISO 19128 –– Web Map ServiceWeb Map Service

•• Based on OGC WMS specification 1.1.1Based on OGC WMS specification 1.1.1•• Introduced into ISO TC211: 9Introduced into ISO TC211: 9--20002000•• Broader international participationBroader international participation

–– Navigation communities (IHO, ICAO, etc)Navigation communities (IHO, ICAO, etc)–– Small but significant changes, CRS, XML Small but significant changes, CRS, XML

Schema, etcSchema, etc•• Expected completion: 8Expected completion: 8--20052005•• Priority for ESRI implementationPriority for ESRI implementation

–– Depending on ISO publication date Depending on ISO publication date ––ArcIMS 9.2 ArcIMS 9.2

Final Draft sent to ISO for publishing as Final Draft sent to ISO for publishing as International StandardInternational Standard

ISO 19139 ISO 19139 –– Metadata Metadata –– XML XML Schema implementationSchema implementation

Soon to be released as Draft Technical SpecificationSoon to be released as Draft Technical Specification

•• ISO TC 211 work begun: 10ISO TC 211 work begun: 10--20022002•• Defines geographic metadata (Defines geographic metadata (gmdgmd) XML ) XML

encodingencoding–– an XML Schema implementation derived from ISO an XML Schema implementation derived from ISO

1911519115--Geographic information Geographic information –– MetadataMetadata•• Full ESRI supportFull ESRI support

–– David Danko David Danko –– Project Team LeaderProject Team Leader–– Lara Bordick Lara Bordick –– Editing Committee EditorEditing Committee Editor–– Hosting international meetingsHosting international meetings

•• Expected completion: 12Expected completion: 12--20052005–– Priority for ESRI implementationPriority for ESRI implementation

Demonstration:Demonstration:

ESRI Portal ToolkitESRI Portal Toolkit

Searching and Using Metadata

User Management and Personalization

Site Administration

Geospatial OneGeospatial One--StopStop

•• Primary UsePrimary Use–– Discovery and access Discovery and access

to geospatial to geospatial resources (data, resources (data, applications, Web applications, Web sites).sites).

•• Primary GoalPrimary Goal–– Reduce redundant Reduce redundant

investments and investments and facilitate cost sharing.facilitate cost sharing.

What We Learned From the What We Learned From the PrototypePrototype

Five Important InsightsFive Important Insights•• UsabilityUsability

–– Improve user experienceImprove user experience–– Support multiple audiencesSupport multiple audiences

•• PerformancePerformance–– Achieve Achieve subsecondsubsecond

responsesresponses•• InteroperabilityInteroperability

–– Support evolving standards Support evolving standards (Portals, OGC, etc.)(Portals, OGC, etc.)

–– Support data downloadSupport data download•• FunctionalityFunctionality

–– Channels worked Channels worked –– ““two two clicks to contentclicks to content””

–– Marketplace communityMarketplace community•• New technologiesNew technologies……

Search Search EngineEngine--GoogleGoogle

Portal Technology Portal Technology

SpatialSpatialToolkitsToolkits

CommunitiesCommunities

MarketplaceMarketplace

WhatWhat’’s s NewNew

New New InteroperabilityInteroperabilityStandardStandard

JSR JSR -- 168168

Portlet Building BlocksPortlet Building Blocks

What This MeansWhat This Means……GISGIS--CentricCentric

Specialized SearchSpecialized Search

Uniform ViewUniform View PersonalizedPersonalized

GoogleGoogle--LikeLike

Web StandardWeb Standard

New Enabling TechnologiesNew Enabling Technologies

IBM WebSphere Portal

Metadata CatalogMetadata CatalogOracleOracle

MetadataMetadataHarvesterHarvester

Catalog ServiceCatalog ServiceGIS Portal ToolkitGIS Portal Toolkit

PublishPublish SearchSearch Map Map ViewerViewer

AppsAppsApps

Z39.50

ESRIESRI--Google Google Spatial ExtenderSpatial Extender

Google Search Google Search ApplianceAppliance ArcIMSArcIMS

CS-W

OAIWAF / XML

Single SignSingle Sign--on and Personalizationon and Personalization

Other JSROther JSR--168 Portlets168 Portlets

WMS

CS-WZ39.50Google http

WMC

WFS/GMLWCSArcIMS

FGDC

ISO

Open LSGazetteer

Open LS Gazetteer

OAINatural Language

Search

COTS & Standards BasedCOTS & Standards Based

JSR-168

Transformational ArchitectureTransformational Architecture