MD at ArcGIS 106 December 2011 1

Metadata in ArcGIS 10Metadata in ArcGIS 10

John Bocchino: NJ Department of Environmental Protection

John.Bocchino@dep.state.nj.us

Edith Konopka, NJ Office of Information Technology, Office of GISedith.konopka@oit.state.nj.us

Challenges SolutionsChallenges Solutions

MD at ArcGIS 10April 10, 2023 2

OutlineOutlinePart 1: Challenges and Solutions

– What Changed

– What’s New

– Solutions (What To Do)

Part 2: An Optional Editor with EPA EME – What is EME?

– Features

– Usage Basics

•Part 3: EME: A Closer Look

6 December 2011 2

MD at ArcGIS 10

Part 1: Challenges and Solutions

What Changed with ArcGIS 10

• New metadata storage

• New metadata editor

• Must set metadata style

• Old FGDC editor is an add-in

April 10, 2023 36 December 2011 3

MD at ArcGIS 10

Why Change?• ISO is coming, ISO is coming

• Only virtue of old FGDC CSDGM editor: familiarity

• Take advantage of – xml tools– More modern programming platform– Allow users to customize– Accommodate multiple standards

6 December 2011 4

MD at ArcGIS 10

Geospatial Metadata Standards• FGDC CSDGM = “old” standard

– ESRI profile and additions (extensions)

• ISO 19115 = “new” standard• ISO 19115 NAP = “North American Profile”• ISO 19115-1 = revision, currently in-work• ISO 19119 = Service metadata• ISO 19110 = Feature catalog aka Attribute Table• ISO 19115 Inspire = European Union

• More… profiles, etc

• ISO 19139 = XML Schema for expressing ISO 19115 and related in XML

6 December 2011 5

MD at ArcGIS 10

ISO Content: it’s metadata!

6 December 2011 6

•Where–were the data collected?

–were the data processed?

–are the data located?•What

–are the data about?

–project were they collected under?

–are the constraints on their use?

–is the quality?

–are appropriate uses?

–parameters were measured?

–format are the data in?

•When–were the data collected?

–were the data processed?

–were the data published

•How–were the data collected?

–were the data processed?

–do I access the data?

–do I order the data?

–much do the data cost?

–was the quality assessed?

•Who–collected the data?

–processed the data?

–wrote the metadata?

–to contact for questions?

–to contact to order?

–owns the data?

•Why–were the data collected?

Slide content courtesy of Jacqueline Mize, NOAA National Coastal Data Development Center

MD at ArcGIS 10

Talking About Metadata• Section = Big logical chunk

• Element/Attribute = a single structured piece of information, e.g. – <title>Ice Cream Store Point Locations in Westfield, NJ</title>

• XML = Extensible Markup Language (illus. here)

• ISO (UML) attribute vs XML attribute– <step number="3">Connect A to B.</step>– <gmd:date gco:nilReason="unknown"/>

6 December 2011 7

MD at ArcGIS 10

But it’s a little differentFGDC CSDGM vs ISO

6 December 2011 8

Main Sections of FGDC CSDGM

Identification InformationData Quality InformationSpatial Data Organization InformationSpatial Reference InformationEntity and Attribute InformationDistribution InformationMetadata Reference Information

Main Sections of ISO 19115

Metadata InformationSpatial Representation Information Reference System Information Metadata Extension Information Identification InformationContent InformationDistribution InformationData Quality InformationPortrayal Catalogue InformationMetadata ConstraintsApplication Schema InformationMetadata Maintenance Information

•Slide content courtesy of Jacqueline Mize, NOAA National Coastal Data Development Center

MD at ArcGIS 10

New ArcCatalog Editor and ViewerThe Good• Better user interface

• Pick lists and calendars; automatic formatting

• Editor stores xml in geodatabase in native (non proprietary) xml format

• Collects info needed for ISO

• Geoprocessing tools for many metadata functions

The Bad and Ugly• Lots of bugs thru sp2

• Still some bugs at sp3

• Hard to produce/reproduce FGDC CSDGM

• Upgrade scrambles process steps

• ISO metadata not supported by most US catalogs yet

6 December 2011 9

MD at ArcGIS 10

ArcCatalog 10 viewer

6 December 2011 1010

MD at ArcGIS 10

ArcCatalog 10 ArcGIS editor

6 December 2011 1111

MD at ArcGIS 10

ArcCatalog 10 ArcGIS editor

6 December 2011 1212

MD at ArcGIS 10

Workflow Decisions• Keep using old FGDC editor if

– Need FGDC metadata for catalogs– Don’t want to learn new editor until it really works– Have a collection of FGDC metadata that must be

maintained

• Switch to new ArcGIS editor if– Like the latest and greatest– Are willing to do xml editing of “almost ok” FGDC

metadata– Have NO FGDC metadata to start with (maybe)

6 December 2011 13

MD at ArcGIS 10

Which Service Pack?

• ArcCatalog 10.0 and sp1: DON’T USE THIS

• ArcCatalog 10.0 sp2: Use if synchronizing data and FGDC metadata is required

• ArcCatalog 10.0 sp3: Use if switching to new Editor

6 December 2011 14

MD at ArcGIS 10

Using the FGDC Editor at ArcGIS 10

Think, then act

Practical tips follow

6 December 2011 1515

MD at ArcGIS 10

DON’T DO THIS• Don’t use the “import” button

• Don’t “upgrade” your existing metadata before thinking about it carefully

• Don’t use the “export metadata” button

6 December 2011 16

Using the FGDC Editor

MD at ArcGIS 106 December 2011 1717

?

Using the FGDC Editor

MD at ArcGIS 10

Do this first

• Install service pack 2, includes FGDC style– WARNING: may also need one or more patches

• Set metadata style to FGDC

• Download and install FGDC editor

• Optional: Download and install NPS synchronizer (sp2 only)

6 December 2011 18

Using the FGDC Editor

MD at ArcGIS 10

Using the FGDC Editor: Downloads• Service pack 2http://resources.arcgis.com/content/patches-and-service-packs?fa

=listPatches&PID=160&FilterPV_1=654&maxVersion=1&maxCategory=2&FilterVersion=+go+

• Old FGDC editorhttp://blogs.esri.com/Dev/blogs/arcgisdesktop/archive/

2010/06/25/FGDC-Metadata-Editor-for-ArcGIS-10.aspxNote: destination may depend on OS. Editor Addin should be downloaded

DIRECTLY to destination.

• NPS Synchronizerhttp://resources.arcgis.com/gallery/file/geoprocessing/details?

entryID=8DA58FD4-1422-2418-8836-2FE83C67EF7D6 December 2011 19

MD at ArcGIS 10

After installing service pack, setting style

6 December 2011 2020

Using the FGDC Editor

MD at ArcGIS 10

Drag button to toolbar

1

2

After downloading FGDC editor, installation

6 December 2011 2121

Using the FGDC Editor

MD at ArcGIS 10

Viewing FGDC metadataFGDC style – base elements only

6 December 2011 22

MD at ArcGIS 10

Using the FGDC Editor

6 December 2011 23

MD at ArcGIS 10

Moving FGDC metadata

• DON’T USE Import, Export buttons

• DON’T USE Import, Export metadata models

• DO use ArcToolbox Metadata Importer tool for Import AND Export

• Do use ArcToolbox USGS MP Metadata Translator tool

6 December 2011 24

MD at ArcGIS 106 December 2011 2525

MD at ArcGIS 10

Final comments• Instructions for NJGIN contributors

https://njgin.state.nj.us/oit/gis/NJ_NJGINExplorer/docs/Tips_MD_Arc10.pdf

• See Reference handout (will be posted)

Another option for limited editing of FGDC metadata (JB, you’re on!)

• EPA Metadata Editor for ArcGIS 10

https://edg.epa.gov/EME/

April 10, 2023 26

MD at ArcGIS 10April 10, 2023 27

A Simple 3-Tab editor for creating, editing and validating metadata

-ArcGIS 10 Compatible-Standalone

6 December 2011 27

Part 2Part 2: The : The EEPA PA MMetadata etadata EEditorditorCurrent EME v 3.1.2Current EME v 3.1.2

MD at ArcGIS 106 December 2011 28

What is EME?The TurboTax of Metadata Editors

MD at ArcGIS 10

EMEWhy not endorse as an option before?

• Customized for mainly EPA (especially early versions)

– EPA/NJDEP Differences (missing fields) – No ability to easily modify fields/dropdowns (no source code)– No detailed Entity & Attribute Section (just overview)– Multiple Entry Problems (online linkages, process steps)– Additional System Requirements (now in ArcGIS 10)– XML header problems– Other bugs– Major software/hardware changes!

• ArcGIS 10• ISO influence

6 December 2011 29

MD at ArcGIS 106 December 2011 30

Using the EME

• Earlier Versions in ArcGIS (9.x)

– EME 3.0 must be uninstalled prior to uninstalling ArcGIS 9.X.

– EPA has developed a patch to help address this issue (Included in EME v3.1.1 download package)

Uninstall EME 3.0

Uninstall ArcGIS 9.x

MD at ArcGIS 10

Using the EME

• EME v 3.1.2 Requirements– Microsoft .NET Framework 3.5 – ArcGIS 10 (for ArcGIS extension)– FGDC Style Patch (for ArcGIS extension)

• *sp2 (allows viewing of FGDC metadata)

• *Microsoft Access: Enter “Defaults” into select databases– One user with Access can share master database (mdb) in a multi-

user environment

MD at ArcGIS 106 December 2011 32

EME Join NJDEP Email Notification List if not released by Dec. 6th

• Version 3.1.2 available now

• What’s Planned for Next Update (3.2 Jan 2012)– Include additional fields

• Source citation information

• Spatial data organization

• Standard order process

Will match NJDEP Metadata Profile

MD at ArcGIS 10

EMEKey Features

• Custom Synchronization• Keyboard shortcuts for Copy ,Cut and Paste • Metadata Export & Import tools from the EME Toolbar, • Provides direct access to EME Help from the EME Toolbar• Provides EME source code from EME website.• Spellcheck• Find and replace• Validate from within the tool• Microsoft Access database to supply default information

within the user interface!

6 December 2011 33

MD at ArcGIS 106 December 2011 34

EMEEME database moved to new location

– Install directory: inherent metadata.mdb has EPA informationC:\Program Files\Innovate! Inc\EPA Metadata Editor\template\metadata.mdb

*Copy/paste NJDEP metadata.mdb for clean version and to easily configure

– Makes an operational copy of EME database in user directory, e.g., (e.g., C:\Document and Settings\username\Application Data\Innovate! Inc\(EPA ver)

*Copy/paste NJDEP metadata.mdb for clean version and to easily configure

Coordinate metadata with multiple users in your office!Have each modify the operational/user config.xml to point to alternative db

location, e.g.,

<EMEConfig> <MdbFilepathname>H:\EME\metadata.mdb</MdbFilepathname></EMEConfig>

*NJDEP metadata.mdb: http://www.nj.gov/dep/gis/metahelp.htmIf changes made to directly to metadata.mdb and config.xml, best to close and open ArcCatalog

MD at ArcGIS 10

Using the EME

• Access EME as an Extension from ArcCatalog

• Access EME as a standalone application– Start EPA Metadata

Editor

6 December 2011 35

MD at ArcGIS 106 December 2011 36

MD at ArcGIS 106 December 2011 37

Using the EME• The EME Database

– EME uses a Microsoft Access (2000) database to supply default information within the user interface

– Database is structured to align closely with the flow of the user interface

– Modify the database from the EME user interface– Change the location of the database as needed

MD at ArcGIS 10

Using the EME

• Synchronization– Automatically insert

data properties into metadata

– Save time and ensures consistency with data

– Particularly useful for coordinate system and spatial extent

Non-compliant

6 December 2011 38

MD at ArcGIS 10

Using the EME

6 December 2011 39

• The EPA Synchronizer– Lets users control which data properties are

synchronized– Retain information for important elements– Avoid inserting unnecessary information– Access from EME Toolbar

MD at ArcGIS 10

Using the EME• Set EPA Synchronizer as

default• Select which attributes

to synchronize• Apply synchronization

6 December 2011 40

MD at ArcGIS 10

Using the EME

6 December 2011 41

• The EME Validator– Tests metadata records

for compliancy with both FGDC and EPA requirements.

– Validate records one at a time or with batch processing

– Results of validation available in:• EME user interface• Web browser

MD at ArcGIS 10

Awards & Publications

2007: EPA Metadata Editor wins first place for Best Embedded

GIS Application at the ESRI Software Applications Fair

2007: FGDC Newsletter "Spatially Speaking" features EME

2007: ArcUser Magazine features EME

2008: Government Computer News (GCN) 2008 Agency Award

2011: EME wins 2nd Place Award for Desktop GIS Application at

the ESRI User Software Applications Fair

6 December 201142

MD at ArcGIS 10

ArcUser July-Sept 2007

436 December 2011

MD at ArcGIS 10

Ready…Set…Go!

1. Verify Spec’s and Requirements to load EME

2. Download/Install EME from EPA’s EME Websitehttps://edg.epa.gov/EME/

*additional training resources also available here

3. Download NJDEP metadata.mdb version (cleaned up):http://www.nj.gov/dep/gis/metahelp.htm

4. Place NJDEP mdb in the following directories:-Install directory: inherent metadata.mdb has EPA information

C:\Program Files\Innovate! Inc\EPA Metadata Editor\template\metadata.mdb

-Operational copy of EME database in “user” directory, e.g., (e.g., C:\Document and Settings\username\Application Data\Innovate\(EPA ver.)

5. Turn it on! (Customize-Toolbars-EPA Metadata Toolbar)

Next steps….

446 December 2011

MD at ArcGIS 10

Additional Resources• EME Website

– https://edg.epa.gov/EME/• ArcGIS 10 Desktop Metadata Help

– http://help.arcgis.com/en/arcgisdesktop/10.0/help/index.html#//00qp0000001p000000.htm

• ArcGIS Metadata Blog Posts– http://blogs.esri.com/Dev/blogs/arcgisdesktop/archive/

2011/01/03/A-new-approach-for-Metadata-with-ArcGIS-10.aspx

• FGDC Metadata Website– http://www.fgdc.gov/metadata

• DEP Metadata Website– http://www.nj.gov/dep/gis/metahelp.htm

• NJGIN– https://njgin.state.nj.us/NJ_NJGINExplorer/index.jsp6 December 2011 45

MD at ArcGIS 10

Questions?

6 December 2011 46

MD at ArcGIS 10April 10, 2023 47

Part 3 Part 3 EME: A Closer LookEME: A Closer Look

• Existing Metadata vs from Scratch• Using & Importing Templates• Synchronization • Database Usage• Database Entry

• Field Entry• Tool Functions• Validating• Exporting• Archiving

*Hint: First create a test file gdb with some layersEME Tool Demo

6 December 2011 47

Edit

Validate

Set Synchro

Synchro

Clear

Import

Export

Find & Replace

Help