metawhat - cpcbcpcb.ku.edu/media/cpcb/datalibrary/assets/library/...id asr_number sample_number...

ID ASR_Number Sample_Number QC_Code Analysis_Request_No External_Sample_Number Start_Date

1 1383 892 __ 1 08-Aug-2002

2 1383 902 __ 1 08-Aug-2002

Site# Date H20 Temperature Conductance Turbidity

KRS-031 05-Sep-2001 23.7 380 19

KRS-030 28-Aug-2001 21 1 1172 25

3 1383 912 __ 1 08-Aug-2002

METAWHAT?KRS-030 28-Aug-2001 21.1 1172 25

KRS-029 22-Aug-2001 25.5 395 14

METAWHAT?Debbie Baker, 2005 Kansas Biological Survey lunch talk

METADATA!METADATA!description Stream chemistry in Kansascreator Don Hugginscontact Debbie Bakerkeywords Kansas, wadeable streams, nutrients…dates 1999 - 2002methods Horiba used to measure parameters…fields H20 temperature = water temperaturefields H20 temperature = water temperatureunits degrees Celsius

Debbie Baker, CPCB, KBS

Life without metadata

Life with metadata• Information describing data content,

context, quality, structure andcontext, quality, structure and accessibility (Michener 2000).

Topics

• Importance of MetadataImportance of Metadata• Elements of Metadata

Results of Metadata• Results of Metadata• Morpho – Metadata Software• Metacat – Metadata Cataloging

Software• KBS Task Force on Databases

Second KNB Data M W k hManagement Workshop(Knowledge Network for Biocomplexity Project)( g p y j )

2 - 4 February 2005

LTER Network OfficeLTER Network OfficeUniversity of New Mexico, Albuquerque

Topics




Information Entropy over Timeen·tro·py : a process of degradation or

nt

Time of publication

Specific details

en·tro·py : a process of degradation or running down or a trend to disorder– Merriam-Webster

n C

onte

n Specific detailsGeneral details

Retirement or

orm

atio

n

career change

DeathAccident

Ti

Info DeathAccident

Timeafter Michener et al., 1997

LTER Tiered Trajectoryfor Metadatafor Metadata

Tiered Trajectory Metadata completenessThe image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the image and then insert it again.

• Unstructured, machine- readable metadata and data

• Establish data access policy • Data and metadata

• Unstructured, online site catalog with minimal metadata

Tier 1UsabilityAccessDiscovery

• Unstructured, machine- readable metadata and data

• Establish data access policy • Data and metadata

• Unstructured, online site catalog with minimal metadata

Tier 1UsabilityAccessDiscovery

• Structured, comprehensive metadata and data

• Automated access to data• Access to site data

• Online, enhanced metadata with consistent internal

Tier 2

• Data use requires human intervention

access requires human intervention

• Data discovery through manual searches

• Structured, comprehensive metadata and data

• Automated access to data• Access to site data

• Online, enhanced metadata with consistent internal

Tier 2

• Data use requires human intervention

access requires human intervention

• Data discovery through manual searches

stru

ctur

e

• Complete validated EML

• Access- enabling metadata structured in

• Discovery- enabling metadata structured in Tier 3

• Data use does not require human intervention

ccess to s te dataand metadata does not require human intervention

structure• Data discovery through machine search

• Complete validated EML

• Access- enabling metadata structured in

• Discovery- enabling metadata structured in Tier 3

• Data use does not require human intervention

ccess to s te dataand metadata does not require human intervention

structure• Data discovery through machine search

Met

adat

a s

Semi- automated knowledge extraction

Data access through a knowledge- based

Semantic- based discovery throughFuture

• Data analysis is integrated across the

network

EML• Data access is integrated across network

EML • Data discovery integrated across network

Semi- automated knowledge extraction

Data access through a knowledge- based

Semantic- based discovery throughFuture

• Data analysis is integrated across the

network

EML• Data access is integrated across network

EML • Data discovery integrated across network

M

knowledge extractionknowledge based query process

discovery through machine- based searchesOutcome

knowledge extractionknowledge based query process

discovery through machine- based searchesOutcome

Topics




Best Practices – Metadata completenesscompleteness

• IdentificationDi• Discovery

• EvaluationA• Access

• Integration• Semantic Use

Level 1 - Identification• Description – Minimum content for adequate

d t t didata set discovery• Major Elements Added :

Title– Title– Creator– Contact– Publisher– Publication Date

Ke ords– Keywords– Abstract– Dataset/distribution (i.e. URL for dataset (

information)

Level 2 - Discovery

• Description – Level 1 content, plus coverage information to support targeted searches

• Major Elements Added :– Geographic Coverage– Taxonomic Coverage– Temporal Coverage

Level 3 - Evaluation

• Description – Level 2 content, plus data set details to enable end-user evaluation of the methodology and data entities

• Major Elements Added :– Intellectual Rights

P j t– Project– Methods– Data Table/Entity Group– Data Table/Entity Group– Data Table/Attributes

Level 4 - Access

• Description – Level 3 content plus data access details to support automated data retrieval

• Major Elements Added :– Access– Physical

Level 5 - Integration• Description – Level 4 content plus requires

that all aspects of the data package be fully described such as complete attribute and quality control details. Supports computer-mediated access and processing of datamediated access and processing of data.

• Major Elements Added :– Attribute List (full descriptions)( p )– Measurement Scale– Units– Constraint– Quality Control

Level 6 - Semantic• Description – Level 5 content plus semantic

information (make everyone use the same ( yverbage). Currently under development by SEEK (KUNHM!) and may require extension t th EML hto the EML schema.

Baker – what the ?#)@! are you talking

b t? Wh t iabout? What is EML?

Ecological Metadata Language• A method for formalizing and standardizing the

set of concepts that are essential for describing ecological data as well as the format forecological data, as well as the format for recording this information.

• Address lack of dataset documentation. • Provide structure to traditionally unstructured

information.

You really don’t need to know EML. Just use the software we’ll discuss

later.later.

EML Continuedeml

packageId: sbclter.316.18p g

system: knb

dataset

title: Kelp Forest Community Dynamics: Benthic Fish

creator

surName: Reed

individualName

individualName

contact

surName: Evans

Related metadata standards• Dublin Core Element Set

– Corresponds roughly to eml-resource• Content Standard for Digital Geospatial Metadata (CSDGM)

– Federal Geographic Data Committee (FGDC)– Corresponds to eml-spatialRaster, eml-spatialVector,eml-

spatialReferenceOverlaps in other modules (eml resource)– Overlaps in other modules (eml-resource)

• Biological Data Profile (BDP) of the CSDGM– Biological Data Working Group of the FGDC

Shares structure for taxonomicCoverage geologicAge and ascii– Shares structure for taxonomicCoverage, geologicAge, and ascii table structures

• ISO 19115 Geographic information: Metadata– Incorporated in the eml-spatial* modulesp p– Eml-party derived from ISO 19115

• Darwin Core– Partially overlaps with eml-coverage

• Geography Markup Language (GML)

Topics




Results• A self-explanatory dataset or database

Results• A standard, searchable information

format.format.– Morpho: a sotware program into which you

enter metadataenter metadata

– Metacat: a catalog of metadata filesMetacat: a catalog of metadata files (created in Morpho) that you can search over the web.

Topics



Software• KBS Metadata Committee

Morphohttp://knb.ecoinformatics.org/morphoportal.jsp

Welcome to Morpho

Adding a title

•Begin by ddi thadding the

title and an abstract.abstract.

•Click next to add Keywords

Adding geographic metadata•A new window will openopen.•You can choose from a predefined list orlist or create a bounding box using lat long valuesvalues.

Methods and sampling metadata

Adding contact metadata• You can

add new owner details or pick from apick from a locally stored data packagepackage

• Information in red is required

Final Product

Topics




•Flexible storage system for metadata and data

Stores metadata•Stores metadata documents •Supports structured ppsearches•Customizable web i t finterface•Replication capabilities

The Search for Metadatahttp://knb.ecoinformatics.org/index.jsp

Topics




The KBS Task Force on D t bDatabases

The KBS Task Force on DatabasesDatabases

• Charged with addressing a suite of issues relating toof issues relating to databases within KBS.

• Inventory• Access• Documentation• Dissemination

Data

KBS Data Catalog

• Dataset name• Description• Keywords• Spatial extent KBS Cat l• Spatial extent• Start and end dates• Sharing permissions

KBS Catalog

• Data source• File name

File Format• File Format• Contact info

The Changing Landscape of Scholarly Communication:

The Role of Digital Repositories

• Tuesday, March 8, 20059 AM - noon, Big 12 Room, Kansas Union

1:30 - 3:00 PM, the Hall Center for the Humanities

• Sharing and preserving the products of research• Sharing and preserving the products of research, including GIS data. Talks will center on digital repositories and dissemination of scholarly work, and introduce KUs own digital repositoryand introduce KUs own digital repository-ScholarWorks: www.ku.edu/~scholar/.

• Details on seminar: www.lib.ku.edu/scholcommSeminar.shtml.

metawhat - cpcbcpcb.ku.edu/media/cpcb/datalibrary/assets/library/...id asr_number sample_number...

Documents