1

FIS Metadata Catalog

Karen L. Sender, Doug Turnbull,Jan Pappas, Tom Kagehiro, Joseph Dane, Pauli Salmu, Tina Chang

NOAA Fisheries Service, Pacific Islands Fisheries Science CenterNOAA Tech 2006

3 Nov 2005

2

3

Other Metadata Systems

(NOAA Server, NBII, CoRIS, FGDC, etc.)

Catalogs fisheries data holding

What data do we have?

Who has it?

Where is it?

Why do we collect it?

Fisheries Information System (FIS) Program

Inventory Fisheries data holdings

Document details required by FIS

Integration analysis and planning

InPort Supports Critical FIS Activities

Information Management & Quality Planning

InPort Metadata Repository

and Web Site

InPortUsers

What is InPort?

4

Data Catalog Benefits

• Searchable, national catalog of fisheries data

• Available to scientists and managers

• Supports analysis and re-engineering of data collection programs

• Paves the way for integrating data sets

• Promotes best practices

• Facilitate the sharing of data and information

5

InPort Capabilities

• Inventory of Fisheries data holdings

• Detailed documentation of Fisheries data

• Provide metadata for data integration analysis and planning

• Share metadata

6

Data Inventory to Support FIS

• Projects, programs, data collections

• Databases, data sets, spreadsheets, files

• Tables and Columns

• Documents

• Reports

• Statistical Models

• Data Processing flow

7

Metadata Analysis

• Create and promote data standards

• Design data integration schemes

• Share tools, expertise, technologies

• Promote data reuse

• Identify data gaps and redundancies

8

Sharing metadata

Fisheries Data Producers

InPort Repository & Web-site

FIS PortalNBII,

CoRIS, FGDC, etc.

NOAAUsers

OutsidePolicy Makers

Public

PI NESW SENW ACCSPAK

InPort User Interface

InPort Batch Load Interface

Publish MD toClearinghouse

Community Interest Driven Queries

Search

FisheriesIM

Issues & Feedback

Publish Manage

Metadata Research available data and designs

FINS

9

InPort Features

• Create and manage InPort system users and access roles

• Create, edit, manage hierarchical metadata “libraries”

• Import from data dictionaries• Establish relationships between catalog items• Publish metadata (public vs. restricted)• Search metadata• Export metadata

10

Catalog Hierarchy

Example Data System Hierarchy

Hawaii Longline Observer Program

LODS(Data System)

Trips(Database Table)

Set of Data Collection Forms

Fish Length Measurement

Trip_Specification.pdf

LODS(Database)

Trip Num(Column)

Observer ID(Column)

Fish Measurement

Protocol

Set of Data Collection Items

PIFSC Metadata Library

Sea Surface Temperature

Sea Surface Temp. Method

11

Catalog Workflow

DraftReview

orRevise

Approved

PublishedInteral

PublishedExternal

Withdrawn

12

Query and Structure

13

Searching InPort

You can search published catalog items.

InPort lists search results, summaries, and details.

14

Search results

Listing of catalog items with “library” in title, abstract, or description

15

Summary of a Library

Each NOAA Fisheries Service Partner may have their own library or libraries.

16

Search: observer longline

You can search with more specific terms.

Example: observer longline

17

Search results

Catalog items matching “observer” and “longline”

18

Item Summary: project

Each catalog item will have a title, abstract, and other descriptive information

19

Details about a project

InPort lists details about the project: area, procedures, faqs

This project includes a data set and some documentation

20

Details about a data set

Abstract about the LODS data set or database

21

Typical fishery data

Much of fisheries data is time-series information stored in tables or files.

The tables record details about activities relevant to fishery performance.

22

Fisheries table – A set

Example: A set record describes activity that starts with putting fishing lines in the water and ends with pulling them out.

23

Details -- table columns

InPort stores table columns (attributes)

24

Details about columns

InPort stores details about each column or attribute

25

Lists, summaries, details

You can search all published catalog items.

InPort shows search results, summaries and details.

26

Fisheries Information System

Other FIS Serversand Sub-systems

InPort Reposi-tory & Web-site

Application Server(s)Unix

App Server 10g

Database ServerUnix

Oracle9i 9.2.0.4

InPort site:JSP, Apache,Axkit, Forms,

others

InPort DB

FIS Portal

Internet /WWW

InPortQuery Users

Client Sites(e.g., NBII)

Secure Network

Technical Environment

27

FIS Architecture

How to I mprove & I ntegrate Fisheries Statistics

Fisheries Information System

Build on existingregional systems &confidentialityagreements

Enhance to meet nat' lstandards

Establish nationalinformation management& quality standards

I dentify critical,national data

Build processes toreconcile & aggregatestatistics

FIS Data Warehouse

Regional Repositories

Regional Systems

Northeast

Southeast

Southwest

Northwest

Alaska

Pacific Islands

Examples:observer, landings

Atlantic

Gulf

PacificCoast

Alaska

WesternPac

Scientists &Fisheries Managers

Industry, NOAA,Congress

Reconcile &Standardize

Nat

ion

al D

ata

Reg

ion

al D

ata

NOAA IOOS(Integrated Ocean

Observation System)Information Management Standards & Quality Standards

Nat

ion

al D

ata

Reg

ion

al D

ata

VesselRegistration

Catch & Effort

Permits

BiologicalSamples

Commercial &RecreationalFishing

Fishery ParticipantsHarvesters,Dealers,Recreational Users

Paperwork

PRA

Keep a lid onpaperwork!

Timely Answers toNational Questions

How many vesselsin each fishery?When? Where?Species? Gear?Effort?