water quality data publishing from an ogc web feature service jonathan doig nsw department of...

Water Quality Data Publishingfrom an OGC Web Feature Service

Jonathan DoigNSW Department of Natural Resources

DIMWG SDISC - 22 May 2006

Context

From CANRI program NRAtlas web portal, catalogue, WMS 2002-03 WFS pilot with ESRI and

Social Change Online

Toward NSW SDI Initial focus on NRM indicator reporting

http://test.nratlas.nsw.gov.au/


Standards ...what we're using and why

Web Feature Service (WFS)

WFS

Mandatory:

Optional:

GetCapabilities Feature Types, GML Object Types, Filter Capabilities

DescribeFeatureType GML schema

GetFeature[WithLock] (queries) Feature Collection

Transaction (Insert, Update, Delete) Status

LockFeature Lock ID, Features Locked

GetGmlObject (by ID) GML element

Request Response



For graphs, download, thematic maps Other agencies can use our data in

their reporting (local, catchment, state, national SoE, ...)

Already supported by GIS vendors

Web Feature Service (WFS)


Observations & Measurements framework

Based on Measurement Theory Application profile of GML, from WFS Standard patterns (where, when, how, etc)

Just insert the bits we need Support by SCOTS software Minimal customisation and maintenance Integrate with other systems (semantic web)



Observations & Measurements frameworkStandards ...what we're using and why

Observations & Measurements framework - detail

ESCAWRI TWG - 12 Oct 2005


Geoserver WFS software

Used in Australian SEEGRID geochemistry demonstrator – all geoscience agencies

Supports complex data & maps from internal tables to community schema

Open source WFS reference implementation geoserver.sourceforge.net


http://geoserver.sourceforge.net/

Deployed componentsIntranet DMZ Internet

Config

GeoserverWFS

3rd-partyApplication

WFSTest

Harness

NRAtlasPortal

SDIRegistryDatabase

SDIRegistry


End user

Applicationdeveloper

FeatureTypes

Queries

Stylesheets

DatasetsContextsServices

Water quality operational

database

Exportscript

Water qualitydistribution

database


1. Select map from home page

[Live demo – test.nratlas.nsw.gov.au] [Skip slides]


2. Click feature on map


3. Choose/confirm query


4. View time-series graph


5. Change query


6. View graph


7. Download data

Contexts

Water qualitydistribution

database

GeoserverWFS


WFSTest

Harness

NRAtlasPortal

SDIRegistryDatabase

SDIRegistry


End user

Applicationdeveloper

FeatureTypes

Queries

Stylesheets

DatasetsServices

Walk-through: Select map from home pageIntranet DMZ Internet

Config

Water quality operational

database

Exportscript

Config


Catalogue-driven WFS workflow

Why use a WFS? To get related or more detailed data for

a selected feature To download data to user To generate a report for an areaTo use a WFS Need to generate a query Do something with results


Overview of main workflow

1. Map locations (using mappable feature type)2. Select site3. “Chain”

Mode (graph/download/report) Target feature (e.g. time-series feature type) Configuration

4. Where configuration not specified in request, look up catalogue for feature type

Query Portrayal configuration Data transform (e.g. to graph syntax)


Views into data

Related Feature Types

Stations(map)

Station id

Time-series(graph)Time-series(download)


Information model Retro-fitted to existing catalogue: all just

METADATA & CLASSIFICATIONS Heterogeneous XML documents in catalogue

(type=DAQM – Data Access Query Model) 1:N Classifications:

FEATURE_TYPE (“relevant to”) ROLE – what part of binding process RESULT_TYPE (for download – to control browser

handling of results) Text/html Text/xml KML (etc)


Existing catalogue/registry design

CLASSIFICATIONCodeSpaceValueReadable_TermFK_ID

1

METADATAIDTitleDescriptionResourceURLTypeX, Y, X1, Y1BeginDate, EndDateCreator, CreateDatePreviewURLMetadataHTMURLXML_CharStream

n


1. Click feature on map


DiscoveredData Service

Catalogue

Form

DAQM

Query

Vocab

CataloguedMetadataDocument

Process

Data transfer(standard format)



Graph

GraphConfig

Graph Defn

XSLT

Data

Query

Data AccessService



3. Download data DiscoveredData Service

(Feature Type)

Catalogue

XSL

Transform(XSL)

DownloadFormat

Viewer


Key to detailed information model

Catalogue Query:

Classifier.X=Y

CODESPACE=XAnd VALUE=Y

XML doc

queryTemplate=URL

HTTP query parameters override defaults

This provides information to set up catalogue contents and bookmarkable query forms



Catalogue

Form

DAQM

Query

Vocab

1. Initiate query (eg click feature on map)

MapContext/Layer or catalogued service

(feature_type)

Type=DAQMClassifier.ROLE=modeQuery(graphQuery | reportQuery |

downloadQuery)Classifier.FEATURE_TYPE=feature_type

Referenced by DAQM

queryTemplate=URL

mode=graph | download | report


Catalogue contents

Detail from Catalogue Maintenance utility



Graph

GraphConfig

Graph Defn

XSLT

Data

Query

Data AccessService

DiscoveredData Service Default: same as original

service(extension – search for

services)

Type=DAQMClassifier.ROLE=graphConfig

Classifier.FEATURE_TYPE=feature_type

DataReformat

graphConfig=URL

graphPackage=URL

service=URL

Type=DAQMClassifier.ROLE=graphPackage



3. Download data

DAQM

Catalogue

XSL

Transform(XSL)

DownloadFormat

Viewer

Type=DAQMClassifier.ROLE=downloadPackage


Mime-type = Classifier.RESULT_TYPE

downloadStylesheet=URL

downloadFeatureType=feature_type

downloadQueryModel=DAQM


Water quality data publishing–other outputs

DNR Web Feature Servicehttp://wfs.test.dnr.nsw.gov.au

Developer doco - for standards-based data models

Project website (below) > Architecture > OandMCookbook

National demonstrationhttp://awdip-demo.socialchange.net.au/wmc/savedapps/awdip

Project websitewww.seegrid.csiro.au > NRInfo > WaterML > WQDP


National alignment

Commonwealth Observer on our project Co-sponsored standards doco Native veg reporting pilot Funded project completion, pilot with NSW & SA Developing Australian water data infrastructure

Northern Territory Co-sponsored Geoserver software development


Indicator governance–who owns what?

Indicator definition

Monitoring results

NameAnalyteUnitsFrequencySampling methodSummary methodRationaleIssue background

Target

Baseline dateTarget dateTarget value

Summarise

AnalyteDate/timeSiteValue

Indicator results

IndicatorTime periodRegionValue/rating

Interpret

Interpretation

TrendPressureResponse

Dataset

NameCustodianOther metadata…


Questions?

Project websitewww.seegrid.csiro.au > NRInfo > WaterML

ContactJonathan Doig +61 2 9895 [email protected]

water quality data publishing from an ogc web feature service jonathan doig nsw department of...

Documents