california’s surface water ambient monitoring program data management systems

California’s Surface Water Ambient Monitoring Program

Data Management Systems

Cassandra Lamerdin SWAMP Data Management Team

Marine Pollution Studies Laboratory

Moss Landing Marine Laboratories

Moss Landing, California

Presentation Outline

SWAMP Database Goals

Start Up Principles

Data Elements

Database Systems

Questions

SWAMPData Management Vision and Goals

Provide data of known & documented quality

Create & document systems which ensure data comparability

Make information available to all stakeholders in a timely manner

Facilitate the use of data for decision making processes

Guiding Principles

Capture analytical QC information in the SWAMP database

Do not store calculated values where possible

All samples will have unique geo-references and information about how samples were collected

Data enters database as “draft” and becomes public after SWAMP procedures are completed

Challenges We Faced

Varied study designs

Varied waterbody types

Multiple external sources of data

Analytical laboratories use performance-based methods

Multiple end-user groups and purposes

“SWAMP”

Time Series

Tissue

BiologicalAssessment

Discrete Field

Measures Chemistry Toxicity

SWAMP Data Elements

Responsibilities of SWAMP Database Management Team

Data Entry Training/Facilitation Field data Analytical data

Database Management/Quality AssuranceWork with each Regional Board individuallyComparability checkingVerification of Data Quality Indicators (QAMP) Compliance Coding Transfer data from Temporary to Permanent

Data Training/Accessibility Regional boards State board Outside SWAMP groups

Logistics Coordination

Contracts/Work OrdersRegional Water Boards

State Water Boards

Sampling CrewsDFG/Contractors

Regional Water Boards

Laboratories

Data ManagementReporting/QC

Analyte/Stations Maintenance

Data Facilitation

Data Flow Overview

Data Entry Forms

Lab Lab Lab

Batch Loaded

Batch Loaded

Lab

Field DataSubmission

Analytical DataSubmission

Toxicity DataSubmission

Samples Createdin Field

Database(Temp side)

SWAMP Field Methods Course

For Copies

Contact George Nichol

916-341-5504 or gnichol@waterboards.ca.gov

Example SWAMP Data Sheet

SWAMP Data Entry Forms

Analytical Data Facilitation Use Standard Formats/Training Manual

Lab Liaison develops a rapport with labs Results in data being reported more efficiently Ongoing training

Many labs do not have LIMS systems Provide converters to assist with formatting SWAMP

data

Upload to Database using Data Loading Program

Data Checkers (Batch Level and Global level)

More Automation of SWAMP Systems

Online Templates and Documentation

http://mpsl.mlml.calstate.edu/swamp.htm

SWAMP Data Systems SOPs

Data Flow Overview

Data Entry Forms

Lab Lab Lab

Batch Loaded

Batch Loaded

Lab

Field DataSubmission

Analytical DataSubmission

Toxicity DataSubmission

DataVerification

by Field Crew

DataVerification

by Lab

Samples Createdin Field

PreliminaryVerification

by DMT

Database(Temp side)

Training/Facilitate Data EntryField DataAnalytical Data

Database Management/Quality AssuranceWork with each Regional Board individuallyComparability checkingVerification of Data Quality Indicators (QAMP) Compliance Coding Transfer data from Temporary to Permanent

Data Training/Accessibility

Regional boards State board Groups outside of SWAMP

Responsibilities of SWAMP Database Management Team

Regional Board Liaisons

Consult on integration of sampling designs into information management Modify field data sheets

Assist with data entry training

Completeness checking Follow-up/track down any missing data

Coordinate database distribution

Data access training

Status of data reporting

DMT Data/QA Process Overview

Exp

ort t o

CE

DE

N

TemporarySide

PermanentSide

Data availableto the public

(Web)

Transfer to

Exp

ort to

CE

DE

N

DMT Data/QA Process OverviewE

xpo

rt t o C

ED

EN

TemporarySide

PermanentSide

Data availableto the public

(Web)

Transfer to

Exp

ort to

CE

DE

N

Contractual Project CompletenessVerify MQOs

Compliance Codes

GlobalChecks

Verify Export

VerifyTransfer

SWAMP Data Verification Process Verification against project MQO’s per batch per Project

Analytical data Toxicity data Field data

Verification of QA codes applied on both a batch and result level Original codes applied appropriately Apply any additional codes if necessary

Compliance codes applied based on QA code combinations Compliant, Estimated, Historical, Rejected

Global verification performed on both permanent and temporary side Business rules Completeness Consistency

Verified batches transferred from temporary side to permanent side

SWAMP Data Comparability ExamplesAnalytes, Matrices and Units

SWAMP Business Rules Examples

Responsibilities of SWAMP Database Management Team

Data Entry Training/Facilitation Field data Analytical data

Database Management/Quality AssuranceWork with each Regional Board individuallyComparability checkingVerification of Data Quality Indicators (QAMP) Compliance Coding Transfer data from Temporary to Permanent

Data Training/Accessibility Regional boards State board Groups outside of SWAMP

Data Training / Communication

Creation and maintenance of documentation Field crews Laboratories Data users Agencies required to be SWAMP comparable

Initial and ongoing training 1st Priority: SWAMP Participants 2nd “Non-SWAMP” parties required to be comparable

SWAMP User Group Information exchange Maintain comparability in data reporting

Data access on temporary and permanent side User has ability to build new queries

Data Accessibility

Data Distribution on WWW

http://baydelta.ca.gov/

Successes SWAMP has created information management

standards and documented processes to meet our goals

All 9 Regional Boards are using SWAMP Database, although RB use varies: simple data access to data loading

Continue to collaborate with other agencies (SCCWRP, Bay Foundation, DWR) for system automation

Partnership with DWR allows more time and effort spent on science and less time on technology development

Questions?