QA/QC by variable – status of the implementation planAna Lara-Lopez

Timeline

Start QA/QC review

1st draft QA/QC review

Final draft

QA/QC review

1st draft Implementation plan

2nd draft Implementation plan

October 2015

January 2017

February 2017

August 2017

December 2017

Implementation plan

ISSUE 1: QA/QC across IMOS facilities per variable is inconsistentRECOMMENDATION: Centralising or standardising QA/QC needs discussion.

ISSUE 2: The lack of a written document outlining QA/QC protocols in many facilities RECOMMENDATION: All facilities without a written protocol produce one that includes the QA/QC procedures for all variables derived from this facility.

Evolving and Sustaining Ocean Best Practices

Best Practice Working Group: M. Bushnell, P.L. Buttigieg, J. Hermes, E. Heslop, J. Karstensen,

C. Muñoz, F. Pearlman, J. Pearlman, P. Simpson,

Presented by Jay Pearlman and Cyndy Chandler

Challenges of Best Practices (BP)

Large investments in high quality measurementsQuality of BP Documentation varies widelyData and metadata formats are inconsistent Machine readability is limited (if at all)Sustainability is often not guaranteed

Global Best Practice System

6

Participating Organizations and Programs

RepositoryPeer Review Journal

Advanced Discovery and Access Technology

Benefits

Living, Sustained, Comprehensive System for Ocean Observing Practices

Academic recognition through peer review Improved visibility from search engines Training resource Greater Interoperability across programs and

institutions

7

Best Practice System

Expand IODE repository capabilities

Expand Permanent IDs through DOI, ORCHID

Implement Natural Language search drawing on marine vocabularies; compatibility with machine readability

Alignment with FAIR principles and open operations

Introduction of community peer review including Research Topic in Frontiers in Marine Science

Coming soon:Pilot - April 2018

Implementation plan

ISSUE 3: Calibration of sensors is inconsistent RECOMMENDATION: Centralised calibration and availability of the calibration results to improve confidence.

ISSUE 1: QA/QC across IMOS facilities per variable is inconsistentRECOMMENDATION: Centralising or standardising QA/QC needs discussion.

ISSUE 2: The lack of a written document outlining QA/QC protocols in many facilities RECOMMENDATION: All facilities without a written protocol produce one that includes the QA/QC procedures for all variables derived from this facility.

Calibration

• Inventory of sensors and their calibration history

• Access to calibration history and make it openly available

• Access to raw data, central location?

Implementation plan

ISSUE 4: For some facilities (e.g. gliders) manual QC is lost when data is re-processed, and becomes a time consuming exercise to re-do.RECOMMENDATION: Resolve issue to retain QC when data re-process

ISSUE 5: Data from additional sensors used in some facilities (e.g. SOTS velocity and acoustic data) has not been delivered to AODN RECOMMENDATION: Discuss with facilities the possibility of getting data from additional sensors into AODN

ISSUE 6: Some data needs analysis to obtained an EOV (e.g. active acoustics)RECOMMENDATION: Developing value added products that could deliver these EOV

Implementation plan

ISSUE 7: Some near real time as well as some delayed mode variables have little to no QC.RECOMMENDATION: Implement and develop a set of standard automated test for near real-time QC. Develop QC protocols for facilities with no QC for delayed mode data.

ISSUE 8: QC for some facilities (biologging) is outsourced to partner organisationsRECOMMENDATION: Involvement from IMOS in the QA/QC of these data should be discussed with MEOP.

ISSUE 9: Visual validation of the automated/semi-automated QC from the Matlab toolbox need to be performed and consistent.RECOMMENDATION: Improve visual validation of Toolbox QC results and develop a standard use of the Toolbox.

Implementation plan

ISSUE 10: Obtaining regular user feedback on the quality of the IMOS dataRECOMMENDATION: Clearly define pathways to collect user feedback on the quality of IMOS data.

Implementation plan

http://imos.org.au/fileadmin/user_upload/shared/IMOS%20General/documents/QA_QC_by_variable/QAQC_implementation_draft4.pdf

It is work in progress …