the swamp advisor 2006 1 the swamp advisor – a new tool for producing consistent &...

15
The SWAMP Advisor 2006 1 The SWAMP Advisor A New Tool for Producing Consistent & Comprehensive Quality Assurance Project Plans (QAPPs) Lawrence H. Keith, Revital Katznelson, & Beverly van Buuren Presented at the NWQMC Meeting May 10, 2006, San Jose, CA

Upload: stephany-patterson

Post on 30-Dec-2015

214 views

Category:

Documents


0 download

TRANSCRIPT

The SWAMP Advisor 20061

The SWAMP Advisor – A New Tool for Producing Consistent & Comprehensive Quality Assurance

Project Plans (QAPPs)

Lawrence H. Keith, Revital Katznelson, & Beverly van BuurenPresented at the

NWQMC MeetingMay 10, 2006, San Jose, CA

The SWAMP Advisor 20062

What is an Expert System?

An “expert system” is an interactive computer program that provides the same answers and advice to questions that a human expert would. It emulates a human expert’s decision-making process in a particular

domain of knowledge.

Advantages Include: Ensures that all necessary questions are addressed and that all

required forms are available. Provides advice and information at any time, day or night, 24

hours a day, 7 days a week. Helps users quickly find specific information and advice for a

particular situation without wasting time on extraneous information.

Gives consistent advice (unlike humans).

The SWAMP Advisor 20063

What is SWAMP?

The Surface Water Ambient Monitoring Program (SWAMP) is the scientific lead for water quality monitoring performed by all Programs of the California State Water Resources Control Board.

In addition, monitoring data collected by all recipients of grants for habitat restoration and pollutant reduction have to be SWAMP-comparable.

The SWAMP Advisor 20064

Why Develop the SWAMP Advisor?

880 water monitoring projects supported by SWAMP. All monitoring projects require a QAPP in a consistent

format and that meets SWAMP protocols & directives. Decisions involving quality objectives, method

selection, the DQO Process, etc. are complex and some users may not be experienced in making them.

SWAMP’s current Electronic QAPP template doesn’t guarantee an acceptable QAPP that will meet DQOs and budgets.

Rejected QAPPs result in wasted staff time and frustrated applicants who must revise them.

The SWAMP Advisor 20065

How Does SWAMP Advisor Work?

Leads users through requirements of a SWAMP QAPP Provides advice as well as information Makes sure that all factors are considered - eliminates

forgetting details that could require re-submission. Helps users consider alternatives and make the best

choices - but it won’t make decisions for them. Doesn’t take the place of a human but simply is a tool to help

the human be more efficient and not forget things. Prepares QAPP components step by step and exports them as

text files (each representing a section of the QAPP) that are later combined by the user to make a QAPP that should be acceptable the 1st time.

The SWAMP Advisor 20066

Software Unique Characteristics - 1. Dual Screen Use

Two panel framework from EMMA and CBR Advisor (preceding expert systems developed under NSF and EPA). Expert System questions and advice displayed in left frame.

Advice also sometimes contains links to text file templates in Microsoft Word format.

MS Word templates are used for simple administrative pages.

Explanation Box accompanying questions and answers is displayed in right frame - often with links to additional info. When additional “advice” is provided, as opposed to

explanations from the QAPP template, the SWAMP Advisor icon is also used.

The SWAMP Advisor 20067

Software Unique Characteristics - 1. Dual Screen Use Illustrated

Note the 3 Navigation

ButtonsA Link - Another Form of Navigation

Expert System Side Explanation Box Side

The SWAMP Advisor 20068

Software Unique Characteristics -2. Three “Planes” of Information

The top level "Executive/Emergency Plane" Gives the user advice and answers for his or her specific

needs as quickly as possible. The second level "Educational Plane"

Provides explanations and ancillary information to help users understand what is being asked of them, why it is being asked, and what the consequences of their actions may be.

The third level "Research Plane" Reached by internal and external hyperlinks from the

second plane - contains extensive in-depth discussions and links to other web sites such as those of US EPA, USGS, etc.

The SWAMP Advisor 20069

Software Unique Characteristics -2. Three “Planes” of Information Illustrated

The SWAMP Advisor 200610

FeaturesColor Coded Title Bars

Groups A, B, C, and D each have Top Level Color Coded Title Bars

Each Element has a 2nd Level Color Coded Title Bar

Each Sub-element has a 3rd Level Color Coded Title Bar

The SWAMP Advisor 200611

FeaturesHyperlinks and Rollovers

Hyperlinks to other files and web sites use standard underlined blue type. These include: Links to RTF template files, Adobe PDF files, PowerPoint slide files, Local web page URLs and other web site URLs

Hyperlinks that are “rolleover” (cursor hover) links are differentiated by using underlined red type. These will include acronym definitions, technical word

definitions, and comments using a standardized glossary.

The SWAMP Advisor 200612

Additional Advantages of the SWAMP Advisor

In addition to having all necessary advice, information and forms available for QAPP preparation 24 / 7, the SWAMP Advisor:

1. Enables multiple lines of inquiry (study questions) and helps users to prepare technical descriptions that are specific to each by looping through applicable questions as many times as needed (i.e., once for each study question) in order to gather all necessary information;

2. Eliminates the arduous preparation of tables for MQOs, performance criteria, and quality check requirements in QAPP Elements 7, 12, 13, 14, and 16 by automatically “looking up” SWAMP Comparable data for each of the parameters selected for monitoring. The Advisor then provides all of these tables at once in an automatically generated file for each study question by using a “Measurement Core Loop” (illustrated in the next slide).

3. Saves completed sections for each QAPP Element in separate files.4. Allows entry to any QAPP Element at any time to facilitate continuing

where you left off if you didn’t complete the QAPP in one sitting.

The SWAMP Advisor 200613

1. Formulate a Study Question.

2. Select Characteristics to Measure (Analytes/Organisms) to Generate Data to Answer a Study Question.

3. Select Quality Objectives (Accuracy, Precision, DL) Adequate to Answer Study Question With Advisor Help.

4. Select Measurement Systems (Methods and Media) That Have Adequate Performance to Achieve Desired Quality Objectives.

5. Define Requirements for Quality Checks & Acceptance Criteria.

6. Automatic Generation of Tables 7, 12, 13, 14 & 16 for Each Study Question’s Separate File.

SWAMP Advisor’s Measurement Core Loop – Process is Repeated for Each Study Question!

File for Study Question #3.

File for Study Question #2.

File for Study Question #1.

The SWAMP Advisor 200614

Limitations of the SWAMP Advisor

Limitations based on your computer1. You must have Java installed (most computers come that way and Java is free

and easily installed if you don’t have it.)2. Your browser must be set to allow Java to be used with it.3. Your computer must allow text files to be sent to it using your browser, so pop-

up blockers and some firewalls must be disabled in order for you to receive these files.

Limitations based on the SWAMP Advisor1. Your files are prepared in Rich Text Format (RTF), so some formatting such as

bold, italics, deleting notes, etc. will be required.2. Tables are produced in comma delimited format, so you must use the “Covert

Text to Table” tool to change the text into regular tables. Limitations based on the SWAMP server

1. Security will not allow your text files to be saved on the server, so they must be sent to your computer.

2. Once you exit the SWAMP Advisor, all data and information gathered from your session that was not saved in the text files sent to your computer, is lost.

The SWAMP Advisor 200615

More Information

Want to see a demonstration? I have my laptop computer here.

Want to see a Poster Presentation? Talk to Will Hagan today from 2:30 – 3:30 pm at Poster

Number 363 “Improving Quality Assurance Programs Using an Expert System.”

Want to contact me after the meeting?

Email: [email protected]