quality assurance and quality control for wet deposition...
TRANSCRIPT
![Page 1: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/1.jpg)
2339-1
Workshop on Atmospheric Deposition: Processesand Environmental Impacts
Greg Wetherbee
21 - 25 May 2012
U.S. Dept. Interior, Geological Survey, Denver, Colorado
USA
Quality Assurance and Quality Control for Wet Deposition Monitoring
![Page 2: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/2.jpg)
Quality Assurance and Quality Controlfor
Wet Deposition MonitoringWet Deposition Monitoring
Greg [email protected]
![Page 3: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/3.jpg)
Acronyms for Lecture – 1/2y• ACM – AeroChem Metrics 301 precipitation collector• AIRMoN Atmospheric Integrated Research Monitoring Network• AIRMoN – Atmospheric Integrated Research Monitoring Network• CAL – Central Analytical Laboratory at University of Illinois, USA• DQOs – Data Quality Objectives• fps – f‐pseudosigma = (75th percentile – 25th percentile)/1 349fps f pseudosigma (75 percentile 25 percentile)/1.349,
= non‐parametric analogue of standard deviation• HAL –Mercury (Hydragyrum) Analytical Laboratory at
Frontier Global Sciences, Bothel, Washington, USAo ie G oba Scie ces, o e , as i g o , USA• LCL – Lower Confidence Limit• MDL – Method Detection Limit• MDN –Mercury Deposition Network: total Hgy p g• MPV –Most Probable Value (Median, 50th percentile)• MRL – Method Reporting Limit• NADP – National Atmospheric Deposition Program• N‐CON – N‐CON Systems Precipitation Collector• NMCL – Network Maximum Contamination Level
![Page 4: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/4.jpg)
Acronyms for Lecture – 2/2y• NTN – National Trends Network: pH, Nrxn, SO4
2‐
PRISM P l i R i I d d• PRISM – Parameter‐elevation Regression on Independent Slopes Model, Oregon Climate Center, Oregon State Univ.
• QA – Quality Assurance• QA – Quality Assurance• QC – Quality Control• QAP – Quality Assurance PlanQAP Quality Assurance Plan• QMP – Quality Management Plan• RSD – Relative Standard Deviation• SOP – Standard Operating Procedure• UCL – Upper Confidence Limitpp• USEPA – United States Environmental Protection Agency• USGS – United States Geological Survey (Dept. Interior)
![Page 5: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/5.jpg)
National Atmospheric DepositionNational Atmospheric Deposition Program QA/QC Overview
![Page 6: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/6.jpg)
National Atmospheric Deposition ProgramNational Trends Network (NTN) Jan 2012National Trends Network (NTN) Jan. 2012
![Page 7: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/7.jpg)
National Atmospheric Deposition ProgramMercury Deposition Network (MDN) Jan. 2012Mercury Deposition Network (MDN) Jan. 2012
![Page 8: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/8.jpg)
NADP QA/QC
• NADP Program Office – QA Manager– Overall audit and documentation of NADP data‐collection, management, and reporting systems
• Laboratory internal QC samples & studiesCe t al A alyti al Labo ato y NTN AIRMoN AMoN– Central Analytical Laboratory = NTN, AIRMoN, AMoN
– Mercury Analytical Laboratory = MDN
• USGS external QC programs – 3rd party evaluation
• USEPA external Site Audit Program – 3rd party
![Page 9: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/9.jpg)
Quality Assurance (QA)Quality Assurance (QA)• Procedures documentation and audits• Procedures, documentation, and audits used to control components of a project to h bachieve objectives.
Quality Control (QC)• Data collected and analyzed to estimate bias and ariability of measurementsbias and variability of measurements.
Analyze QC data to achieve QAAnalyze QC data to achieve QA.
![Page 10: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/10.jpg)
Quality Assurance (QA)Quality Assurance (QA)• Implement Controls for Measurements: p
locations regional representationlocations – regional representationcollection time – event, weekly, bi‐weeklystandardized equipment standardized techniquesqpromote sample integrity – preservationpromote sample validity limit contamination?promote sample validity, limit contamination?
![Page 11: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/11.jpg)
Quality Control (QC)Quality Control (QC)• Collect data to challenge / e aluate data• Collect data to challenge / evaluate data‐collection systems:
Does location affect data collected?Does equipment perform properly?Do te h i ue e e e a le i te ity?Do techniques preserve sample integrity?Do laboratories produce accurate data?Are network changes influencing bias?
![Page 12: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/12.jpg)
NADP Program DocumentsNADP Program Documents
QA ONLY EXISTS WHEN DOCUMENTED!WHEN DOCUMENTED!
QA Program PlanQA Program PlanSite Operations Manuals = Field ProtocolsLaboratory QA Program PlansLaboratory QA Program PlansLaboratory Standard Operating ProceduresDocumented Laboratory MethodsDocumented Laboratory MethodsData Validation ProtocolsLaboratory QA Reports ‐ Annualy Q pExternal (USGS) QA Program Reports ‐ Biannual
![Page 13: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/13.jpg)
Sample Validation
Ch k i ibl i d• Check visibly contaminated samples (e.g. plants, insects,
h ) f h hsoot, other) for high concentrations.
• Collector was NOT open during periods with no precipitation (“Dry Exposure”)p p ( y p )
• Collector operated properly
![Page 14: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/14.jpg)
NADP Data Products• Data from a site may only be used for
NADP map products if :NADP map products if :
1) Valid 75% of the year 2) Valid 90% of the2) Valid 90% of the
annual precipitationd thdepth
3) Precipitation data for75 % of the time period
![Page 15: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/15.jpg)
A/ ObQA/QC Objectives
![Page 16: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/16.jpg)
Overall QA/QC ObjectiveQ Q j• Ensure that temporal and spatial trends represent environmental signals and arerepresent environmental signals and are quantified within “acceptable” error limits.
0 141994 = Changed from shipping samples
in collector buckets to bottles1996 = Changed sample filter type
0.14
1996 = Changed sample filter type
mg/L
Na,
0.02
YEAR
![Page 17: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/17.jpg)
QA/QC Objectivej1994 = Changed from shipping samples in collector buckets to bottles1996 = Changed sample filter type1996 = Changed sample filter type
14
L Do we
Eq/L believe this?
H+,
Should the e data be o e ted fo bia ?2
1978 1994 2012
Should these data be corrected for bias?
YEAR
![Page 18: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/18.jpg)
Spatial Data Products QA/QCValid samples Complete data How representative is this map?
2010 NH4+
What is the errorof this interpolation?
![Page 19: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/19.jpg)
Spatial Data Products QA/QC
2010 NH +2010 NH4+
Deposition(kg/ha)
Error (variability) isyalso related to terrain.Example: Ammonium deposition in Rocky Mountains
Deposition = PRISM (ppt) X NADP Concentration
![Page 20: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/20.jpg)
Quality Control (QC) Requires DataQuality Control (QC) Requires DataMeasure 2 components of error inMeasure 2 components of error in environmental data:
• Bias: Positive or negative systematic error i (R l i A )in measurements. (Relative Accuracy)
• Variability: Random inherent error as a result of repeated application of theresult of repeated application of the measurement process under controlled conditions (Absolute Precision)conditions. (Absolute Precision)
![Page 21: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/21.jpg)
![Page 22: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/22.jpg)
![Page 23: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/23.jpg)
![Page 24: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/24.jpg)
NO!NO!
![Page 25: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/25.jpg)
Common Sources of Wet‐DepositionpBias ... & Variability
Sample Contamination – bird droppings, debris, dust, insects, ,operators/people, laboratory
Sample Evaporation – bi‐weekly > weekly > event
Sample Stability – N, P, H+ (pH), Hg
Collector Catch Efficiency –partial events typical
R i bi f l iti d b i i tRaingage bias – false positives, debris, insects,chart vs electronic
![Page 26: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/26.jpg)
QC Sample Types / Purposep yp pBlanks 2 Types: Laboratory & Field / Bias
SpikesReference Materials
Laboratory & Field / BiasReference Materials
Laboratory Replicates Laboratory Variability
Co-Located SamplerReplicates
Overall VariabilityReplicates
![Page 27: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/27.jpg)
Quantifying Bias and Variability inQuantifying Bias and Variability in NADP Measurements
![Page 28: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/28.jpg)
Internal NADP QC ProgramsgInterlaboratory‐Comparisons
Laboratory variability and biasLaboratory variability and bias
Field Supply Blanks – Before Field ExposureField Supply Blanks Before Field ExposureCollector bucket blanksSample bottle blanksSa p e bott e b a ksBag blanksFilter blanksi e a
Special Studiespe ia u ieBias from factors affecting sample integrityBias from instrumentation performancep
![Page 29: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/29.jpg)
External USGS QA/QC ProgramsField Supply Audits – Post Field Exposure
Bias from sample contamination or instability
Co‐Located Collector Studies2 Ide ti al Colle to O e all Va iability2 Identical Collectors = Overall Variability
2 Different Collectors = Overall Bias from2 Different Collectors Overall Bias fromInstrument Changes
Interlaboratory‐ComparisonsLaboratory variability and bias
Special StudiesBias affecting sample integrity, representationBias affecting sample integrity, representation
![Page 30: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/30.jpg)
External USGS QA/QC ProgramsgCo-located Collector
Field Audit
System Blank
![Page 31: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/31.jpg)
2 USGS INTERLABORATORYCOMPARISON PROGRAMS
Ca, Mg, Na, K, NH4,Cl, Br, NO3, SO4,
4 samples / month7 labs in 4 countries:, , , ,
pH, Specific Conductance 7 labs in 4 countries:USA, Canada,Norway, Japan
T t l H b CVAF 2 samples / month
Norway, Japan
Total Hg by CVAF 2 samples / month11 labs:USA, Canada, Sweden,Belgium, Taiwan, Germany,Slovenia, China
Pending: IT, FR, SA
![Page 32: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/32.jpg)
External USGS QA/QC StudiesQ /Q
Arvada Site, Colorado
![Page 33: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/33.jpg)
M h ll Fi ld Sit C l dMarshall Field Site, Colorado
StandardStandardACMCollector
ShieldedACMACMCollector
![Page 34: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/34.jpg)
BiBias
![Page 35: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/35.jpg)
NTN Field Audit
1 2Field Field
Shipped 2 bottles CAL Univ IL
> 24 Hours
Shipped 2 bottles CAL, Univ. IL
43Fi ld 43Field 5
![Page 36: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/36.jpg)
NTN Field Audit& MDN System Blank
What is the maximum contamination that we can expect inWhat is the maximum contamination that we can expect in NTN and MDN samples with statistical confidence?
Network Maximum Contamination Level= 90% UCL of [Contamination] 90% UCL of [Contamination]
with 90% confidence
What is the maximum analyte loss that we can expect in NTN and MDN samples with statistical confidence?
90% UCL of [Analyte Loss] with 90% confidence= 90% UCL of [Analyte Loss] with 90% confidence
![Page 37: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/37.jpg)
Bucket – minus ‐ Bottle Ca2+CONTAMINATION IN NTN SAMPLES, 2009‐11O A I A IO I A E ,
N, 90% UCL
0.10ATON
90% UCL95% UCL99% UCL0.08
AMINA
mg/L MDL
0.06
CONTA IN m
NETWORK MAX CONTAMINATION=0.034 mg / Liter0.04
Ca2+C
0.02
50 60 70 10080 9020 3010 400
PERCENTILES60 70 1009010
![Page 38: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/38.jpg)
Bottle – minus – BucketNH4
+ LOSS IN NTN SAMPLES, 2009‐11mg/L
90% UCL
4 ,SS, IN 90% UC
95% UCL99% UCL
M LOS MDL
ONIUM
0.04 mg / Liter
AMMO
A
50 60 70 80 90PERCENTILES
50 60 70 10080 90
![Page 39: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/39.jpg)
2011 Field Audit2009‐11 Network Maximum Contamination Levels & Ptiles2009 11 Network Maximum Contamination Levels & Ptiles
Analyte NMCL NTN %tileC 2+( /L) 0 034 16Ca2+(mg/L) 0.034 16Mg2+ (mg/L) 0.006 15Na+ (mg/L) 0.015 21K+ (mg/L) 0 007 18K (mg/L) 0.007 18NH4
+ (mg/L) 0.020 40Cl- (mg/L) 0.025 11NO3
- (mg/L) 0.044 13 ( g )SO4
2- (mg/L) 0.030 1H+ ( Eq/L) 1 2 17H+ (Eq/L) 1.2 17
N = 330 sample pairs
![Page 40: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/40.jpg)
Ca + Mg + Na + K Contamination/Loss
Loss Contamination
![Page 41: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/41.jpg)
NH4+ Contamination/Loss
LLoss Contamination
![Page 42: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/42.jpg)
MDN SYSTEM BLANKDeionizedH20
![Page 43: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/43.jpg)
MDN NMCL’s2006 08 0 2332006‐08 0.233 ng2007‐09 0.325 ng2008 10 0 325
Mercury Deposition NetworkSystem Blank Results, 2011
2008‐10 0.325 ng2009‐11 0.285 ng
![Page 44: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/44.jpg)
L2008-10 SYSTEM BLANK
C /N, n
g/L
99% UCL
NMCL = 1.472 ng/L
NAT
ION
99% UCL95% UCL90% UCLTA
MIN
H C t i ti90% UCL
g C
ON
T Hg Contamination =[Hg]system – [Hg]bottle
TAL
Hg
TOT
MRL = 0.13
PERCENTILE
![Page 45: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/45.jpg)
USGS PROGRAMHg LABORATORIESUSGS PROGRAM Hg LABORATORIES
FRLIVLVITO
NLS
NSA ALETHAL GAPMN JSIPSFRL
IVLVITONLS
NSA ALETHAL GAPMN JSIPSNLS
LEEQACZDASNC
WML CASIGNLSLEEQACZ
DASNCWML CASIG
ACTIVEACTIVEACTIVEINACTIVEPENDING / INVITED
ACTIVEINACTIVEPENDING / INVITED
![Page 46: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/46.jpg)
Most Probable Value (MPV)Most Probable Value (MPV)
MPV = median, 50th percentile value
![Page 47: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/47.jpg)
f pseudosigmaf-pseudosigma
f 75th til 25th til / 1 349fps = 75th ptile – 25th ptile / 1.349
A non parametric analog e ofA non-parametric analogue of standard deviation
+1 fps = 67% of values+2 fps 95% of values+2 fps = 95% of values+3 fps = 99% of values
Hoaglin, D.C., Mosteller, F., and Tukey, J.W., 1983, Understanding robust andexploratory data analysis: New York, John Wiley and Sons, p. 38-41.
![Page 48: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/48.jpg)
2011 BLANKS
4 BLANKS ANALYZED / LAB / YEAR
2011 NADP MERCURY ANALYTICAL LABORATORY FRONTIER GLOBAL SCIENCES, BOTHEL, WA, USA
4 BLANKS ANALYZED / LAB / YEARWARNING = 3 fps
CONTROL = 2 fps
MEDIAN ALL LABS=MPVMEDIAN ALL LABS=MPV
![Page 49: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/49.jpg)
USGS NTN PROGRAM LABORATORIES
NILUNILUECST
ACAPCAL NYSDECMACTEC
MOEESA
ECSTACAPCAL NYSDEC
MACTEC
MOEESA
MACTECMACTEC
ACAP EANETCAL NADPCAL NADP ECST CAPMoNNILU EMEPNILU EMEP
![Page 50: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/50.jpg)
CAL SO42-ES
, 0.4
CAL SO4SO
4-2
EREN
CE
ITER +2 and +3 fps-Control Limits
–M
PV S
N D
IFFE
AM
S / L
I
0.0
OR
TED
R
ATI
ON
LLIG
RA
Solutions: SP1 SP17 SP21Natural wet deposition SP97SP3R
EPO
NC
ENTR
IN M
IC
ON
2007 2008 2009-0.4
Example Non‐Parametric Control Chart for CAL SulfateExample Non Parametric Control Chart for CAL Sulfate
![Page 51: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/51.jpg)
2011 Relative Percent Difference from MPVsF N Y k St t D t E i t l C tiFor New York State Dept. Environmental Conservation
PVs
RO
M M
PEN
CE
FR
+10% GuidelinesMPV
DIF
FER MPV
ERC
ENT
PE
![Page 52: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/52.jpg)
LaboratoryAnalyte CAL ECST AMEC
Ca2+ 7 8 3Mg2+ 7 11 6Number of
lg
Na+ 5 1K+ 6 10 7
analysesoutside +/‐10% difference control K 6 10 7
NH4+ 3 6 4
Cl- 2 2 2
difference control limits for 3 labs during 2011 Cl 2 2 2
NO3- 1
SO 2- 1
g
SO42 1
H-ion (pH)S 10Spec. Cond.
10
![Page 53: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/53.jpg)
V i biliVariability
![Page 54: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/54.jpg)
Wet Deposition Data VariabilityLaboratory
AnalysisField
Sample Analysis2%
pExposure
8%
FieldFieldSample
HandlingField a d g26%Instrument
&SiteSite64%
![Page 55: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/55.jpg)
2Hg, g/m2
>18
2Can we actually measure these differences?
2
How reliable is the interpolation?
![Page 56: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/56.jpg)
Common Sources of Wet‐DepositionpVariability
Collector Fetch / Location trees buildings towers otherCollector Fetch / Location – trees, buildings, towers, othernearby objects(a.k.a. “natural variability”)(a.k.a. natural variability )
Field Methods ‐ compliance / non‐compliance
Collector Performance – lid sensors & motors
Raingage Performance Calibrated? Recording properly?Raingage Performance – Calibrated? Recording properly?
Laboratory Variability – procedures, instruments,Laboratory Variability procedures, instruments, contamination
Contamination Variability – climate, landscape, seasonality
![Page 57: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/57.jpg)
Fetch Differences
![Page 58: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/58.jpg)
Increased sensitivity can increase variability.
N CON O ti l SN‐CON Optical Sensor6 particles / 50 sec.
ACM Grid Sensor, >> particles / 50 sec.
![Page 59: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/59.jpg)
Raingage Performance / Seasonal Differences
Snow bridging on gages – an example of conditions that create variabilityconditions that create variability & uncertainty in precipitation records.
![Page 60: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/60.jpg)
Measure Variability with Replicate Samples• Concurrent, multiple samples collected at same times same locations ith identicalsame times, same locations, with identical instruments and protocols.Sites WI98 / 98WI: Co‐located AeroChem Metrics 301 Collectors &Belfort Model 5‐780 Gages
![Page 61: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/61.jpg)
“Non‐replicate” Samplesp p• Concurrent, multiple samples collected at same time same location but withsame time, same location, but with different instruments or field protocols.
CA76 / 76CA
N CONACM
OTT Pluvio2
N-CONBelfort 5-780
![Page 62: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/62.jpg)
CAN5 / CAN6: Quebec, CNA 5 / A 6 Quebec,
Co‐located identical Noah‐IV rain gages,o o a e i e i a oa I ai gage ,N‐CON, AeroChem, and MICcollectors
2 x ETI Noah-IV, Different Shields
NADPCAN5 N-CON NADPCAPMoN CAN5 N-CON NADP
CAN6 ACMCAPMoNMIC Collector
![Page 63: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/63.jpg)
5050
40
45 F
RO
M
N n
g*L-1 COLLOCATED SITES IL11 AND 11IL
COLLOCATED SITES WA18 AND 18WAHg )
CO-LOCATED SITES IL11 / 11 IL
CO-LOCATED SITES WA18 / 18WA
30
35
ENTR
ATI
ON
or 1
8WA
), IN
1:1 Line 1 to 1 line
TOTA
L H
(ng
/ L) CO-LOCATED SITES WA18 / 18WA
20
25
RY
CO
NC
ESI
TE (1
1IL
o
D S
ITE
TR
ATIO
N,
25
10
15
AL
MER
CU
LOC
ATE
D S
OC
ATED
CEN
TR
0
5
10
TOTA
CO
LL
Data eliminated from analysis due to suspected contamination.C
O-L
OC
ON
0
DATA POINT ELIMINATED,SUSPECT CONTAMINATED
00 5 10 15 20 25 30 35 40 45 50
TOTAL MERCURY CONCENTRATION FROM ORIGINAL SITE (IL11 or WA18), IN ng*L-1ORIGINAL SITE TOTAL Hg CONCENTRATION, 0 25 50
0
(ng / L)
![Page 64: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/64.jpg)
Minimum Resolvable Difference Estimator mdMinimum Resolvable Difference Estimator md
md =
)1(
)1(
RSDRSDaverage
Z
Z.
S A l ti t d d d i ti
)1( RSDaverageZ
RSDaverage = Average relative standard deviationof all 2-sample replicates (decimal)
Z = 1.96 for 95% Confidence1 645 f 90% C fid1.645 for 90% Confidence1.28 for 80% Confidence
![Page 65: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/65.jpg)
Minimum Resolvable Difference Estimator mdMinimum Resolvable Difference Estimator md
md * C = UCL of Resolutionmd C UCL of Resolution
C ÷ m = LCL of ResolutionC ÷ md = LCL of Resolution
C = Concentration Measurement
![Page 66: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/66.jpg)
40
30NC
E L 90TH
20
30
FID
EN
S, n
g/L PERCENTILE
23.2 ng/L
20
CO
NIM
ITS MEDIAN
8.63 ng/L
10
95%
L
Measured Value
00 10 20 30 400 10 20 30 40
MEASURED TOTAL Hg CONCENTRATION, ng/LWetherbee, Gay, Brunette, & Sweet (2007), Environmental Monitoring and Assessment
![Page 67: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/67.jpg)
![Page 68: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/68.jpg)
NADP Site Surveys&&
I t u e t U adeInstrument Upgrades
![Page 69: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/69.jpg)
External USEPA Site Survey Program100 Sites per year visited by audit personnel contracted to USEPA.
Every site visited approximately once every 3 years.
Networks: NTN, AIRMoN, MDN
Audits cover:Operator techniques, problemsSit ditiSite conditionsInstrument calibration & performanceReports to site sponsors/operatorsReports to site sponsors/operatorsAnnual report & presentationat annual NADP meetingsg
![Page 70: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/70.jpg)
NADP Wet DepositionpSiting Criteria Rules
45o
30o
45
Collector
N
Collector
dV ≤ 0.3mN
Raingage Wet Bucket = WestSensor = NorthSensor North
http://nadp.isws.illinois.edu/lib/manuals/NADP_Site_Selection_and_Installation_Manual.pdf
![Page 71: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/71.jpg)
NADP Siting Criteria≤ 5m
> 30m
> 20m> 500m
0plants ≤ 0.6m
road > 10m > 500m> 500m
> 1km
fence > 5m
![Page 72: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/72.jpg)
FL11, 1983FL11, 2010
![Page 73: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/73.jpg)
VA13, 2011VA13, 1983
3, 0
![Page 74: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/74.jpg)
ETI Noah-IV Precipitation GagePrecipitation Gage
N-CON SystemsNTN B k t C ll tNTN Bucket Collector
![Page 75: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/75.jpg)
N-CON SystemsD l ChiDual ChimneyMDN Collector
![Page 76: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/76.jpg)
Hg SampleMetals Sample
Hg Sample
![Page 77: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/77.jpg)
Belfort 5‐780Chart Recording Gageg g
OTT Pluvio2
ETI Noah-IV
![Page 78: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/78.jpg)
Current Electronic Raingage Network(All Networks) ...as of April 2012(All Networks) p
ETI Noah-IVOTT Pluvio2BelfortAK
PR VI
![Page 79: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/79.jpg)
Concluding MessagesConcluding Messages
• Precipitation chemistry data require strict attention to clean and consistent field collection and laboratory analysis protocols.
• QC data are collected to quantify bias and variability of NADP data and provide information to achieve QA goals andinformation to achieve QA goals and objectives.
![Page 80: Quality Assurance and Quality Control for Wet Deposition ...indico.ictp.it/event/a11166/session/16/contribution/12/material/0/... · Quality Assurance and Quality Control ... •](https://reader034.vdocument.in/reader034/viewer/2022051723/5aacd04c7f8b9a8d678d5e02/html5/thumbnails/80.jpg)
Concluding MessagesConcluding Messages• QC results provide information to evaluate temporal trends and spatial patterns of wettemporal trends and spatial patterns of wet deposition.
• As NADP upgrades its infrastructure to more modern instruments, QC data are needed to , Qdiscern between environmental signals and instrument bias.
• NADP now has a number of spare Belfort 5 780 i d A Ch M t i 3015‐780 raingages and AeroChem Metrics 301 collectors that could be used for monitoring in USA and abroadUSA and abroad.