qapp outline. 2 element 1: title page with approval signatures title of qapp name(s) of...
TRANSCRIPT
![Page 1: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/1.jpg)
QAPP outline
![Page 2: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/2.jpg)
2
Element 1: Title Page with Approval
SignaturesTitle of QAPPName(s) of organizations
implementing projectApproval personnelAssistance agreement or
contract number(s)
![Page 3: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/3.jpg)
3
Element 2: Table of Contents
List of all required elements and their page numbers
AppendicesReferences
![Page 4: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/4.jpg)
4
Element 3: Distribution List
Lists people who will get original and revised QAPP•Everyone who does the work•Everyone who manages them•Funding agency
![Page 5: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/5.jpg)
5
4-Organization of Project
Governmental Entities, Contractors, and Key Individuals.
Roles and Responsibilities.How often will these be done?How will each person do their
job? To whom will they report?
![Page 6: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/6.jpg)
6
Examples of Agencies
Required Agencies•Tribal Environmental Program•USEPA
Other Agencies•TAMS Center•State and Local Partners
![Page 7: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/7.jpg)
7
Possible Contractors
SamplingLaboratory Data AnalysisQA/QC Audit
![Page 8: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/8.jpg)
8
Examples of Key Individuals
Required Tribal employees•Air Quality Program Manager•Quality Assurance Coordinator
Optional positions (may be contractors)•Environmental Specialist•Environmental Technician
![Page 9: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/9.jpg)
9
Program Manager:Roles &
ResponsibilitiesOversees monitoring projectPrepares or reviews quarterly
& annual reports for submittal to EPA
Ensures staff is hired and trained
![Page 10: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/10.jpg)
10
Program Manager:Roles & Responsibilities
(cont.)Prepares & maintains project
work plan & budgetCommunicates with
Environmental Director & EPA Project Officer
Responsible for approval & modifications of project QAPP
![Page 11: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/11.jpg)
11
QA Coordinator: Roles &
Responsibilities Prepares or coordinates
preparation of QAPPsReviews and approves
corrective actionsConducts system audits
![Page 12: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/12.jpg)
12
QA Coordinator:Roles &
Responsibilities (cont.)Oversees or conducts method
performance auditsPrepares QA reportsConducts or oversees data
verification, validation and assessment
![Page 13: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/13.jpg)
13
Environmental Specialist:
Roles & Responsibilities
Conducts sample transport, handling & exchange
Delivers samples to laboratory (by mail or actual drop off)
Signs off on chain of custody forms
![Page 14: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/14.jpg)
14
Environmental Specialist:
Roles & Responsibilities
(cont.)Conducts quarterly calibrations, quarterly audits
Records sample information on data forms
Reports all aspects of monitoring project to Program Manager
![Page 15: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/15.jpg)
15
Project Organizational Chart (Example)
John W. SmithDirector
Navajo Tribe
Alexandria WashingtonAir Quality Program
Manager
Samuel VaughnAir Quality Specialist
EPA as appropriate
Michelle WinstonAir Quality Specialist
Tom LambAir Quality Technician
Laboratory
Sue JonesQA Officer
![Page 16: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/16.jpg)
16
5-Project Background
HistoryContextAssume an
“ignorant” reader (e.g., member of public)
![Page 17: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/17.jpg)
17
Why is this work important?
Are there health effects in your community that may result from this problem (asthma, bronchitis)?
Reduced visibility?
![Page 18: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/18.jpg)
18
More reasons why this work is important:
Concern about possible regional transport of pollutant (ozone precursors)?
Increased development, more roads, businesses, residents?
Concern about children’s exposure?
![Page 19: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/19.jpg)
19
Summarize Existing Information
Previous results from earlier studies?
Results from nearby areas? (if you did not gather the data, you may not be able to use it with your data but it can be useful to you in planning)
Results from emissions inventory?Results from compliance
monitoring of nearby facilities?
![Page 20: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/20.jpg)
20
Who are the Decision-makers?
Tribal CouncilTribal
Environmental Office director
EPA Region
![Page 21: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/21.jpg)
Element 6: Project Description
Ondrea BarberSalt River Pima-Maricopa
Indian Community
![Page 22: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/22.jpg)
22
Summarize Purpose of Project
Why are we making these measurements?
![Page 23: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/23.jpg)
23
Standards
What standard will the measurement
results be compared against (if
applicable)?
![Page 24: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/24.jpg)
24
Field Work-Summary
What kinds of measurements are being made?
What kind of samplers are being used?
How many measurements over what time period?
Site locations
![Page 25: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/25.jpg)
25
Field Activities-Summary
Routine field samplingSample collectionMonthly calibrations/auditsInstrument maintenance
![Page 26: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/26.jpg)
26
Laboratory Work
How are the samples being analyzed?• state the method• can refer to a standard method)
Who is doing the analysis?
![Page 27: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/27.jpg)
27
Schedule
1. Hiring deadlines
2. Training• Dry runs with
equipment
3. Field measurements
4. Analysis5. Reporting
Activity Frequency
Test sampler
October 1, 2005
First sampling
December 1, 2005
![Page 28: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/28.jpg)
28
Assessments
How will you check on yours and the lab’s work to ensure data is good (summarize)?
Who is involved and what are their roles (summarize)?
![Page 29: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/29.jpg)
29
Records of Assessment
Internal assessments (readiness review)
External assessmentsa. PEP audits for PM2.5, NPAP for othersb. Technical Systems Audits
![Page 30: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/30.jpg)
30
YOUR Assessments of the Analysis Lab
Initial review of their QAPP and calibration certificates when you agree to the contract
Onsite visit during the contract
Ongoing review of their QC results
![Page 31: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/31.jpg)
31
Records
BRIEF description of project’s records, • Information on where they are
stored•Ensure that detailed
information is in Section 19 What reports are required?
![Page 32: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/32.jpg)
Element 7: Project Quality Objectives
Mathew Plate US EPA Region 9
![Page 33: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/33.jpg)
33
Project Objectives
Why are we making these measurements?•Conformance with NAAQS•Obtain baseline data•To determine need for additional
monitoring•Health risk evaluation
![Page 34: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/34.jpg)
34
Project Objectives
What will we do with the results?• Compare with
NAAQS• Report to
community, EPA, health officials
![Page 35: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/35.jpg)
35
Systematic Planning
Required by grant regs: 48 CFR 46
Performance criteriaQAPP or equivalentData assessmentCorrective actionQA training for management
and staff
![Page 36: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/36.jpg)
36
Why Systematic Planning
Quality is the extent to which our data is sufficient for purposes it is being used
We need a process that defines objectives for our monitoring data and ensures that we know when these objectives are met
Program objectives should be developed in consultation with decision makers
![Page 37: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/37.jpg)
37
Decision Maker(s)
Those who use data for decisions or conclusions, such as• Is a standard violated?•Should we take action to improve
the air quality?•What is the air quality now, so
that we will know if it gets worse or better?
•Should we be taking more measurements?
![Page 38: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/38.jpg)
38
Who are the Decision Makers for Air
Monitoring Data?
Required Decision Makers for EPA grants•EPA•The Tribe’s Environmental
ProgramOther Decision Makers the
Tribe may consider in quality planning•State and local organizations•Researchers
![Page 39: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/39.jpg)
39
Types of Objectives
Project and Program ObjectivesData Quality Objectives (DQOs)
• Based on Program Objectives• Qualitative and quantitative
Measurement Quality Objectives (MQOs)• Specific criteria which when met should
produce data of acceptable quality• Quantitative
![Page 40: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/40.jpg)
40
Information in DQOs
How data will be used Type of data neededHow data should be collected
![Page 41: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/41.jpg)
41
DQOs Work Backwards...
Degree of uncertainty you can tolerate
Acceptable degree of uncertainty in
each measurement & number of
measurements to take
From
To
![Page 42: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/42.jpg)
42
DQO Functions
DQOs •Link answers to actual
measurements•Set limits on uncertainty so
that data produce required uncertainty in the answer
![Page 43: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/43.jpg)
43
Example
"We know that we meet the standard with 80%
confidence—this means there is a 20% chance that we
could be wrong and we are higher than that standard."
![Page 44: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/44.jpg)
44
Balancing Cost vs. Degree of
Uncertainty Balances costs of taking many
samples with desired uncertainty in Taking many samples with expensive devices yields low decision errors
Taking few samples at low cost yields high decision errors
Result—may have to change objectives, e.g. minivols to see if you need to monitor and ask for more $
![Page 45: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/45.jpg)
45
Accuracy
DQOs are concerned with determining the accuracy of measurements
![Page 46: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/46.jpg)
46
Accuracy
Accuracy = Total error• Includes both bias and precision•Measured by true audit and/or by
evaluating method quality objectives
![Page 47: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/47.jpg)
47
Translating DQOs into Useable Criteria
DQOs should be defined in terms of data quality indicators
Criteria set for the data quality indicators are method quality objectives
MQOs are set by using empirical data, conservative assumptions, statistical assumptions, and/or common sense.
![Page 48: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/48.jpg)
48
Data Quality Indicators
These are sometimes Called the PARCCS
Precision (P)Bias (A) (bias is sometimes called
accuracy)Representativeness (R)Completeness (C)Comparability (C)Detectability (S) (also called
sensitivity)
![Page 49: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/49.jpg)
49
Precision
...how well different measurements of the same thing under prescribed similar conditions agree with each other
“Random” component of error—sometimes high, sometimes low
![Page 50: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/50.jpg)
50
Precision
Precision =“wiggle” (variability within many measurements of the same thing)
You are trying to estimate the variability within the population of “all” your measurements of the same thing (concentration)
Two ways to estimate precision for a single instrument• If you have enough equipment, side-by-side,
can be two or more devices measuring the same concentration
• If you have only one continuous instrument, you must estimate precision by how much the measurement fluctuates over time when it is measuring the same concentration?
![Page 51: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/51.jpg)
51
Precision for Manual Methods
Relative percent difference (RPD)
RPD =*difference between two monitors*
their average
Example: RPD= * -0.05 *=0.05, or 5%
![Page 52: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/52.jpg)
52
Precision Exercise for Manual Methods #1
SiteB
Splr#1
Splr #2 Avg Diff RPD Correc.Action?
Jan 15µ/m3
16µ/m3
15.5 1 -6.5%
Feb 22 20
Mar
24 27
![Page 53: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/53.jpg)
53
Precision Exercise for Manual Methods #2
SiteB
Splr #1 Splr #2 Avg Diff RPD Correc.Action?
Jan 10 µ/m3 9 µ/m3
Feb 6 5
Mar 19 15
![Page 54: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/54.jpg)
54
Bias
A systematic distortion of a measurement process, which
causes errors in one direction (i.e., generally
positive or generally negative)
-15.0
-10.0
-5.0
0.0
5.0
10.0
15.0
Apr-02
May-02
J un-02
Jul-02
Aug-02
Sep-02
Oct-02
Nov-02
Dec-02
J an-03
Feb-03
Mar-03
month
% di
ffere
nce
%differencelower limitupper limit
![Page 55: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/55.jpg)
55
Bias
Bias = how far from “truth” you are, in terms of percentage
Bias = audit result – your result
audit result
Expressed as a percentage, so multiply by 100.
0.03 would be 3%0.11 would be 11%
![Page 56: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/56.jpg)
56
Bias Exercise #1
SiteA
Auditresult
Yourresult
Bias Correctiveaction?
Jan 42ppm
44ppm
Feb 39 42
Mar 32 36
![Page 57: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/57.jpg)
57
Bias Exercise #2
SiteB
Auditresult
Yourresult
Bias Correctiveaction?
Jan 12ppm
11ppm
Feb 19 18
Mar 22 19
![Page 58: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/58.jpg)
58
Bias Exercise #3
SiteC
Auditresult
Yourresult
Bias Correctiveaction?
Jan 55ppm
60ppm
Feb 50 16
Mar 48 47
![Page 59: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/59.jpg)
59
Representativeness
...a measure of how well your measurements represent the entire population of what you
are trying to measure
![Page 60: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/60.jpg)
60
Detectability
…how low can this be reliably measured with this equipment? Is this low enough to measure trends
and evaluate regulatory compliance?
this value is in instrumentation manuals or laboratory QA plan
![Page 61: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/61.jpg)
61
Completeness
... the amount of valid data obtained from a measurement system compared to amount
expected to be obtained under correct, normal conditions
![Page 62: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/62.jpg)
62
Completeness (cont.)
Completeness = # results that are usable (valid)
# measurements necessary
80% completeness 8 valid results
for Quarter 1 10 necessary
Also can do make-up runs to make up missed days
=
![Page 63: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/63.jpg)
63
Comparability
...measure of confidence with which one data set can be compared to another
Beware of apples and oranges in disguise
EPA tries to control this by the method designation process
![Page 64: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/64.jpg)
64
Manual Methods
Our precision measured by side-by-side monitors is 10% or less for all checks
Our bias measured by independent audits (PEP for PM2.5, NPEP for other criteria pollutants and PM10 flow) is 10% or less for all checks
NPEP is mail-in or van program required for all SLAMS and PSD monitors
![Page 65: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/65.jpg)
65
Automatic (Continuous) Methods
Our precision measured by bi-weekly one-point precision checks (flow rate for PM, span gas for other
criteria pollutants) is 15% or less for all checks
Our accuracy, measured by independent audits, is 15% or less for all audits
![Page 66: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/66.jpg)
66
Measurement Quality
Objectives (MQOs)
PM2.5 example considering:•Bias error•Precision error•Completeness
![Page 67: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/67.jpg)
67
EPA’s DQO Standards
for the PM2.5 NAAQS
The question: Does this air meet the annual standard of 15
mg/m3 ?
![Page 68: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/68.jpg)
68
Decision Error Limits
EPA decision: acceptable to make correct decision on attainment 95% of time
5% of time, decision may be wrong
![Page 69: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/69.jpg)
69
EPA Measurement Assumptions
EPA based their calculations on 137 samples in a 3-year period, which is 75% completeness with
a 1 in 6 day schedule
![Page 70: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/70.jpg)
70
MQO Calculations
Using acceptable uncertainty and the other assumptions, EPA calculated that each measurement must have a bias and a precision error (MQOs) of 10% or less
(See element 7 in the EPA PM2.5 Model QAPP)
![Page 71: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/71.jpg)
71
MQOs
If these MQOs are met, then the conclusion about attainment
will be correct 95% of the time
(Maybe - - This assumption needs to be verified when the data is assessed and the DQOs
are reviewed)
![Page 72: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/72.jpg)
Element 8: Special Training
Requirements
Melinda Ronca-BattistaITEP/TAMS
![Page 73: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/73.jpg)
73
Specialized Training
Identify & describe for each person all specialized training/certifications needed
How will training be provided?How will training be
documented (memos to the file of on-the-job training, personnel files with certificates of training, annual appraisals)?
![Page 74: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/74.jpg)
74
What Training Is Necessary?
Technical (equipment, QA/QC, etc.)• From instrument manufacturer• From TAMS
Allot TIME allowed/expected for reading manuals, doing on-line courses—40 hrs?
Document that you have spent 16 (or more) hours reading the QAPP and understand its requirements, using a sign-off sheet, and this will count as necessary training for anyone working on the project
![Page 75: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/75.jpg)
75
What Training Is Necessary? (cont.)
Computer use:• Word processing• Excel (see excellent on-line
courses)• Access
GIS/GPS?On-the-job training/staff
orientationSafety courses? (24-hour field
safety, first aid/CPR etc.) TAMS AQS training
![Page 76: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/76.jpg)
76
Examples of Training Options:
EPA (regional, headquarters, OAQPS [[email protected]], etc.)
ITEP: AIAQTP and TAMS CenterCalifornia Air Resources Board
(CARB)Local or state agencies with whom
you have a good relationship• borrow their manuals• accompany them in the field• document this in your personal logbook
(# hrs spent, activity, instruments, your initials and date; make photocopy for personnel file)
![Page 77: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/77.jpg)
77
Examples of Training
Options (cont.)US EPA’s Air Pollution Training
Institute (APTI); can view tapesTribal/state/local agenciesUniversity/college courses
(college credit, CEUs, etc.)Air & Waste Management
Association (www.awma.org)
![Page 78: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/78.jpg)
78
![Page 79: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/79.jpg)
Element 9: Documentation
and Records
Melinda Ronca-BattistaITEP/TAMS
![Page 80: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/80.jpg)
80
This section needed to:
Protect legal and financial rights of the agency and persons affected by agency’s activities
Ensure that data are legally defensible (e.g., all changes are documented [who/when/why WRITTEN DOWN] )
![Page 81: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/81.jpg)
81
This section:
Is short—complete data management is described in element 19
Think of data management as:• What (requirements)• Why• Who• How• Where• When
Goes in element 19
Element 9
(can be very brief if you reference SOPs!)
![Page 82: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/82.jpg)
82
“What”
This element lists the requirements for the records—what do you require of these records?•Records of planning•Records of operation•Records of data management
![Page 83: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/83.jpg)
83
Records created during project
planning:Hiring and training recordsInitial contracts with instrument
vendors, contractorsBudget recordsPlans for instrument specs,
network, site locations, site visitsLIST THESE RECORDS, WHO WILL
WRITE/REVISE/APPROVE THEM, HOW OFTEN, WHERE YOU WILL STORE THEM
![Page 84: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/84.jpg)
84
Records created during project
operations:Site visitsData transferAudits and assessmentsQC checks (internal and external)CalibrationsLIST THESE RECORDS, WHO WILL
WRITE/REVISE/APPROVE THEM, HOW OFTEN, WHERE YOU WILL STORE THEM
![Page 85: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/85.jpg)
85
Records created during data
management:Download and transferFile naming, moving, pw-protecting,
archivingReview, range checks, flagging,
calculationsReporting to tribe, EPALIST THESE RECORDS, WHO WILL
WRITE/REVISE/APPROVE THEM, HOW OFTEN, WHERE YOU WILL STORE THEM
![Page 86: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/86.jpg)
86
A little detail please…
In the text or table, list for each item :• Any rules—must be written in pen,
dated and initialed• Changes must be made so that original
data is kept legible• Computer files are password-protected
for making changes• Duplicate copies made and stored
where?• How long are they kept and who
decides to throw them away?• File naming conventions?
![Page 87: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/87.jpg)
87
Requirements for data transfer:
Specify rules for:•never over-writing files• frequency of downloading files
from instrument, backing up files•Keeping files on paper (may be
summary if very long) and on disk and in PC (designate PC)
•File structure (see example)
![Page 88: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/88.jpg)
88
File naming convention example:
All your files follow the same format (example): pppp_ssss_dddddd_nnn_rev# • Post this on a wall and changes to it to add
fields • Where pppp=pollutant• Ssss=site name or number• Dddddd=date when measurements made• Nnn=initials of person saving the file• Rev # is the revision number
![Page 89: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/89.jpg)
89
List all documents:
SOPs, QAPP (this one and that of any lab analyzing your samples)
Site logbooks, personal logbooksRepair and maintenance recordsReports drafted, final, sent out to
tribal authorities, EPAPhotos of sitesLetters from community, EPA, etc.
are kept and filed
![Page 90: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/90.jpg)
90
Data handling procedures:
Example: state that this project will use an Access database for all transcribed or input records and data
State that the requirements for data handling are in element 19; this element only lists the records and the requirements for the records
![Page 91: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/91.jpg)
91
List your plans for reports received and
sent out:
Quarterly & Annual Reports submitted to tribe, EPA
Quarterly Laboratory Data Report
Audit reports Quarterly AIRS-AQS Data
submittal to EPAList these in a table
![Page 92: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/92.jpg)
92
References
QA documentsSOPsOther documents
Have all references available in your office
![Page 93: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/93.jpg)
93
![Page 94: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/94.jpg)
Element 10: Network Design
Ondrea BarberSalt River Pima-Maricopa
Indian Community
![Page 95: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/95.jpg)
95
Rationale for Measurement Location
and FrequencyRefer to the data quality objectives
(Element 7)Use the objectives when you decide
where/how often to monitor• Near where people live? • Overall community background? • Near sources?
Discuss purpose of primary & collocated samplers
![Page 96: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/96.jpg)
96
Design Assumptions
Document what you are assuming: •That a source will impact air
quality in the monitored area? •Weather patterns, road use,
community development in the future, whatever
Are your locations reasonable in terms of CFRs and other guidance documents (see ITEP CD)
![Page 97: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/97.jpg)
97
Data Generation/Collection Design
What type of equipment will be used to generate/collect data?
How many will be used? Primary and collocated, meteorological eqmnt
Frequency of data collection (24 hours)? Saturdays & Sundays? How many calendar years?
Is the monitoring equipment FRM or FEM? If so, what is designation number?
![Page 98: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/98.jpg)
98
Sampling Network Design
Do you have special purpose samplers (SPMS) measuring for baseline conditions?
Do you have a SLAMS-designated site that will provide EPA with national data?
Discuss siting requirements • (40 CFR Part 58 App. D & E; although
these may be impossible to meet so do your best, and confer with your EPA regional office)
Monitor location: Roof? Platform? Other?
Spatial scale of representativeness • (40 CFR Part 58 App. D)
![Page 99: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/99.jpg)
99
Monitoring Objectives could
include:1. To determine highest
concentrations expected to occur in area covered by network
2. To determine representative concentrations in areas of high population density
3. To determine impact on ambient pollution levels of significant sources or source categories
![Page 100: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/100.jpg)
100
More possible monitoring objectives
4. To determine general background concentration levels
5. To determine extent of regional pollutant transport among populated areas, and in support of secondary standards
6. To determine culture [EPA calls welfare]-related impacts in more rural & remote areas (i.e., visibility impairment, effects on vegetation)
![Page 101: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/101.jpg)
101
TABLE 1.—RELATIONSHIP AMONG MONITORING
OBJECTIVES AND SCALE OF REPRESENTATIVENESS
Monitoring Objective Appropriate Siting Scales
Population…………..
Source impact……….
General background…
Regional transport…..
Welfare-related impacts...
Micro, Middle, neighborhood
(sometimes urban1)
Neighborhood, urban
Neighborhood, urban, regional
Urban/Regional
Urban/Regional
1 Urban denotes a geographic scale applicable to both cities and rural areas
![Page 102: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/102.jpg)
102
Critical / Non-critical
MeasurementsCritical measurements are required
to achieve project objectives or limits on decision errors• Field measurement requirements (i.e.
ambient temperature, barometric pressure, etc.)
• -What you would include when submitting data to AQS
Non critical measurements are those that are “nice to know” but not make-or-break
![Page 103: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/103.jpg)
103
“Standard” Measurements
Federal Reference Methods (FRMs) and Federal Equivalent Methods (FEMs) provide standard measurements as required by EPA for comparison to the NAAQS
Use of any non-standard measurement method can provide useful information
Also pertains to filter-weighing laboratories – EPA requirements must be met
![Page 104: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/104.jpg)
104
![Page 105: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/105.jpg)
Element 11: Sampling Methods
Requirements
Melinda Ronca-BattistaITEP/TAMS
![Page 106: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/106.jpg)
106
Sampling Method Requirements
Requirements, not procedures go in the QAPP
Attach your SOPs!
![Page 107: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/107.jpg)
107
Sampling Equipment, Preservation,
& Holding Time Requirements
Requirements for getting samples (data) to lab without losing what you are measuring or making it stink…
![Page 108: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/108.jpg)
108
Requirements for the Sample
Volume of air or whatever medium you are collecting
Object with which you are collecting the medium
Data for automatic methods (complete, copied onto floppy, file named correctly, never overwritten)
![Page 109: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/109.jpg)
109
Requirements for PM2.5 Samplers
Installed & operated with adherence to requirements in •40 CFR Parts 50, 53 and 58;•Section 2:12 of EPA QA
Handbook;• the sampler manufacturer’s
operation manual, •SOPs, • and this QAPP
![Page 110: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/110.jpg)
110
Sample (Data) Collection Overview
Schedule of receiving filters (data)
Schedule of samplingSample routeDescribe procedures (may be
in SOP) for when retrieving samples (data) do not go as planned
![Page 111: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/111.jpg)
111
Prevention of Contamination
Requirements for•Temperature•Humidity•Time• Integrity•Custody•Data handling
![Page 112: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/112.jpg)
112
Sample Preservation Requirements for
PM2.5Filter cassettes stored in filter
cassette storage containersStored with the particulate side up.Temperature (40 CFR Part 50,
Appendix L)• No direct sunlight or closed-up
car during summerTime before sample recovery and
time before weighing
![Page 113: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/113.jpg)
113
Set-Up Requirements
WhenWhere How (ref. SOPs)Who Documentation
![Page 114: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/114.jpg)
114
Sample (or data) Recovery
RequirementsWhen
•PM2.5 must occur within 96 hours of end of sample period for that filter
Where (sites)How (order)WhoDocumentation
![Page 115: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/115.jpg)
115
Support Facilities for
Sampling MethodsOffice, trailer, truck, & cooler must be consistent with requirements for•Temperature•Humidity• Integrity•Custody•Storage capacity
![Page 116: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/116.jpg)
116
Field Safety:
State that safety comes before getting the sample (data)
Reference health and safety plan
Provide training if appropriate
![Page 117: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/117.jpg)
117
Field Corrective Action
Who is responsible for fixing it? Verifying that it is fixed? Reporting the fix to?
Where do they write how they fixed it?
When do they have to fix it by?How do you make sure it does
not happen again?Where is the documentation
stored?
![Page 118: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/118.jpg)
118
Corrective Action Responsibilities
(cont.)Who makes sure problem was
solvedWho makes sure it doesn’t
happen againwho approves changes to
sampling locations, personnel, SOPs, QAPP
![Page 119: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/119.jpg)
119
![Page 120: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/120.jpg)
Element 12: Sample & Data
Custody
Ondrea BarberSalt River Pima-Maricopa
Indian Community
![Page 121: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/121.jpg)
121
Sample (Data) Integrity
Packing List Shipping Receipt Annual Shipping Schedule Log BookOther
![Page 122: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/122.jpg)
122
Sample Custodian
Who is responsible for sample or data custody?
Verify sample/data security.Track sample/data storage
location.
![Page 123: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/123.jpg)
123
External Sample Custody Procedure
Formal Chain of Custody Form/Record
Dates/Times SignaturePre-samplingPost-sampling
![Page 124: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/124.jpg)
124
Internal Sample Custody Procedure
Sampling media (filter) receipt
Tracked in Logbooks and/or Computers
StorageAccessArchiveDisposal
![Page 125: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/125.jpg)
125
Data Custody Procedure
Data storageData transferData securityData backup (logger/strip
chart)
![Page 126: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/126.jpg)
126
![Page 127: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/127.jpg)
Element 13: Analytical Methods
Requirements
Melinda Ronca-BattistaITEP/TAMS
![Page 128: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/128.jpg)
128
This element is important for comparability:
Requirements of all FRM monitors are the same, so that data from different sites can be compared
Performance of all labs meeting these requirements is the same, so that data from different labs can be compared
![Page 129: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/129.jpg)
129
Summarize method:
In one paragraph summarize how the lab or instrument conducts the measurement
If FRM or FEM cite the method number
List special components, modifications, inlets
List requirements for equipment you are using (scales, thermometers)
![Page 130: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/130.jpg)
130
List in this element:
Requirements for how well the lab or instrument performs
List analytical methods and equipment
![Page 131: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/131.jpg)
131
Instrument or lab environment:
Limits for temperature, humidity
If the instrument requires a shelter, describe the requirements here
If lab or instrument changes their procedures or performance, who approves it? What are the requirements they/it must meet?
![Page 132: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/132.jpg)
132
![Page 133: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/133.jpg)
Element 14: Quality Control
Melinda Ronca-Battista
ITEP/TAMS
![Page 134: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/134.jpg)
134
QC: An Ongoing System
MeasuringComparing with
MQOGraphing itFixing it when
needed
Everything must be documented and, when significant, reported
![Page 135: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/135.jpg)
135
Evaluate Where Things Can Go Wrong—and How
To Check
Preparing for the fieldSampling in the fieldAnalyzing the samplesEntering the dataReporting the data
![Page 136: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/136.jpg)
136
Error
…the difference between your answer
and the “truth”
![Page 137: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/137.jpg)
137
Bias Error
Minimized by calibrating your equipment against a standard•Make sure the standard has
TRACEABILITY to a NIST standard
•Compare standard to field and/or lab equipment
Measures any bias in your
equipment
![Page 138: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/138.jpg)
138
Verifying the Accuracy of Your
Transfer StandardIf necessary, send your standard to the
manufacturer, who has NIST-traceable equipment, and they send you back your standard with a certificate of traceability
If appropriate, use natural standards, such as freezing ice water for temperature, and carefully document your calibration according to a standard method
![Page 139: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/139.jpg)
139
Single (One) Point Verifications
Single-point verification is when you conduct a check using one flow rate or concentration or value
Span is an example of a one-point check
Verifications DO NOT involve any changes to your equipment or settings
![Page 140: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/140.jpg)
140
Multi-Point Verifications
Check of the response of the instrument to more than one flow rate, concentration, or value
Usually zero, a low level, and at the upper end of the range expected to be measured
![Page 141: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/141.jpg)
141
Example of Verification
Perform a check of your equipment:• flow rate for PM• concentration for gas• internal mass for TEOM
This may be single-point or multi-point
If this is within specifications, record this and continue
![Page 142: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/142.jpg)
142
Calibrations
If results are NOT within specs, then the instrument must be adjusted
This adjustment means that the response of the instrument is changed, which is defined as a CALIBRATION
Must be multi-pointAfter calibrating, check again
at a single point
![Page 143: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/143.jpg)
143
Example for PM2.5
Corrective Action if the flow rate difference between the transfer standard and the sampler is > 4%
Check sampler for internal and external leaks
Ensure that temp. and pressure are within normal ranges
Run check a 2nd time If still > 4%, perform a multipoint
calibration followed by a single-point verification
![Page 144: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/144.jpg)
144
Who can conduct verifications?
Routine checks of instrument stability can be conducted by the site operator
Periodic assessments (may be every six months, may be every year, should be quarterly check of flow rate for PM2.5) should be conducted by someone OTHER than the site operator
QAPP specifies how often these checks are conducted, by whom, what to do if results are off
![Page 145: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/145.jpg)
145
Calculations for Results of
VerificationsConsider the standard to be the
“ideal truth” for your equipment Difference between the “ideal
truth” and your equipment is the instrument error (this may include bias [error either usually high or usually low], and imprecision [wiggle sometimes high and sometimes low])
How is instrument error quantified?
![Page 146: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/146.jpg)
146
Quantifying instrument error:
Truth = the standard’s result
Y = your equipment’s resultYour equipment’s error Truth – Y
Truth
=
![Page 147: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/147.jpg)
147
Remember...
0.02 = 2 %0.10 = 10 %
Bias calculations exercise
![Page 148: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/148.jpg)
148
Precision Error
Some imprecision is unavoidable
Sometimes up, sometimes down–“random”
Estimated by measuring the same thing several times
Minimized by carefully following procedures
![Page 149: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/149.jpg)
149
Two Sources of Precision Error
Field
Lab
Cows can be problems….
![Page 150: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/150.jpg)
150
Estimating Precision
in the FieldEstimate the random “wiggle” errorIf you have more than one of the
same type of instrument, place side-by-side (measuring the same sample of air within a room or small area)
If you only have one instrument make repeated measurements (same sample of air, quickly in time so the air does not “change”)
Verify that results are within limits
![Page 151: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/151.jpg)
151
Estimating Precision
in the LabRepeated filter weighings OF THE
SAME FILTER or standard weightVerify that results are within limits
—if results are very different then there is a lot of imprecision and there may be an intermittent power draw, a breeze blowing onto the scale, changes in humidity….
![Page 152: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/152.jpg)
152
Next steps of QC
If you are outside the limits:Review procedures & logs to
identify problemGo back and review data—may
have to throw out data to the last good check
Fix, document and report (when significant)
![Page 153: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/153.jpg)
153
Calculating Precision Error
Because we don’t know which device is better, there is no “truth,” so use the average as “truth” X = one sampler Y = the other sampler then precision error is
( )x y
x y
2(multiplied by 100 to yield a value in percent)
![Page 154: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/154.jpg)
154
Coefficient of Variation (COV)
COV = coefficient of variation
Where “s” is the sample standard deviation
COV = s/(average)
See the Tribal Data Analysis spreadsheets for example calculations that you can use
![Page 155: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/155.jpg)
155
Remember...
0.05 = 5%0.10 = 10%
Precision calculations exercises
![Page 156: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/156.jpg)
156
Accuracy = Total Error
“Accuracy” for EPA means “total error”
Comparison conducted with completely different system can be used to estimate total error
For PM2.5, this is a performance evaluation conducted with a side-by-side FRM device, with the filter weighed by a different lab
Total error includes both precision and bias errors
![Page 157: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/157.jpg)
157
Blanks
Measure anything that affects the result outside of what you are measuring
May make the result greater (contamination)
Or decrease the result
![Page 158: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/158.jpg)
158
Types of Blanks
For real-time measurements zero checks display the value with no air
Manual methods using filters must use field blanks—accompany “real” samples
Labs must measure their own blanks to assess whether there is any contamination in the lab
If it is possible that samples get damaged or contaminated during shipping use shipping blanks (trip blanks)
![Page 159: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/159.jpg)
159
Field Blanks
Handled exactly as field samples
Some field blanks go everywhere field samples go
With each operator, site, procedure
![Page 160: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/160.jpg)
160
Control Charts
• Try to keep something steady, but it naturally varies
• 95% of time within 2 s of average • 99.8% of time within 3 s of average
red lines within 2 s of average
S = sample standard deviation
![Page 161: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/161.jpg)
161
![Page 162: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/162.jpg)
Element 15: Equipment Testing, Inspection, and
Maintenance Requirements (General Principles)
Ondrea BarberSalt River Pima-Maricopa
Indian Community
![Page 163: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/163.jpg)
163
Purpose of T.I.&M.
Increase system reliabilityData completenessMinimize down timeDocument credibility of data
![Page 164: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/164.jpg)
164
Types of instrumentsEmphasize those instruments
that impact data quality Acceptance testing of
equipmentOutside person to review final
testsProvide a table – referencing
SOPs is okay!
Ensuring your data meets its quality
objectives:
![Page 165: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/165.jpg)
165
Checks
Check equipment before you go into field
Check in field before you make measurements
Check after you make measurements
Ongoing checks and maintenance
Checklists! (include in QAPP, even if you know it will be revised)
![Page 166: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/166.jpg)
166
Personnel
Delineate responsibilities•Person(s) to do T.I.&M.•Person(s) to order equipment and
supplies•Person report to for replacement
parts or potential problems•Person(s) to report problems to
and to contact for corrective actions
![Page 167: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/167.jpg)
167
Procedures
Describe how T.I.&M. will be done • Schedule of T.I.&M.• Documentation in QAPP appendices
(maintenance checklists kept in sampler case and logbook, standard forms with boxes to list values for parameters or check that tubing and wiring is in satisfactory condition)
• Location/storage of completed checklists
• Maintenance history – inventory of replacement parts, suppliers, spare parts, other consumables
![Page 168: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/168.jpg)
168
Visual Inspections
Inspect forDamage to monitorCondition of filter and surroundings
(i.e., cleanliness)Consistent power supply so that
start/stop times are reliableO-rings in place and not tornWires and tubes all attached
![Page 169: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/169.jpg)
169
Inspections
Specify what is done in the field or in the office
Be practicalAllow for adequate time to do
inspections and document their results
Take spare parts such as o-rings with you—add this to the checklist
![Page 170: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/170.jpg)
170
Inspection Considerations
FrequencyInspection parameter – what do you
look for?Action if item fails inspection – how
do you fix it?Documentation (logbooks for each
piece of equipment & inventory of spare parts, oil, etc., instrument or site visit checklists—include in QAPP or reference owner’s manual)
![Page 171: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/171.jpg)
171
Site-Specific Factors
TemperaturePrecipitationWindCurious peopleBirds, bugs,
leaves
![Page 172: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/172.jpg)
172
Toolbox
Screwdrivers (Phillips, flat head, tiny)
WrenchesGlovesDigital multimeter – trouble shoot
electrical componentsExtra batteries – to charge
computer board, etc.Duct tapeState this in the
![Page 173: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/173.jpg)
173
Maintenance
Spare partsLocation of partsInventory of partsWhere parts or equipment are
purchased
![Page 174: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/174.jpg)
174
Schedule of Maintenance
Field or transfer standard traceability to NIST or certificate
of calibration referenced
![Page 175: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/175.jpg)
175
Cleaning Supplies
Ammonia-based general purpose cleaner – clean hub unit
Cotton swabs – clean vent tubes
Soft bristle brushes – air screen, bug screen, etc.
![Page 176: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/176.jpg)
176
Cleaning Supplies (cont.)
KimWipes – lint-freeSilicone-based lubricant –
ensure leak-free fit of rain jar, O-rings, other connections
Powder-free rubber gloves – sample handling, transport
![Page 177: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/177.jpg)
177
Be sure to include:
How you conduct T.I.&M. (reference SOPs, pages from owner’s manuals) or briefly summarize
ScheduleSpare partsCorrective actionChecklists, documentation
sheets
![Page 178: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/178.jpg)
178
![Page 179: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/179.jpg)
Element 16: Instrument Calibration
Ondrea BarberSalt River Pima-Maricopa
Indian Community
![Page 180: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/180.jpg)
180
Calibration
Calibration is defined as•Comparison of instrument
response to a standard and•Adjusting response to fall within
planned limits (remember that if you just check the response and it is okay then that is a verification)
![Page 181: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/181.jpg)
181
List Equipment that Requires Calibration
Identify all tools, gauges, instruments, and anything that produces values
Make a table that lists the frequency of calibration and how it is to be conducted and who is responsible for ensuring that it gets done
![Page 182: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/182.jpg)
182
List Equipment that Requires Calibration
(cont.)
Limit to equipment you will be responsible for
If you use transfer standards (temperature, flow rate, BGI delta-cal) then these must be periodically recalibrated, so that you know they is producing valid results and this is documented
![Page 183: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/183.jpg)
183
Reference Attached SOPs and...
Describe briefly or reference SOP:•How calibration is done•When to calibrate
Summarize calculationsSummarize calibration
records (logbooks, forms, reports)
![Page 184: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/184.jpg)
184
Calibration Standards
Primary standards—keep as the “gold standard”
Field, transfer, or working standards are used in the field
These apply to flow rate, temp., pressure, etc.
![Page 185: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/185.jpg)
185
Types of Calibration
Multiple pointZero-levelRepetitions at each
concentrationAlways verify stable operation
after a calibration by checking at least one point again
![Page 186: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/186.jpg)
186
Changes to Calibration Schedule
You may have to recalibrate if you:
Move, repair, or reassemble equipment
If QC checks show degradationIf QC checks show great
stability, then may not have to recalibrate so soon
Change in weatherChange in pollutant
concentration
![Page 187: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/187.jpg)
187
Justification for Changes
Documentation—write a memo to the files (see example on CD)
External reviewer—get a reality check from another person
Periodic verifications of your calibration schedule and procedures
![Page 188: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/188.jpg)
188
Do Calibrations Yourself?
Requires careful documentation
Use standards calibrated by vendor or another certified lab•Use these standards to
calibrate your instruments
![Page 189: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/189.jpg)
189
If you need a Laboratory
Get copy of laboratory’s QAPP, include as appendix to your QAPP
Conduct tour of facility if possible
Communicate regularly with facility personnel
Make sure lab documents everything, provides reports
![Page 190: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/190.jpg)
190
Documents to you from analysis lab:
Copy of their QAPPCopies of their internal
performance evaluations within the last year, and throughout the project
Agreement that they provide you data on paper and electronically (via email) in excel or whatever format you agree to
![Page 191: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/191.jpg)
191
Documents to you from the lab that certifies your
calibration standards:
Copy of calibration certificate showing what standard they use to calibrate your equipment
Traceability of this standard to the National Institute of Standard and Technology (NIST)
Agreement that they provide you a calibration certificate and detailed report on paper and electronically (via email) in excel or whatever format you agree to
Outline of calibration procedure
![Page 192: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/192.jpg)
192
![Page 193: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/193.jpg)
193
![Page 194: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/194.jpg)
Element 17: Inspection and Acceptance for
Supplies
Ondrea BarberSalt River Pima-Maricopa
Indian Community
![Page 195: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/195.jpg)
195
Requirements
What are the requirements for the equipment / supplies
you will use during the project?
![Page 196: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/196.jpg)
196
Make a List
All supplies & consumables that may directly or indirectly affect the quality of the project•Filters•Hoses•Oil•Batteries•Disks
![Page 197: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/197.jpg)
197
Provide a Table Listing
DescriptionVendorSpecifications Model numberCall the sales rep. and ask
them to fax you a list of what parts will be needed
![Page 198: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/198.jpg)
198
Two tables may be needed:
(1) listing of critical supplies, parts (hoses, filters, disks, etc.)
(2) list of their acceptance criteria (diameter/type of hose, type of filter, disks preformatted, whatever is appropriate)
![Page 199: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/199.jpg)
199
(1) List of Critical Supplies:
Example First Table for PM2.5: Critical Supplies and Consumables (excerpt)
Area Item Description Vendor Model Number
Sampler Impactor Oil Tetramethyltetraphenyl-trisiloxane (30ml)
Dow Corning@ 704 Oil
Sampler 37 mm GlassFiber Filter
For use in impactor well XYZ Company xxxx
Sampler Rain Collector Glass XYZ Company xxxx
![Page 200: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/200.jpg)
200
(2) Acceptance Criteria
List criteria for each itemShould be consistent with
project’s overall technical and quality criteria
Should reflect common sense, but need to document the basic requirements, even if they seem obvious to you
![Page 201: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/201.jpg)
201
(2) Acceptance-Criteria Table
Second Table: Example Acceptance Criteria for Supplies and Consumables
Equipment Acceptance Criteria Action if requirements not met
Impactor Oil Is the oil identified asTetramethyltetraphenyl-trisiloxane
Return
37 mm Glass Fiber Filter Filters of the correct size andquality
Return
Rain Collector Not broken Call Vendor, will likely notreturn
![Page 202: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/202.jpg)
202
![Page 203: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/203.jpg)
Element 18: Data Acquisition Requirements
for Non-Direct Measurements
Melinda Ronca-BattistaITEP/TAMS
![Page 204: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/204.jpg)
204
What is non-direct data?
Any data that you do not gather, such as•Weather information•Housing information•Physical constants• Instrument parameters
![Page 205: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/205.jpg)
205
Examples
Chemical and physical properties data
Operations manualsGeographic data – site, boundary
conditions, met sitesData from previous studiesMeteorological information – U.S.
Weather Service Data, wind rose information
Census data, housing office data
![Page 206: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/206.jpg)
206
Be sure to include:
Any non-direct data you plan to use
How you plan to use itIf you are using historical
monitoring data, how you will keep track of which data you gather and which data you have gotten from another source
![Page 207: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/207.jpg)
207
Why is the QA Significant?
If you plan to use the data with yours, data that you do not gather should:•Have undergone QA review•Meet quality objectives
established for your programThis means that you need to get
a copy of their QAPP or QA report and compare with this QAPP
![Page 208: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/208.jpg)
208
Step 1 – Describe your Requirements:
How you are going to use this data
Whether this could change conclusions
What are your quality objectives for this data
If the data is critical describe some or all QC parameters
![Page 209: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/209.jpg)
209
Step 2 – Describe the Data Sources:
Nationally recognized source (USGS, NWS, & NIST)
Peer Reviewed Source (published in a peer reviewed journal)
Monitoring data from another study
![Page 210: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/210.jpg)
210
Step 3 – Determine if Data Validation will be
Performed:If the data is from a nationally
recognized source and is being used for a similar purpose validation is probably not needed
If the data has not undergone external review and/or the data will be used to meet a different purpose than intended (when collected) some level of validation is required
![Page 211: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/211.jpg)
211
Step 4 – Describe Data Validation for data you plan to use but did not
gatherReview QC checksReview QA evaluationsCompare to other data setsPerform QC measurementsDon’t be afraid to discard data
that you don’t trustReference validation in elem.
24
![Page 212: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/212.jpg)
212
![Page 213: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/213.jpg)
Element 19: Data Management
Melinda Ronca-BattistaITEP/TAMS
Ondrea BarberSalt River Pima-Maricopa
Indian Community
![Page 214: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/214.jpg)
214
Six Elements of Data Management
(1) Data processing and transmission (WHAT)
(2) Data end use and integrity protection (WHY)
(3) Data access (WHO)
![Page 215: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/215.jpg)
215
Six Elements of Data Management (cont.)
(4) Data dissemination (WHERE)
(5) Data storage and retrieval (HOW)
(6) Data disposal (WHEN)
Document everything!
![Page 216: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/216.jpg)
216
Describe in the QAPP:
Brief description of•Data management objectives (all
data is retrievable)•How you will meet these objectives
(no data erased, no files overwritten, use sharpies, date and initial)
•Describe (briefly) your paper filing system
•Describe logbooks: personal, instrument
•Electronic filing system, file naming system
![Page 217: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/217.jpg)
217
Data Flow
Step by step data trackingWho has access to readWho has access to change dataVersion tracking of filesHow changes are approvedHow file integrity is checked
![Page 218: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/218.jpg)
218
Files for each instrument and any
extra sensors:Request as much information
as possible electronically and on paper from vendors to allow you to make extra copies
Maintain file for each instrument with contact information, calibration records, manuals
![Page 219: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/219.jpg)
219
Material Receipt and Storage
Use logs for everything (see examples in template QAPPs)
Use indelible markers Use tagsUse designated shelves with
labelsUse SOP that is POSTED
![Page 220: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/220.jpg)
220
Types of Field Data Sheets
Site Data Sheets • document the site information• in site files and in database
Sampler run data sheets• go into field• input info into database
Verification data sheets• every 4 weeks (1-point flow rate, temp,
pressure, time) Internal audit data sheets
• for the sampler and extra sensors (your own audits)
![Page 221: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/221.jpg)
221
Before leaving office for the field:
Review the number of each item you will need, and bring backups (use a checklist)
Check field data sheet from previous visit to site
PM2.5: Ensure that there are filter cassettes for routine, field blanks, and collocated samples
PM2.5: Ensure there are enough field transport containers, ice substitutes, max/min thermometers, preprinted mailing labels, if mailing immediately
![Page 222: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/222.jpg)
222
Write in pen and update the documents:
Continuously update the checklist in pen• make photocopy• put in “to-do” pile to
– add the information to the database– change the form in the computer if
appropriate
At the site draw a map on the field data sheet
Take photos if possible
![Page 223: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/223.jpg)
223
Sampler Placement Records
Unobstructed air flow for a minimum of 1 m in all directions
Inlet at a height of 2 to 15 m above ground level
If collocated with any other PM sampler, the spacing between sampler inlets must be > 1 m for other PM2.5 samplers and > 2 m for PM10
All samplers that are called collocated must be within 4 m
Sampler inlet must be level Vertical distance between two inlets < 1
m
![Page 224: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/224.jpg)
224
Sampler Maintenance and Cleaning Records
Plan all required maintenance 12 months ahead—post 3 months on a calendar
Use a checklist that includes items to bring with you and what to do for:• Every visit (filter change data sheet)• Every month (1/3 day schedule) or
quarter (1/6 day) (verification data sheet)
• Every quarter (flow rate audit data sheet)
• See examples
![Page 225: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/225.jpg)
225
Computer Backups
Every two weeks or as data are gathered—add “back up today” to calendar
Alternate between two sets of backup ZIP or JAZ disks
Store backup disks in a relatively fireproof location (another building, garage)
Plan for the time and money it takes to save copies of files
![Page 226: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/226.jpg)
226
Supplementary records must be kept for only 3
years
Chain of custody formsNotebooksField data sheetsField data sheets
![Page 227: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/227.jpg)
227
Keep records organized in
readiness for an audit
Paper copies must be available to auditor to attach to their reports in the categories of:• Management and organization• Site information• Field operations• Raw data• Data reporting• QA
THE BEST WAY TO GET RID OF AN AUDITOR QUICKLY IS TO GIVE HER PAPER COPIES OF EVERYTHING SHE WANTS
![Page 228: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/228.jpg)
228
Site information files to include:
Site Data SheetsSite mapsSite photosSummary of instruments at
each site and shelter, trailer information
Addresses, names, phone numbers
![Page 229: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/229.jpg)
229
Field Operations files to include:
Instrument manuals, warranties, calibration certificates in a file for each instrument
Standard operating procedures (SOPs)
Field notebooks and communications
Copies of most recent field sheetsInspection/maintenance records
![Page 230: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/230.jpg)
230
Raw Data files to include:
Any original data (routine and QC data on disk and paper)
Reports from laboratory or external audits
Strip chartsDisksSupporting data, such as NWS
data
![Page 231: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/231.jpg)
231
Data Reporting files to include:
Internal reports Weekly/monthly summariesCorrective action reportsReports to EPACopies of presentations to
community
![Page 232: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/232.jpg)
232
QA files to include:
For each instrument, copies of instrument check reports (verifications)
Calibration reports (multipoint using some standard)
Archived control chartsQA reportsAudit reports and reports on how
problems were solved (corrective action reports)
![Page 233: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/233.jpg)
233
Measurement results should be kept
indefinitely
Data must be accessible for 5 years
All official reports kept for 5 years
Paper copies can be discarded after 5 years and electronic copies archived on disk/CD
![Page 234: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/234.jpg)
234
Data Transformation & Analysis
Data analysis requirements contained in 40 CFR Part 58, Appendix A
Show equations you will use (usually simple relative percent difference)
Show examples of charts (use example control chart in the template QAPP)
![Page 235: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/235.jpg)
235
QAPP outlines plans for data transmittal:
How data gets from equipment into your computer
How (who, how often) data is input
How (who, how often, how much) someone double checks data entry
How data is sent electronically How you will transfer data into
AQS
![Page 236: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/236.jpg)
236
Describe plans for data flagging
Criteria for flagging dataFlags may be generated by the
instrumentFlags may be noted by you on
the site data sheet (e.g., high winds) and entered into the database later
Flags may be automatically written into a column in excel if values are outside a specified range (see example on CD)
![Page 237: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/237.jpg)
237
Describe plans for data storage &
retrieval
Data archival policies: where, how long, on paper and disk
Security of data; locked cabinet; password-protected
Database management
![Page 238: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/238.jpg)
238
![Page 239: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/239.jpg)
Element 20: Assessments &
Response
Mathew PlateUS EPA Region 9
![Page 240: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/240.jpg)
240
Corrective Action
Designed to identify and correct flaws in your system
Anyone can start and document corrective action
Documented by a formal process (a review by a supervisor and a memo to the file; see example)
![Page 241: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/241.jpg)
241
Internal Assessments
May be qualitative, such as a review of whether documentation is in order, or technical, checking procedures, and
May be conducted by your tribal air organization•Someone who has common sense
and is technically competent •Someone from another program,
such as water, solid waste
![Page 242: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/242.jpg)
242
Internal Assessments, cont.
May be informal and consist of a review between you and your supervisor on progress
IF this is to be considered an assessment it must be DOCUMENTED; use a checklist or memo
![Page 243: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/243.jpg)
243
External Assessments
Performed by outsiders such as another tribe, EPA region, or consultant who is technically qualified
andUnderstands project’s QA
requirementsA real auditor
![Page 244: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/244.jpg)
244
Types of Assessments
Surveillance• “Over-the-shoulder” monitoring of
project & records; this can be internal or external
Technical Systems Audit (TSA)• On-site examination of facilities,
equipment, personnel, training, procedures, and record keeping, usually conducted by EPA
Performance Evaluation (PE)• involves numeric comparison of
results between auditor’s equipment and yours
![Page 245: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/245.jpg)
245
Performance Evaluations:
Internal• that you conduct as a “test” with a
borrowed standard, during an inter-comparison with other agencies—VERY useful, esp. before an external audit
External• side-by-side on-site with another
device independently calibrated Comparison of your results with
equipment mailed to you or in an EPA van (NPEP)
![Page 246: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/246.jpg)
246
Definitions of Assessments
Audits of data quality – qualitative • are you working toward your
objectives? Do your measurements make sense?
Data Quality Assessments – quantitative • comparison of results with someone
else’sManagement Systems Reviews
• review of QA system; usually conducted by EPA
Network Reviews • are your locations/instruments
appropriate?
![Page 247: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/247.jpg)
247
All Assessments:
Basically compare•What is actually being done in the
field and the office•Against what is stated in the
QAPP and SOPs
![Page 248: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/248.jpg)
248
Readiness Review—one type of Internal
AuditConducted before starting routine
measurements to assess: “are we ready?”
Technical components – equipmentTrainingThe report should be approved by
an uninvolved personReadiness review can be counted as
an internal assessment, IF it is documented and any problems are resolved and documented as well
![Page 249: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/249.jpg)
249
Technical Systems Audits
Every three yearsLook at reports, computer
files, logbooks, control chartsFollow people around Compare what is happening
with QAPP and SOPs
![Page 250: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/250.jpg)
250
Technical Systems Audit (cont.)
Field operations: sampling, shipping
QA – corrective actionQC – field checks, data
flagging, record keepingData management: securityReporting – accuracy
![Page 251: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/251.jpg)
251
Audit of Data Quality
Evaluating your data before you report it•How data are handled•What judgments were made•Do your conclusions make sense?
Annually and as part of a technical systems audit
![Page 252: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/252.jpg)
252
Network Review
40 CFR Part 58 Appendices D and E
How well is your network meeting its objectives?
How should it be modified?Conducted formally annually,
but you should be continually assessing your results
![Page 253: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/253.jpg)
253
Describe in your QAPP
Number, frequency, and types of assessments
People or organizations doing the assessments
ScheduleCriteria for assessmentsReporting and responsibility for
follow-up
![Page 254: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/254.jpg)
254
Element 20 includes a table listing assessments:
Assessment Activity
Frequency Personnel Responsible
Schedule Report Completion
Reporting/Resolution
Network Reviews App E
Ongoing informally and annually
Describe the first schedule and how often after that
30 days after formal review
Who is responsible for doing the assessment, who makes sure the problems get corrected?
Technical Systems Audits
1/3 years 30 days after activity
Performance Evaluation--Internal
Quarterly?
Performance Evaluation--External
Annual?
![Page 255: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/255.jpg)
255
Responsibility for Follow-Up and Verification of Corrective Action
CLOSE THE LOOP (fix problems and take action to
make sure they do not happen again)
And make sure it is documented
![Page 256: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/256.jpg)
256
![Page 257: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/257.jpg)
Element 21: Reports to Management
Ondrea BarberSalt River Pima-Maricopa
Indian Community
![Page 258: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/258.jpg)
258
Purposes of Reports
CommunicateDocument TrackCYA
![Page 259: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/259.jpg)
259
PM2.5 Reporting
Pictures are worth a thousand words— CHART YOUR DATA—by site, by date
Flow Rate Audits conducted quarterly by someone other than the routine site operator
Results of collocated FRM samplersResults in ranges of concentrations
(see tribal data analysis spreadsheet)
40 CFR 58 Appendix A (Section 3.5)
![Page 260: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/260.jpg)
260
Corrective Action Reports
OngoingWhat, where, when, who, how,
whyVerification of permanent
solution
![Page 261: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/261.jpg)
261
Report Tracking
ListThose responsible for
generating and reviewing reports
What is in each report (brief)How often each type of report
is issuedWho receives each type of
report
![Page 262: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/262.jpg)
262
![Page 263: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/263.jpg)
Element 23:Data Review Methods
Melinda Ronca-Battista
![Page 264: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/264.jpg)
264
Data Validation
Can the data be used for the purpose it is intended?
Is the data invalid or can it be used with qualifications?
Is the data generation process likely to produce invalid data in the future?
![Page 265: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/265.jpg)
265
Data Validation Templates
Developed by OAQPS, EPA Regions and monitoring organizations
Three tables generated
![Page 266: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/266.jpg)
266
Data Validation Tables
•Critical – In CFR with acceptance requirements
![Page 267: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/267.jpg)
267
Data Validation Tables
•Operational – In CFR without acceptance criteria or identified in guidance
![Page 268: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/268.jpg)
268
Data Validation Tables
•Systematic – important for correct interpretation of data but do not usually impact validity of sample or group of samples
![Page 269: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/269.jpg)
269
Template for PM2.5
![Page 270: QAPP outline. 2 Element 1: Title Page with Approval Signatures Title of QAPP Name(s) of organizations implementing project Approval personnel Assistance](https://reader035.vdocument.in/reader035/viewer/2022081602/5516f1a655034603568b4afd/html5/thumbnails/270.jpg)
270
Template for Ozone