This 54-page appendix, Revision No. 1 dated 03/17, provides measurement quality objectives and validation templates for ambient air monitoring of ozone, carbon monoxide, nitrogen oxides, sulfur dioxide, particulate matter, and lead. It distinguishes critical, operational, and systematic criteria and explains their implications for data validation and invalidation. Pollutant-specific tables identify requirements, evaluation frequencies, acceptance criteria, and regulatory or guidance references. Topics include calibration, quality control checks, audits, sampling and laboratory procedures, maintenance, reporting, completeness, precision, and bias.
Free preview text
The first 5 pages, shown as text so search engines and readers can find this document.
Page 1
QA Handbook Volume II, Appendix D
Revision No. 1
Date:03/17
Page 1 of 54
Appendix D
Measurement Quality Objectives and Validation Templates
Table of Contents
(click on link to go to individual tables)
Validation Template Page
O3 5
CO 8
NO2 , NOx, NO 10
SO2 13
PM2.5 Filter Based Local Conditions 16
Continuous PM2.5 Local Conditions 21
PM10c for PM10-2.5 Low –Volume , Filter-Based Local Conditions 25
PM10 Filter Based Dichot STP Conditions 30
PM10 Filter Based High Volume (HV) STP Conditions 33
Continuos PM10 STP Conditions 36
PM10 Low Volume STP Filter-Based Local Conditions 38
Pb High Volume (TSP) 43
Pb Low Volume (PM10 ) 46
Page 2
QA Handbook Volume II, Appendix D
Revision No. 1
Date:03/17
Page 2 of 54
In June 1998, a workgroup was formed to develop a procedure that could be used by monitoring
organizations that would provide for a consistent validation of PM2.5 mass concentrations across the US.
The workgroup included personnel from the monitoring organizations, EPA Regional Offices, and
OAQPS who were involved with assuring the quality of PM2.5 mass; additionally, the workgroup was
headed by a State and local representative. The workgroup developed a table consisting of three criteria:
critical, operational, and systematic criteria, where each criterion had a different degree of implication
about the quality of the data. The criteria included on the tables were from 40 CFR Part 50 Appendices L
and N, 40 CFR Part 58 Appendix A, and Method 2.12; a few criteria were also added that were neither in
CFR nor Method 2.12, but which the workgroup felt should be included. Upon completion and use of the
table, it was decided that a “validation template” should be developed for all the criteria pollutants.
To determine the appropriate table for each criterion, the members of the workgroup considered how
significantly the criterion impacted the resulting concentration. This was based on experience from
workgroup members, experience from non-workgroup members, and feasibility of implementing the
criterion.
Criteria that were deemed critical to maintaining the integrity of a sample or group of samples were
placed on the first table. Observations that do not meet each and every criterion on the Critical Criteria
should be invalidated unless there are compelling reason and justification for not doing so. In most cases,
this criterion can identify a distinct group of measurements and time period. For example, a flow rate
exceedance represents a single sampler for a particular period of time (and therefore distinct number of
samples), whereas a field blank or QA collocation exceedance is harder to identify what samples the
exceedance may represent. In most cases the requirement, the implementation frequency of the criteria,
and the acceptance criteria are found in CFR and are therefore regulatory in nature. The sample or group
of samples for which one or more of these criteria are not met is invalid until proven otherwise0F
1. The
cause of not operating in the acceptable range for each of the violated criteria must be investigated and
minimized to reduce the likelihood that additional samples will be invalidated. Typically, EPA Regional
Offices will be in the best position to assess whether there are compelling reasons and justification for not
deleting the data. The evaluation will be informed by a weight of evidence approach, consider input from
States/locals and EPA’s national office, and be documented.
Criteria that are important for maintaining and evaluating the quality of the data collection system are
included under Operational Criteria. Violation of a criterion or a number of criteria may be cause for
invalidation. The decision maker should consider other quality control information that may or may not
indicate the data are acceptable for the parameter being controlled. Therefore, the sample or group of
samples for which one or more of these criteria are not met are suspect unless other quality control
information demonstrates otherwise and is documented. The reason for not meeting the criteria MUST be
investigated, mitigated or justified.
Finally, those criteria which are important for the correct interpretation of the data but do not usually
impact the validity of a sample or group of samples are included on the third table, the Systematic
Criteria. For example, the data quality objectives are included in this table. If the data quality objectives
are not met, this does not invalidate any of the samples but it may impact the uncertainty associated with
the attainment/non-attainment decision.
1 In a number of cases precedence has been set with invalidating data based on failure of critical criteria.
Page 3
QA Handbook Volume II, Appendix D
Revision No. 1
Date:03/17
Page 3 of 54
NOTE: The designation of quality control checks as Operational or Systematic do not
imply that these quality control checks need not be performed. Not performing an
operational or systematic quality control check that is required by regulation (in CFR) can be a
basis for invalidation of all associated data. Any time a CFR requirement is identified in the
Requirement, Frequency or Acceptance Criteria column it will be identified by bold and italics
font. Many monitoring organization/PQAOs are using the validation templates and have
included them in QAPPs. However, it must be mentioned that diligence must be paid to its
use. Data quality findings through data reviews and technical systems audits have identified
multiple and concurrent non-compliance with operational criteria that monitoring organization
considered valid without any documentation to prove the data validity. The validation
templates were meant to be applied to small data sets (single values or a few weeks of
information) and should not be construed to allow a criterion to be in non-conformance simple
because it is operational or systematic
Following are the tables for all the criteria pollutants. For each criterion, the tables include: (1) the
requirement (2) the frequency with which compliance is to be evaluated, (3) acceptance criteria, and (4)
information where the requirement can be found or additional guidance on the requirement.
The validation templates have been developed based on the current state of knowledge. The templates
should evolve as new information is discovered about the impact of the various criteria on the uncertainty
in the resulting mass estimate or concentration. In recent years there has been a number of circumstances
where critical criteria and in some cases operational criteria that were in regulation (had a frequency and
acceptance criteria) where not met. In these cases, EPA has been consistent in their application of
invalidating data not meeting regulations. Interactions of the criteria, whether synergistic or antagonistic,
should also be incorporated when the impact of these interactions becomes quantified. Due to the
potential misuse of invalid data, data that are invalidated should not be uploaded to AQS, but should be
retained on the monitoring organization’s local database. This data will be invaluable to the evolution of
the validation template.
Use of Bold Italics Font to Identify CFR Requirements.
The criteria listed in the validation templates are either requirements that can be found in the Code of
Federal Regulations, guidance found in a variety of guidance documents, or recommendations by the QA
Workgroup or EPA. As mentioned above any time a CFR requirement is identified in the Requirement,
Frequency or Acceptance Criteria column it will be identified by bold and italics font and can be used for
data invalidation depending on the infraction. The Information/Action column will provide the
appropriate references for CFR or guidance documents.
Hyperlink References
Where requirements or guidance documents are found on the web, a hyperlink is created which will lead
the user to the closest URL address. Any links to CFR are directed to the electronic CFR document (e-
CFR) which is the most up-to-date. E-CFR will not get you to an individual section. Therefore, e-CFR is
only hyperlinked once on each page.
Page 4
QA Handbook Volume II, Appendix D
Revision No. 1
Date:03/17
Page 4 of 54
Change in Acceptance Criteria
In order to provide more consistent guidance in the use of acceptance criteria we have developed more
definitive information on rounding. The acceptance criteria will show more digits than might otherwise
be found in regulations or guidance. For example, where in the past the one-point flow rate verification
was + 4% of transfer standard, some monitoring organizations equated a flow rate of < + 4.5% as
acceptable while others considered anything < + 4.1% acceptable. Therefore, in order to ensure
consistency, EPA has provided more definitive information of these acceptance limits. In this case, the
acceptance criteria for the flow rate verification is < + 4.1%. In the cases where the CFR lists a
requirement (as is the case with the flow rate verification which is listed as + 4%), EPA will interpret the
acceptance criteria to a level that will provide a more consistent application of the template across the
ambient air monitoring network. The rounding policy is included in Appendix L of the QA Handbook.
Truncation
Under no circumstances should quality measurements for comparison to acceptance criteria be truncated,
rather than rounded.
PM10 Note of Caution
The validation templates for PM10 get complicated because PM10 is required to be reported at standard
temperature and pressure (STP) for comparison to the NAAQS (and follow 40 CFR Part 50 App J) and at
local conditions if using it to monitor for PM10-2.5 (and follow 40 CFR Part 50 App O). Moreover, PM10
can be measured with filter-based sampling techniques as well as with automated methods. The
validation templates developed for PM10 try to accommodate these differences, but monitoring
organizations are cautioned to review the operations manual for the monitors/samplers they use and
augment the validation template with QC information specific to their EPA reference or equivalent
method designation and instrument. http://www.epa.gov/ttn/amtic/files/ambient/criteria/reference-
equivalent-methods-list.pdf
Page 5
QA Handbook Volume II, Appendix D
Revision No. 1
Date:03/17
Page 5 of 54
Ozone Validation Template
1) Requirement (O3) 2) Frequency 3) Acceptance Criteria Information /Action
CRITICAL CRITERIA-OZONE
Monitor NA Meets requirements listed in FRM/FEM
designation
1) 40 CFR Part 58 App C Sec. 2.1
2) NA
3) 40 CFR Part 53 & FRM/FEM method list
One Point QC Check
Single analyzer Every 14 days < +7.1% (percent difference) or < +1.5 ppb
difference whichever is greater
1 and 2) 40 CFR Part 58 App A Sec. 3.1
3) Recommendation based on DQO in 40 CFR Part 58
App A Sec. 2.3.1.2. QC Check Conc range 0.005 - 0.08
ppm and 05/05/2016 Technical Note on AMTIC
Zero/span check Every 14 days
Zero drift < + 3.1 ppb (24 hr)
< + 5.1 ppb (>24hr-14 day)
Span drift < + 7.1 %
1 and 2) QA Handbook Volume 2 Sec. 12.3
3) Recommendation and related to DQO
OPERATIONAL CRITERIA -OZONE
Shelter Temperature Range Daily
(hourly values)
20.0 to 30.0o C. (Hourly avg)
or
per manufacturers specifications if designated
to a wider temperature range
1, 2 and 3) QA Handbook Volume 2 Sec. 7.2.2
Generally, the 20-30.0o C range will apply but the most
restrictive operable range of the instruments in the shelter
may also be used as guidance. FRM/FEM list found on
AMTIC provides temp. range for given instrument.
FRM/FEM monitor testing is required at 20-30o C range
per 40 CFR Part 53.32
Shelter Temperature Control Daily (hourly values) < 2.1o C SD over 24 hours 1, 2 and 3) QA Handbook Volume 2 Sec. 7.2.2
Shelter Temperature Device
Check
Every 182 days and 2/ calendar year <+ 2.1o C of standard 1, 2 and 3) QA Handbook Volume 2 Sec. 7.2.2
Annual Performance
Evaluation Single analyzer
Every site every 365 days and 1/
calendar year within period of
monitor operation,
Percent difference of audit levels 3-10
< +15.1%
Audit levels 1&2 < + 1.5 ppb difference or
<+ 15.1%
1 and 2) 40 CFR Part 58 App A Sec. 3.1.2
3) Recommendation- 3 audit concentrations not including
zero. AMTIC guidance 2/17/2011
AMTIC Technical Memo
Federal Audits (NPAP) 20% of sites audited in calendar
year
Audit levels 1&2 < + 1.5 ppb difference all
other levels percent difference < + 10.1%
1 and 2) 40 CFR Part 58 App A Sec. 3.1.3
3) NPAP QAPP/SOP
Verification/Calibration
Upon receipt/adjustment/repair/
installation/moving and repair and
recalibration of standard of higher
level
Every 182 day and 2/ calendar year if
manual zero/span performed
biweekly
Every 365 day and 1/ calendar year if
continuous zero/span performed daily
All points < + 2.1 % or < +1.5 ppb difference
of best-fit straight line whichever is greater
and Slope 1 + .05
1) 40 CFR Part 50 App D
2) Recommendation
3) 40 CFR Part 50 App D Sec 4.5.5.6
Multi-point calibration (0 and 4 upscale points)
Slope criteria is a recommendation
Zero Air/Zero Air Check Every 365 days and 1/calendar year Concentrations below LDL 1) 40 CFR Part 50 App D Sec. 4.1
2 and 3) Recommendation
Ozone Level 2 Standard
QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates: summary, contents and background
This guide helps you understand the scope of QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates before or alongside reading the original document. It is based on the catalogue record, credited creator, source, classification and topics shown on this page. It does not replace the original work and does not invent claims about passages that Doxxly cannot verify.
Summary and overview
QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates is a 54-page documentcredited to Elias C. Quinlan. This 54-page appendix, Revision No. 1 dated 03/17, provides measurement quality objectives and validation templates for ambient air monitoring of ozone, carbon monoxide, nitrogen oxides, sulfur dioxide, particulate matter, and lead. It distinguishes critical, operational, and systematic criteria and explains their implications for data validation and invalidation. Pollutant-specific tables identify requirements, evaluation frequencies, acceptance criteria, and regulatory or guidance references. Topics include calibration, quality control checks, audits, sampling and laboratory procedures, maintenance, reporting, completeness, precision, and bias. It appears in the Environment & Sustainability collection, which groups it with other material that readers may use for comparison and further study.
The item can be approached in several ways. A reader looking for a quick orientation can begin with the free five-page preview, inspect the page structure and use the metadata to judge relevance. Someone undertaking deeper research can work through the complete file, search its indexed text, record useful page references and compare its treatment of Ambient air monitoring, Quality assurance, Measurement quality objectives, Data validation, Validation templates, Criteria pollutants, Particulate matter, Lead monitoring, Quality control with the related resources linked below.
Rather than reducing the work to a single claim, this page treats it as a source that should be read in context. The title, creator, publication source, licence and format all help explain what kind of evidence it may offer. Readers should distinguish the original author's statements from Doxxly's catalogue description, and should cite the original edition when using the material in academic, professional or published work.
Key topics and reader takeaways
The catalogue connects this document with Ambient air monitoring, Quality assurance, Measurement quality objectives, Data validation, Validation templates, Criteria pollutants, Particulate matter, Lead monitoring, Quality control. These terms offer practical entry points rather than a substitute for close reading. Start by identifying the definitions, examples, arguments, tables or visual explanations attached to each topic. Then note where the creator draws connections, makes distinctions or moves from background material to a conclusion, recommendation, calculation or narrative development.
A useful reading method is to separate description from interpretation. First record what the item actually presents: names, headings, figures, formulas, quotations or stated propositions. Next consider why those details matter within the whole work. Finally compare them with another source from the same subject area. This process helps turn a long digital file into evidence that can be evaluated rather than merely skimmed.
Table of contents and reading guide
The following is an editorial content guide based on the verified catalogue topics. It is not represented as the original author's formal table of contents. Use it to organise notes while moving through the 54 pages in the player.
Part 1
Ambient air monitoring
Use this section of the reading guide to identify how Ambient air monitoring appears in QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates, note important terms, and connect the subject to the wider purpose of the work.
Part 2
Quality assurance
Use this section of the reading guide to identify how Quality assurance appears in QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates, note important terms, and connect the subject to the wider purpose of the work.
Part 3
Measurement quality objectives
Use this section of the reading guide to identify how Measurement quality objectives appears in QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates, note important terms, and connect the subject to the wider purpose of the work.
Part 4
Data validation
Use this section of the reading guide to identify how Data validation appears in QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates, note important terms, and connect the subject to the wider purpose of the work.
Part 5
Validation templates
Use this section of the reading guide to identify how Validation templates appears in QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates, note important terms, and connect the subject to the wider purpose of the work.
Part 6
Criteria pollutants
Use this section of the reading guide to identify how Criteria pollutants appears in QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates, note important terms, and connect the subject to the wider purpose of the work.
Part 7
Particulate matter
Use this section of the reading guide to identify how Particulate matter appears in QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates, note important terms, and connect the subject to the wider purpose of the work.
Part 8
Lead monitoring
Use this section of the reading guide to identify how Lead monitoring appears in QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates, note important terms, and connect the subject to the wider purpose of the work.
When a heading in the original differs from this guide, follow the original heading in your citation. Page numbers can also vary between editions. Doxxly's direct page field is useful for navigation, but formal references should include the title, creator, source and edition details available in the file itself.
About Elias C. Quinlan
Doxxly credits Elias C. Quinlan as the author or creator of QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates. This page does not add an unverified biography, job title or institutional affiliation. The attribution is preserved so readers can distinguish the creator from the hosting library and follow the original record when an external author link is available.
Author context matters because a work reflects a particular purpose, audience and point of view. Before relying on the material, consider what the creator set out to explain, when the source was produced and whether later research or revised guidance should also be consulted. For literature and philosophy, compare translations and editions; for technical material, check whether a newer version has superseded the one shown here.
About the source organisation
The recorded source for this item is epa.gov. Doxxly provides access and discovery tools but does not claim to be the original publisher unless explicitly stated. Source links, creator attribution and the recorded Publicly available file collected for editorial review licence are displayed to help readers assess provenance and permitted use.
Provenance is especially important for reports, standards, presentations and working spreadsheets. Check the original source for amendments, supporting files and current policy. A trustworthy research workflow keeps the source URL with any notes or downloaded copy, verifies important figures against the original, and avoids treating an archived document as automatically current.
Begin with the title and opening pages, then use the guide above to decide whether to read sequentially or move to a particular topic. The Doxxly player provides previous and next navigation, a direct page field, zoom steps, fit-to-width and fit-to-page modes, rotation and fullscreen. These controls are useful when a page contains small type, a wide table, an image, a scanned layout or a dense sequence of notes.
The first five pages are open to every visitor. A plan unlocks the complete item and full-document search. Search is best used for distinctive names, technical terms or short phrases; broad words can produce too many possible contexts. When you find a useful passage, read the surrounding pages so that a sentence, chart or formula is not separated from its explanation.
If downloading is enabled, members can obtain the original PDF file. Keep the original format when formulas, slide sequencing, pagination or layout carries meaning. Respect the Publicly available file collected for editorial review terms displayed on this page, and use the rights-report link if you believe the attribution or availability needs review.
Research questions to consider
As you read QA Handbook Volume II, Appendix D: Measurement Quality Objectives and Validation Templates, ask which audience the creator addresses, what problem or idea organises the work, what evidence is presented, and which assumptions remain unstated. Note whether important terms are defined consistently and whether examples represent a broader pattern or a narrow case. For quantitative material, record units, time periods, formulas and data sources. For interpretive material, separate the creator's language from your own summary.
A second set of questions concerns relevance today. Which parts remain durable, which depend on their historical or institutional setting, and what would need confirmation from a newer source? Following the tags and the Environment & Sustainability collection can reveal useful comparisons. Agreement between sources can strengthen confidence, while disagreement can point to changing definitions, methods, evidence or priorities.
Finally, decide what you need from the item: background knowledge, a quotation, a worked example, a model, a visual explanation or a starting bibliography. That purpose should guide the depth of reading and the notes you keep. Doxxly helps locate and navigate the source; careful interpretation remains the reader's responsibility.