u.s. department of the interior u.s. geological survey asprs 2006 annual conference reno, nevada...
TRANSCRIPT
![Page 1: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/1.jpg)
U.S. Department of the InteriorU.S. Geological Survey
ASPRS 2006 Annual ConferenceReno, Nevada
Overview of the USGS Plan for Quality Assurance of Digital Aerial Imagery
![Page 2: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/2.jpg)
2
OutlineOutline
Background ASPRS Study recommendations Who, what, why, how USGS Plan for Quality Assurance of Digital Aerial
Imagery When Summary
![Page 3: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/3.jpg)
3
Why calibration at USGS?
Photogrammetric methods for map generation Map production primarily done in-house Quality assurance measure for aerial photography
from aerial contractors
Leadership role in standards development Unbiased, independent agency with technical
expertise Quality assurance for The National Map
BackgroundBackground
![Page 4: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/4.jpg)
4
USGS Camera Calibration HistoryUSGS Camera Calibration History
USGS responsible for calibration services for film camera in United States since 1973
USGS operates Optical Sciences Lab (OSL) in Reston, VA with a custom-built calibration instrument
Current policy requires current (within 3 years) camera calibration report on file before award of contract
The “Catch-22” problem for digital sensors
![Page 5: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/5.jpg)
5
Continue to provide analog calibration services Develop and implement digital calibration capabilities Develop standards for camera and sensor calibrations Develop and implement in-situ calibration methods
ASPRS Study RecommendationsASPRS Study Recommendations
![Page 6: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/6.jpg)
6
Stage 1: Initiation Stage 2: Contagion Stage 3: Control Stage 4: Integration
Stages of New TechnologyStages of New Technology
![Page 7: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/7.jpg)
7
Initiation: Research and pilot projects Contagion: Wild enthusiasm and demand Control: Define standards and format Integration: DOQs critical to enterprise operation
Example: DOQsExample: DOQs
![Page 8: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/8.jpg)
8
The unknown: Does it perform as claimed? Lack of standards: What are the specifications? Lack of experience: What I can or can not do? Business decision: Does it make business sense? Operational changes: What are the best practices? Integration: How to integrate into existing processes? Overcoming inertia: Acceptance by users?
The Barriers to New TechnologyThe Barriers to New Technology
![Page 9: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/9.jpg)
9
An independent validation of manufacturer’s specifications
Selection of well-qualified Data Providers with experience and established “best practices”
Standardized procurement specifications and selection criteria
Quality control measures
The Formula for QualityThe Formula for Quality
![Page 10: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/10.jpg)
10
Development of a comprehensive quality plan Acceptance and use by Inter-Agency Digital Image
Working Group composed of 14 Federal agencies Extension of requirement to other agencies and
contracting offices Acceptance by general user community
What is the USGS Strategy for Quality?What is the USGS Strategy for Quality?
![Page 11: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/11.jpg)
11
The major players:
Manufacturers
Data Providers
Procurement officials
End-users
What’s Your Perspective?What’s Your Perspective?
![Page 12: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/12.jpg)
12
The USGS PerspectiveThe USGS Perspective
Image products and services for other agencies and cooperators via contracts with Data Providers
Occasional procurement of sensor systems Quality assurance of end products for The National
Map Development and establishing standards for
geospatial community
![Page 13: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/13.jpg)
13
USGS Plan for Quality AssuranceUSGS Plan for Quality Assurance
Four major parts covering two major processes:
Data Production Manufacturers Certification Data Providers Certification
Data Purchasing & Acceptance Contracting Guidelines Data Acceptance Standards
![Page 14: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/14.jpg)
14
The USGS PlanThe USGS Plan
Data Procurement:
Contracting Guidelines & Boilerplate Tool
Data Users and Inspectors:
Acceptance Standards
Sensor Manufacturers:
Manufacturers Certification
Data Providers:
Data Providers Certification
User Needs
Data Purchasing and Acceptance Domain
Data Production Domain
Final Product
![Page 15: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/15.jpg)
15
Manufacturers CertificationManufacturers Certification Aerial Digital Imaging is in its “Wild West” phase
Anything & everything being tried Some metric-quality systems Many “other” systems
How does the customer know which can produce mapping-quality data?
USGS to offer “type certification” of mapping-quality digital aerial sensors
Must be stable, well-quantified, repeatable Able to routinely generate mapping-quality data
When operated properly!
![Page 16: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/16.jpg)
16
Communicates specifications Provides evidence of system performance Independent certification helps to promote sensor
systems Supports verification of Data Provider’s system Type certification eliminates burden of calibration for
each sensor sold in the United States (1 time vs. n times)
Eliminates need for USGS to have custom-built calibration instrument for calibration purposes
Benefits of Manufacturers CertificationBenefits of Manufacturers Certification
![Page 17: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/17.jpg)
17
USGS Manufacturers Review TeamUSGS Manufacturers Review Team Review Team Lead - Gregory L. Stensaas
Remote Sensing Technologies Project ManagerUSGS Earth Resources Observation and Science Center, Sioux Falls, [email protected]
Systems Engineering Team Member - Jon Christopherson Science Applications International Corporation (SAIC) Contractor to the USGS EROS, Sioux Falls, [email protected]
Photogrammetric Engineering Team Member - Dr. George Y. G. LeeU.S. Geological Survey, Menlo Park, [email protected]
Geo-Spatial and Software Engineering Team Member - Donald Moe Science Applications International Corporation (SAIC) Contractor to the USGS EROS, Sioux Falls, [email protected]
Radiometric and Physics Team Member - Dr. Robert RyanScience Systems and Applications, Inc. Contractor to NASA Stennis Space Center, [email protected]
![Page 18: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/18.jpg)
18
Data Providers CertificationData Providers Certification
Focused on processes and process control Ensures that Data Providers are operating sensors in
accordance with manufacturer’s instructions and limitations Ensures that Data Providers follow quality procedures
Focused on documentation and monitoring of procedures and best practices
ISO-like certification process
Desire to ensure reliability, repeatability, and quality
![Page 19: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/19.jpg)
19
Provides evidence of performance of products Independent certification helps to promote product
specifications and Data Provider’s capabilities Documents Data Provider’s quality assurance plan
and “best practices” One certification for Data Provider and not for each
camera Data Providers no longer have to send cameras to
OSL for calibration, reducing down-time and shipping expenses
Benefits of Data Providers CertificationBenefits of Data Providers Certification
![Page 20: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/20.jpg)
20
Contracting GuidelinesContracting Guidelines
User community is not sure how to contract for digital imagery
New terms, capabilities, standards, lexicon Inhibits digital contracting Addresses boilerplate requiring “USGS Certificate” Goal is to remove barriers to digital aerial contracts Encourage digital imaging
Created Federal Digital Imagery General Contract Guideline
![Page 21: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/21.jpg)
21
Standardized terms and descriptions make the contracting process easier and more uniform among agencies
Guidelines help acceptance of digital sensors and educate end-users on benefits of digital technology
Standardized terms and guidelines help contracting officers describe their users needs
Standardized performance measures USGS certifications provide a priori acceptance of
systems and Data Provider’s “best practices” Manufacturer and Data Providers Certification reduces
necessary documentation in the RFP process
Benefits of Contracting GuidelinesBenefits of Contracting Guidelines
![Page 22: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/22.jpg)
22
Digital Data Acceptance StandardsDigital Data Acceptance Standards
End-users unsure of how to judge digital aerial data quality
New terms & capabilities (resolution, spectral, etc.) Each customer understands things differently
There is a need for common, uniform definitions and methods for evaluating quality of image data
USGS to work with Inter-Agency Digital Image Working Group to develop these standards
Goal is a Web-based tool illustrating quality problems, measurement techniques, and standards
![Page 23: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/23.jpg)
23
Data consumers have common standards to evaluate data products
More consistent acceptance/rejection criteria among contracting agencies
Clearer standards and guidelines helps to eliminate false expectations
Ensures high quality products Increases customer satisfaction
Benefits of Acceptance StandardsBenefits of Acceptance Standards
![Page 24: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/24.jpg)
24
Manufacturers Certification (Cost-shared by USGS and manufacturers)
Data Providers Certification (100% by Data Providers)
Contracting Guidelines (100% USGS and IADIWG funded)
Acceptance standards (100% USGS and IADIWG funded)
Funding StrategyFunding Strategy
![Page 25: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/25.jpg)
25
Manufacturers Certification Guidelines drafted Up to 4 manufacturers to be certified this fiscal year Applanix and Intergraph factory visits completed, reports
pending A few details but no major issues; certification to be issued soon Leica and Vexcel-Microsoft visits being discussed now
Four Data Providers have expressed interest working on the initial round of Data Providers Certification
First draft of Digital Imagery Contracting Guideline completed and reviewed by limited group
A Web-based tool to help generate contracting language is being developed
IADIWG to begin drafting guidelines in Fall
StatusStatus
![Page 26: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/26.jpg)
26
USGS Plan for Quality Assurance of Digital Aerial Imagery briefed during ASPRS panel session
Invite comment from broader community Finalize and obtain ASPRS approval Complete initial four Manufacturers Certifications Begin initial Data Providers Certifications Provide briefings to geospatial community Participate in international forums to communicate
plans used in the United States
Next StepsNext Steps
![Page 27: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/27.jpg)
27
Four Phases of Technology Assimilation:
Phase 1: Identification and investment Phase 2: Learning and adaptation Phase 3: Management control and standards Phase 4: Maturity and widespread acceptance
Closing ThoughtClosing Thought
![Page 28: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/28.jpg)
28
To implement a comprehensive, meaningful process that ensures the quality of data products and services
To cooperatively develop the plan with all elements of the geospatial community
Good for one is good for all
Education and training for the community
To establish a model to support other new technologies in the future
SummarySummary
![Page 29: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/29.jpg)
29
IADIWG Web site at: http://calval.cr.usgs.gov/
For more informationFor more information
![Page 30: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/30.jpg)
30
Contact:
Gregory L. StensaasRemote Sensing Systems Characterization ManagerUSGS EROS Data Center47914 252nd StreetSioux Falls, SD [email protected]
For issues or commentsFor issues or comments
![Page 31: U.S. Department of the Interior U.S. Geological Survey ASPRS 2006 Annual Conference Reno, Nevada Overview of the USGS Plan for Quality Assurance of Digital](https://reader030.vdocument.in/reader030/viewer/2022032803/56649e205503460f94b0b76b/html5/thumbnails/31.jpg)
31
Questions or comments?
The USGS Quality PlanThe USGS Quality Plan