state/federal data sharing initiative
DESCRIPTION
State/Federal Data Sharing Initiative. Randy Hippen EPA OERR April 25, 2002. Overview. State/Federal Data Sharing Initiative Two prototypes Data Harvesting Institutional Controls Data Sharing Lessons Learned New Directions. State/Federal Data Sharing Initiative. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/1.jpg)
State/Federal Data Sharing Initiative
Randy HippenEPA OERRApril 25, 2002
![Page 2: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/2.jpg)
• State/Federal Data Sharing Initiative• Two prototypes
– Data Harvesting – Institutional Controls Data Sharing
• Lessons Learned• New Directions
Overview
![Page 3: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/3.jpg)
State/Federal Data Sharing Initiative
Why is data sharing needed?
![Page 4: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/4.jpg)
Data Harvesting
Enables the integration of state and federal data, with minimal burden on
the data providers.
![Page 5: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/5.jpg)
STEP 1: Submitting Queries
Through the Data Harvesting Web site, users can submit queries on site remediation data. Topics for queries include:
Data Harvesting
• Remediation Activities
• Locational Information
• Media and Contaminants
• Institutional Controls
![Page 6: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/6.jpg)
STEP 2: Querying Data
Using Information Builders, Inc. (IBI) EDA middleware, queries are submitted directly to state and federal data sources across the Internet. The data remain in their native format, with no need for manual data conversion.
Data Harvesting
EDA has the ability to query virtually any type of data source, including databases, text files, and XML documents.
![Page 7: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/7.jpg)
STEP 3: Virtual Warehousing
Query results are temporarily held in a virtual warehouse, where data from all sources are brought together and transformed into a common format.
Data Harvesting
It is from this virtual warehouse query results are presented to the user through their Web browser.
![Page 8: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/8.jpg)
Institutional Controls Data Sharing
Facilitates the sharing and tracking of institutional controls data through a
simple Web interface.
![Page 9: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/9.jpg)
Prototype Concept
Institutional Controls Data Sharing
Importing data from Stakeholders who are already
tracking Institutional
Controls data
Central Repository
Reporting tools for Stakeholders
Public Interface
Collecting data from Stakeholders
who are not currently tracking
Institutional controls data
IN IN
OUT OUT
![Page 10: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/10.jpg)
STEP 1: Data Gathering
Institutional Controls data are procured from state and federal data sources such as:
The data come in multiple formats, including MS Access, Visual FoxPro, and Oracle
Institutional Controls Data Sharing
• MO - DNR’s Site Management and Reporting System (SMARS)
• SC - DHEC’s Site Assessment and Remediation Program (SARP)
• NJ - DEP
• EPA - CERCLIS
![Page 11: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/11.jpg)
STEP 2: Data Conversion
The data are converted into XML. Commercial off-the-shelf tools such as XMLSpy, make database-to-XML conversion simple.
An XSL stylesheet is applied to each XML document to standardize the data format.
Institutional Controls Data Sharing
![Page 12: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/12.jpg)
STEP 3: Data Loading
The new XML data are loaded into the Oracle database by customized Java routines that utilize the Oracle XML parser and the Oracle XML SQL utility
STEP 4: Sharing DataThe Institutional Controls (IC) data sharing Web site gives visitors the opportunity to view IC data from all states and agencies. Agencies that do not have a means of tracking IC’s on their own can also use site to maintain their IC data
Institutional Controls Data Sharing
![Page 13: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/13.jpg)
Web Site
Using a Web browser, visitors can submit predefined queries to search the database…
Query
…or they can create customized searches to hone in on specific sets of data.
Institutional Controls Data Sharing
![Page 14: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/14.jpg)
Query Results Page
From the Query Results Page, visitors can view maps of each site’s location.
Visitors can also get more detail about the site, such as address, latitude/ longitude, media, and contaminants
Institutional Controls Data Sharing
![Page 15: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/15.jpg)
Comparisons
• Underlying Technology
• Data Query and Compilation Mechanism
• Preparatory work necessary
• Flexibility/Scalability
• Ease of Implementation/Use
• Impact on Data Owners’ Resources/ Infrastructure
• Compatibility with EPA and Industry Data Exchange and Security Standards
• Demonstrated Use in Large Scale Data Exchange Efforts
![Page 16: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/16.jpg)
Lessons Learned
• Agree on a common set of realistic goals.
• Assess underlying source databases and technologies prior to selecting a tool.
• Select the right technology for the task at hand.
• Establish firm standards, rules, and operating procedures.
• Establish a mechanism for evaluating success and fostering change where needed.
![Page 17: State/Federal Data Sharing Initiative](https://reader035.vdocument.in/reader035/viewer/2022070411/56814816550346895db542d7/html5/thumbnails/17.jpg)
Additional Information
Randy Hippen
EPA Office of Emergency and Remedial Response Phone:
703-603-8829
• EPA Electronic Data Registry: www.epa.gov/edr
• EDA (Information Builders): www.iwaysoftware.com