tri pilot data flow via the exchange network michigan’s experience michael beaulac – michigan...

20
TRI Pilot Data Flow TRI Pilot Data Flow via the Exchange Network via the Exchange Network Michigan’s Experience Michigan’s Experience Michael Beaulac Michael Beaulac – Michigan DEQ – Michigan DEQ Bill Rensmith Bill Rensmith – Windsor Solutions, Inc. – Windsor Solutions, Inc. Whad’ya Node? Conference Whad’ya Node? Conference New Orleans, LA – 2/28/05-3/1/05 New Orleans, LA – 2/28/05-3/1/05

Upload: daniel-chambers

Post on 28-Dec-2015

220 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

TRI Pilot Data FlowTRI Pilot Data Flowvia the Exchange Networkvia the Exchange Network

Michigan’s ExperienceMichigan’s Experience

TRI Pilot Data FlowTRI Pilot Data Flowvia the Exchange Networkvia the Exchange Network

Michigan’s ExperienceMichigan’s Experience

Michael BeaulacMichael Beaulac – Michigan DEQ – Michigan DEQ

Bill RensmithBill Rensmith – Windsor Solutions, Inc. – Windsor Solutions, Inc.

Whad’ya Node? ConferenceWhad’ya Node? Conference

New Orleans, LA – 2/28/05-3/1/05New Orleans, LA – 2/28/05-3/1/05

Page 2: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

TRI Integrated Project TeamTRI Integrated Project Team

EPA ECOS

Virginia DEQ Indiana DEM

South Carolina DEQ Michigan DEQ

Windsor Solutions, Inc. EnfoTech & Consulting, Inc.

Computer Science Corp. Lockheed Martin

Page 3: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

Business Requirements

TRI XML Schema InputsTRI XML Schema Inputs

TRI XMLSchema

Standards &Guidelines Existing TRI Formats

CRM1CRM1

CRM2/SSC’sCRM2/SSC’s

EDSC 2.0EDSC 2.0

EN DRCs &W3C Standards

EN DRCs &W3C Standards

TRI-ME Flat File Format

TRI-ME Flat File Format

EnviroFactsData ModelEnviroFactsData Model

Form R and AForm R and A

ReportingInstructionsReporting

Instructions

IPT MeetingsIPT Meetings

Page 4: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

TRI Pilot Data FlowTRI Pilot Data Flow

Page 5: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

TRI Next Generation Data FlowTRI Next Generation Data Flow

Page 6: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

Project TasksProject Tasks

High-Level TasksHigh-Level Tasks

1. Convert TRI production database to SQL Server 1. Convert TRI production database to SQL Server and remap front end and remap front end

2. Configure Node for TRI data flow2. Configure Node for TRI data flow

3. Testing with CDX3. Testing with CDX

Page 7: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

The Michigan TRI Technical ArchitectureThe Michigan TRI Technical Architecture

deqwebdmz

web

deqsqldmz

Node Database

TRI Database

(exchange tables)

(CDX)deqsqlprod

DMZ Inner Network

EPA Node Michigan Node

Michigan TRI OverviewMichigan TRI Overview

EPA CDX Node submits Michigan Node TRI XML file

1

Node logs incoming request

as Processing

2

Node parses XML file, stores in TRI exchange

tables

4

XML file stored on

Node

5

Node logs incoming request

as Complete

6

Node grabs XSLT from Node (contains XML parsing logic)

3Michigan Node returns transaction

ID to EPA

7

Page 8: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

TRI Node Administration ConsoleTRI Node Administration Console

Page 9: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

Some Preliminary Lessons Learned …Some Preliminary Lessons Learned …

Make the exchange server accessible to the Node because firewall “rules” may prevent data passing through the Node Application Server to Exchange Tables

Verify cycle-time per transaction for single and multiple chemical reports per submission

XML Instance files archived in Node Application Server and file server to verify accuracy and completeness of data

Page 10: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

DM

Z Zo

neIn

tern

et

MI Infrastructure to Support TRI Pilot

Machine Access to Web

Services web

EPA-NAAS

CDX

EPA Program Offices

EPA-TRI

Deqw1dmz(TRI Converter)

Deqw2dmz(TRI Converter)

Deqsqldmz(Production Node_db)

Deqsqlprd(TRI database)

Deqinet (Node.Administration)

DB Format

XMLFormat

1433

1

2

3

Inte

rnal

Net

wor

k

443

Load Balanced

Node.WebServices

Page 11: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

XML Instance File – Facility IdentificationXML Instance File – Facility Identification

Page 12: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

XML Instance File – Chemical and ActivityXML Instance File – Chemical and Activity

Page 13: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

Cycle Time TransactionsCycle Time Transactions

TRIFIDTRIFID # Chem.# Chem. Cycle-TimeCycle-Time

48192BSFCR1609B48192BSFCR1609B 1212 4 Min 12 sec4 Min 12 sec

49001THPJH7171P49001THPJH7171P 3434 2 Min 5 sec2 Min 5 sec

48174MCHGN3634548174MCHGN36345 4747 5 Min 45 sec5 Min 45 sec

48667THDWCMICHI 48667THDWCMICHI 8686 3 Min 16 sec3 Min 16 sec

Page 14: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

To Be Completed …To Be Completed …

CDX translator (TRI ME => XML) issues:CDX translator (TRI ME => XML) issues:

creates one submission block for all chemicals generated w/in a facility. creates one submission block for all chemicals generated w/in a facility. Does not handle multiple SIC codes per chemical. This has been/is Does not handle multiple SIC codes per chemical. This has been/is being corrected.being corrected.

Translator doesn’t handle Dioxins due to reporting unit differences Translator doesn’t handle Dioxins due to reporting unit differences (grams vs. lbs.)(grams vs. lbs.)

State notification to facilities: MI cannot echo back to reporting State notification to facilities: MI cannot echo back to reporting facilities that we received a submitted instance file from CDXfacilities that we received a submitted instance file from CDX

Who best to do this? CDX or states?Who best to do this? CDX or states?

Possible joint development of solution to “submit” from State Possible joint development of solution to “submit” from State Node to back-end db (multiple platforms and environments … Node to back-end db (multiple platforms and environments … Oracle and SQL, J2EE and .NET)Oracle and SQL, J2EE and .NET)

Page 15: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

Preliminary Costs*Preliminary Costs*

TaskTask CostCost

Document review, testing, QA, etc. (100-200hrs)

Develop and implement a TRI data flow strategy

$1,000-2,000

Install TRI Converter w/site visit (dB and App.)

$2,000-3,400

Linkage of converter with existing Node

$1,500-3,000

*Does not include Node development and db conversions, etc. *Does not include Node development and db conversions, etc. (i.e., MS Access => SQL/Oracle)(i.e., MS Access => SQL/Oracle)

Page 16: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

Preliminary Costs*Preliminary Costs*

TaskTask CostCost

Map TRI Schema to data backend data source

$1,500-3,000

Develop procedures to convert from exchange tables to backend system

$2,000-4,000

Test of data flow (with EPA) $2,000-4,000

Document results $1,500-3,000

Total $11,500-22,400

*Does not include Node development and db conversions, etc. *Does not include Node development and db conversions, etc. (i.e., MS Access => SQL/Oracle)(i.e., MS Access => SQL/Oracle)

Page 17: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

Conclusion & IncentivesConclusion & Incentives

TRI CDX transactions reduces data processing time, save resources and improves data accuracy,

Enables continuous QA/QC,

Eliminates need for the UTIL upload program,

Could potentially eliminate redundancy in reporting certain environmental and business information to the state and local governments

Reporting facilities could realize a reduction in reporting time resulting in cost saving

Page 18: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

Process ~ Time• Open mail and separate current from

previous year (if applicable), • data stamp (paper and disk)

submission & log receipt

3 weeks

• Authenticate certification letter and disk

• Upload data on disk to TRI db via UTIL (Electronic submittals equate to 3229 reports; 90% of data received)

2 weeks

• Manually key paper submittals using TRI-ME and upload data into TRI dB via UTIL (Paper submittals equate to 343 reports; 10%)

3 weeks

• QA accuracy of uploaded data 1 week

• File certification letter with paper reports & disks,

• archive prior year data at record center.

1 week

Page 19: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

Cost BenefitsCost Benefits

State:

10-12 weeks savings in internal staff resources = ~0.25 FTE => $17,500/yr

ROI => 6 months - 2 years

Facility:

1000 facilities @ 1-2 hours X $25.00/hr => $25,000 - $50,000 per year

EPA:

Unknown at this time … anybody???

Page 20: TRI Pilot Data Flow via the Exchange Network Michigan’s Experience Michael Beaulac – Michigan DEQ Bill Rensmith – Windsor Solutions, Inc. Whad’ya Node?

More Information:More Information:

http://www.exchangenetwork.net/flow/cross/tri.htmRobert Jackson Robert Jackson (MI DEQ) 517-373-2731(MI DEQ) 517-373-2731

Ruth Borgelt Ruth Borgelt (MI DEQ) 517-373-9804(MI DEQ) 517-373-9804

Michael Beaulac Michael Beaulac (MI DEQ) 517-241-7808(MI DEQ) 517-241-7808

Sara Pushpala Sara Pushpala (MI DIT) 517-373-8565(MI DIT) 517-373-8565

Phyllis Donahue Phyllis Donahue (EPA–TRI) 202-566-0338(EPA–TRI) 202-566-0338

Natalia Vainshtein Natalia Vainshtein (CSC) 301-306-6465(CSC) 301-306-6465

Bill Rensmith Bill Rensmith (Windsor Solutions) 503-675 7833, x217(Windsor Solutions) 503-675 7833, x217

Kevin Jeffery Kevin Jeffery (Windsor Solutions) 503-675 7833, x202(Windsor Solutions) 503-675 7833, x202

Doug Timms Doug Timms (enfoTech) 609-896-9777, x129(enfoTech) 609-896-9777, x129

Ryan Teising Ryan Teising (enfoTech) 609-896-9777, x148(enfoTech) 609-896-9777, x148