chains and processes to facilitate transparency between ... · data center • framework for...
TRANSCRIPT
![Page 1: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/1.jpg)
Chains and processes to facilitate transparency between government agencies and the public.
The Single Window; Dutch customs use case
Asish Dash, CTOMarnix Vermaas, Business Architect
![Page 2: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/2.jpg)
About us• Qualified information exchange,
established in 2006
• Responsible for services provided to governments world wide
• Service the complete delivery from idea to operations using open standards and secured protocols
• We embrace laws and regulations.
![Page 3: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/3.jpg)
What is the concept of Single Window?Drivers:
• In line with EU regulations• EU Directive (2010/65/EU)
• Streamline the Dutch economy• Import value (2017):
400,000 million euros• Export value (2017):
450,000 million euros• Automate complex border
processing• Share required information
between agencies • Standardise and harmonise
![Page 4: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/4.jpg)
What is the concept of Single Window?Stakeholders:
• Four Dutch Ministries• Several Dutch Sea Ports
including Rotterdam (largest port in Europe)
• Schiphol Airport (3rd largest in Europe)
• Various companies, Consortiums, Community hubs, networks, etc. (over 1500 parties)
![Page 5: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/5.jpg)
What is the concept of Single Window?Scope of Interaction:
• All border formalities:• Port entry• Cargo• Health and Safety• Border Security
• Maritime and Air transport
Standards:
• WCO semantic model• XML/EDIFACT• SMTP
![Page 6: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/6.jpg)
Where do the messages go?
Single Window
Customs
Immigrations
![Page 7: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/7.jpg)
Where do the messages go?
Single Window
Customs
Immigrations
![Page 8: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/8.jpg)
Where do the messages go?
Single Window
Customs
Immigrations
![Page 9: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/9.jpg)
Why is it important globally?
EU Single Window
![Page 10: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/10.jpg)
What’s our situation?March 2016
Customs Declaration Platform
• Legacy, as-is migration to our platform
• 1-to-1 messages (to Customs)
September 2016
Maritime Single Window MSW
• 1-to-many messages
• Compliant by Design
• WCO Semantic model
• Dutch sea ports connected, incRotterdam
June 2017
Generic Single Window SW
• Dutch airports connected, incSchiphol
• EDIFACT/XML conversion
• Single point of contact for all Dutch border formalities
Aug 2018
Increased volumes, More standards
• More businesses connected
• Business 2 Government (B2G) – 80,000 messages per day (MPD)
• Government 2 Business (G2B) –40,000 messages per day (MPD)
![Page 11: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/11.jpg)
Why did we select TIBCO?
• Onboarding experience• Our team actually enjoys working with and
supporting connecting parties
• Support of Active-Active maintenance• This infrastructure and setup is being used as a
blueprint for other government deployments
• Built-in monitoring of connection points• At a technical and functional level, made our life
easier.
![Page 12: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/12.jpg)
What TIBCO products do we use?
TIBCO BW & BC
• Government transaction gateway for chain processing
TIBCO BW, RV, EMS
• Integration and scalability
![Page 13: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/13.jpg)
How do we use our TIBCO products?
SOAPSOAP
TESTING STUB
ESB ROUTERPOSTFIX
MTAPOSTFIX
Adapter
SMTP-MTA
SMTP Service
Generic Service
(e.g. WUS)
SMTP
• 10K bus messages per minute• 10 TIBCO nodes (BW, RV, EMS)• 30% burst
• No issues at burst• No issue with sustaining burst
POSTFIX
MSA
SMTPPOP3
TERMINOLOGY• MSA – Mail Submission
Agent for mailclient to SMTP server
• MTA – Mail Transmission Agent for machine to machine SMTP traffic
• POSTFIX – Mail Server• WUS – WSDL, UDDI,
SOAP
TECHNICAL CHALLENGES:• Timelines• Burst traffic• 0 down time, 0 loss of
messages, 15s guaranteed delivery
![Page 14: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/14.jpg)
What success looks like Mar 2016 Business
• Platform migration as-is
• Virtually no impact on businesses
• Customs Declarations
INBOUND
DC1 DC2
HTTPSRV1
HTTPSRV2
HTTPSRV3
HTTPSRV4
DB 1 DB 2 DB 3 DB 4
APP SRV2
APP SRV1
APP SRV3
APP SRV5
APP SRV4
APP SRV6
Technical
• Seamless transition from previous system
• Support for blue-green maintenance
• INBOUND fully load balanced and fault tolerant (combination of BC interior, BC exterior, MFT)
• NFS tuned and developed in datacenter to support I/O requirements
![Page 15: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/15.jpg)
What success looks like Sep 2016 Business
• 3 Port Hubs
• Customs, Border Control, SafeSeaNet
• OTP starts transition to Single Window
• B2G – 200 MPD
• G2B – 100 MPD
Technical
• Enhanced monitoring
• Technical
• Functional
• E2E
• Performance tuning based on this monitored data
Go to cool animation …
![Page 16: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/16.jpg)
Enhanced monitoring
Single Window
Customs
Immigrations
1A
1B
2A
2B
3A
3B
E2E
![Page 17: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/17.jpg)
Enhanced monitoring
Single Window
Customs
Immigrations
1A
1B
2A
2B
3A
3B
FunctionalTimingsRepliesTracking
DiskCPURAM
Network
Technical
![Page 18: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/18.jpg)
What success looks like Jun 2017 Business
• Air traffic and cargo messages
• Send and receive in EDIFACT
• B2G – 7,000 MPD
• G2B – 5,000 MPD
Technical
• Automatic databases failover in one data center
• Double management LAN from second data center
• Framework for automatic startup of environments
INBOUND
DC1 DC2
HTTPSRV1
HTTPSRV2
HTTPSRV3
HTTPSRV4
DB 1 DB 2 DB 3 DB 4
APP SRV2
APP SRV1
APP SRV3
APP SRV5
APP SRV4
APP SRV6
DB 2
![Page 19: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/19.jpg)
What success looks like Jun 2017 Business
• Air traffic and cargo messages
• Send and receive in EDIFACT
• B2G – 7,000 MPD
• G2B – 5,000 MPD
Technical
• Automatic databases failover in one data center
• Double management LAN from second data center
• Framework for automatic startup of environments
INBOUND
DC1 DC2
HTTPSRV1
HTTPSRV2
HTTPSRV3
HTTPSRV4
DB 1 DB 2 DB 3 DB 4
APP SRV2
APP SRV1
APP SRV3
APP SRV5
APP SRV4
APP SRV6MG
T SR
V1
DB 2 DB 3 DB 4
![Page 20: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/20.jpg)
What success looks like Jun 2017 Business
• Air traffic and cargo messages
• Send and receive in EDIFACT
• B2G – 7,000 MPD
• G2B – 5,000 MPD
Technical
• Automatic databases failover in one data center
• Double management LAN from second data center
• Framework for automatic startup of environments
INBOUND
DC1 DC2
HTTPSRV1
HTTPSRV2
HTTPSRV3
HTTPSRV4
DB 1 DB 2 DB 3 DB 4
APP SRV2
APP SRV1
APP SRV3
APP SRV5
APP SRV4
APP SRV6MG
T SR
V1
MG
T SR
V2
![Page 21: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/21.jpg)
Lessons LearnedData synchronization is a problem
• DB data synchronization and latency (amount of data, pipe saturation, errors, etc)
Infrastructure fails
• Hardware fails, networks go down, KPIs not met, Hacks and attacks
Actively put in monitoring on day 1
• Don’t assume out of the box monitoring will meet your needs. Functional (individual component/service), Technical (middleware down) and E2E chain (message flow) need to be viewed in a consolidated place.
Equal partners, conflicting interests
• How to build trust and confidence
![Page 22: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/22.jpg)
What success looks like next year?Tackling BREXIT
• 35,000 companies affected:
• More connected parties
• Message volume growth:
• B2G – 120, 000 MPD
• G2B – 60, 000 MPD
One Single Window to rule them all
• Interconnecting national Single Windows
• Additional: Tracking Cargo, Modes of transport and sharing Documentation
EU Single Window
![Page 23: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/23.jpg)
What else do we do with TIBCO?Dutch Tax Declarations
• For Companies and Citizens
• Standard Business Reporting (SBR), Extensible Business Reporting Language (XBRL)
E-Government/GLOBE
• National platform for all communications from Government to Citizen (replacing all paper)
FinTech
• Certified SWIFT Service Bureau, PSD2
• Government transaction gateway for national financial transactions
![Page 24: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/24.jpg)
What’s next?Improve our architecture
• APACHE kafka (as part of SMACK stack)
• Autoscaling
• Hyperledger
Hackathons
• Identities on Blockchain
• Fraud detection/universal track-and-trace
More industries, more …:
• Health and Safety
• Statistics Office
• Housing Authority
• Financial SWIFT transactions
• Personal Data Management (GDPR)
![Page 25: Chains and processes to facilitate transparency between ... · data center • Framework for automatic startup of environments INBOUND DC1 DC2 HTTP SRV1 HTTP SRV2 HTTP SRV3 HTTP SRV4](https://reader033.vdocument.in/reader033/viewer/2022060211/5f04d4447e708231d40fea44/html5/thumbnails/25.jpg)
Questions…• EBPI - https://www.ebpi.nl/
• Hyper42 - https://www.hyper42.eu/
• Blockchaingers Hack-a-thon - https://blockchaingers.org/teams-2018/hyper42
• Dutch Customs Single Window -https://www.belastingdienst.nl/wps/wcm/connect/bldcontenten/belastingdienst/customs/reference_books_and_other_information/single-window/
• EBPI’s news on the launch of Single Window - https://www.ebpi.nl/over-ons/single-window/