wso2 partner webinar: managed file transfer with wso2 enterprise service bus
TRANSCRIPT
ManagedFileTransfer:backboneofyouropera7ons ChinmayaTripathy,Integra1onConsultant,YenloRobBlaauboer,Integra1onConsultantYenloSenduranBalasubramaniyam,So<wareEngineerWSO2
April5th2016
Aboutthepresenters
2
ChinmayaTripathySeniorConsultant,YenloChinmayaTripathyisanIntegra1onConsultantwithWSO2knowledgestackalongwith9yearsofexperianceincrossdomainprojectsandtechnologieslikeJava,J2EE,WebServices,Spring,SOAArchitecture,JS,AJAX,DOJO,GWT.HehasaMasterdegreeinComputerApplica1on,followedbygradua1onofscienceasMathema1csasspecialcourse.RobBlaauboerSeniorConsultant,YenloRobisaSeniorBusinessConsultantandSolu1onArchitectwithmorethantwentyyearsexperience.Inaddi1ontohisworkheisanac1vebloggerworkingonanumberofar1clesonthe'InternetofThings'andaWSO2'GeRngStartedwith...'seriesinwhichhetalksaboutWSO2componentsandtheirpurposeespeciallyaimedatnontechnicalreaders.SenduranBalasubramaniyamSo:wareEngineer,WSO2Senduran is a software Engineer at WSO2 and part of WSO2 Enterprise Service Bus engineering team.
3
• PremierPartnerofWSO2
• GlobalOrganiza1on
• OfficesintheNetherlands,Germany,Belgium,UnitedKingdomandUnitedStates
• ExpertsisIntegra1onSolu1ons
• Expertsina‘ConnectedBusiness’
• WSO2project&consultancyservices
• WSO2supportservices:• ProductSupport• DevelopmentSupport• Opera1onalSupport
• WSO2Trainingservices
• Enterprise&Solu1onArchitecture
Whoweare Whatwedeliver
Moreinfoaboutusandourpre-build(WSO2)solu1ons:www.yenlo.com
TopicsWebinar
4
ManagedFileTransfer=SGlloneofthebackbone’sofmanyoperaGons
• Introduc1onto‘FileTransfer’ingeneral
• FiletransferinWSO2ESB(Transports)
• WhataboutManagedFileTransfer?
• BenefitsofourMFTsolu1onbasedonWSO2
• Demonstra1on&Technicaldetails
• Youhaveques1ons?Wehaveanswers!
ThelongevityofFileTransfer
Formanyorganiza1onsfiletransferiss1llpartoftheirdailyopera1ons,forexample:o Transferfilesbetweensystemso Interactwithbusinesspartnerso ManagingLaws(publishing)o Taxreturnstoconsumers
Filetransferisheretostay….
6
o Filescanbereallybig,uptoseveralGB,andreallysmall,somekilobytes,forexample
Bigfilesandsmallfiles
7
o FilescanbePDF,XML,Plaintext,and-so-ono Filescanbeencryptedorevenneedtobeencrypted
XML, PDF, DOC, D
OCX …
Allkindoffiles
8
o A<eruploadingyoumightneedtosendtheuploaderareceipto Calcula1ngahashmightbenecessaryforauditpurposes
ab34e562acd
Receipt We have received…
Filesmayneedreceiptorhash
9
o Checkformaliciouscontent,isthereanyunwantedpayload?
Receipt Warning! We have received…
Maliciouscontent
10
o Ac1ve/PassiveorAc1ve/Ac1vesetupo Makeitscalableo MakingsureoneESBpicksupthefile,nottwoormoreo Needstobeadeadleherchannel(EIP)
Setupcanbechallenging
11
FiletransferinWSO2ESB(Transports)
TransportsinWSO2ESB
Forthecompletelist:hRps://docs.wso2.com/display/ESB490/ESB+Transports
o HTTP/SNIOTransporto HTTPPassThroughTransporto HTTP/SServletTransporto JMSTransporto VFSTransporto FIXTransporto andmore...
13
VFSTransport
SupportedProtocols
o LocalFileSystemo FTPo FTPSo SFTPo WindowsShare(SMB)
14
FileTransportsinESB
15
o VFSTransporto FileInboundprotocolo FileConnector
FileHandlingComponents
VFSTransporto FileprocessingisdonethroughVirtualFileSystem(VFS)
transport.o VFSTransporthastwoparts
o VFSTransportListenero VFSTransportSender
o EnablingbyUncommen1ngthefollowingentriesinaxis2.xml
<transportreceivername="vfs"class="org.apache.synapse.transport.vfs.VFSTransportListener"/>
<transportSendername="vfs"class="org.apache.synapse.transport.vfs.VFSTransportSender"/>
16
o Thisisamuchimprovedalterna1vetoVFSTransporto Supportsmul1-tenancyo Supportscoordina1oninclusteredenvironment
FileInbound
FileConnector
o Speedfilecopy
17
VFSusecases
18
HTTPtoVFS
VFSusecases
19
VFStoHTTP
TheYenloManagedFileTransfersolu1onbasedonWSO2
o ArobustMFTsolu1onbasedonWSO2ESB
o Manyout-of-the-boxfeaturestoaddressmen1onedchallenges,andmuchmore…
o Addedhighavailabilitybyadding2ormoreESBnodes
SoYenlocreated...
21
Inalmostallcasesguaranteeddeliveryisanecessity.TheYenloManagedFileTransferoffers:o SLA’so Possibleguaranteeddeliveryo Deliveryonlyonceo Receiptwithorwithouthasho Possibilitytoworkwithencryptedfiles
GuaranteedDelivery
22
Forcon1nuousopera1onaHAsetupisnecessary:o HAinAc1ve/Passivesinglesetupo HAinAc1ve/Passivegroupsetup(2+groups)
AP
AP
Highavailability
23
Contentandmetadatacontrol
Makingcontentbasedrou1ngpossibleusingsimplerulesbasedon,forexample:o RegEXo Metadata(1mestamp)o Inclusionandexclusioncriteria(size,type,extension)o Encryp1onortheabsenceofencryp1ono Virusscanning
24
Clusteredsetup
Managingmul1pleESB’sandmul1pledropdirectories
25
RegExSample
ExampleofMetadatabasedrou1ng
26
Transportvariables(currentversion)
27
Futuredevelopments
o Encryp1on–Decryp1ono Hashcrea1onforauditpurposeso MalicousPayloadscanningo Receipttosender/uploadero Poten1alValida1onofpayload(internal)
28
ManagedFileTransferWhatarethebenefits?
Benefitsareclear
o Highavailabilityo Mul1tenanto Monitoring&Tracingo Guaranteeddeliveryo MFTisaservice;Sonoheadachesfortheend-user
30
ManagedFileTransferDemonstra1on&Technicalstuff
Demo
o Runningonlocalmachine:twoWSO2ESB’s(4.9.0)o Clustered(Hazelcast)withtwoworkers
o 10000(dummy)fileso 7toobigo 13corrupto 8000XMLfileso 2000PDFfiles
o Es1mated1metofinish:lessthen120seconds
32
ManagedFileTransferYouhaveques1ons?Wehaveanswers!
Contact&Download
34
InterestedinourManagedFileTransfersoluGon?
Downloadthispresenta1on:hhps://www.yenlo.com/en/free-advice/webinarsOrContactus:hhps://www.yenlo.com/en/contact
35
THANK YOU FOR
YOUR ATTENTION