Download - Introducing FileCatalyst Workflow
© Copyright FileCatalyst, 2015
Presenter
John Tkaczewski, President and Co-Founder FileCatalyst / Unlimi-Tech
© Copyright FileCatalyst, 2015
Agenda• What is FileCatalyst
• File Transfer Issues with TCP
• Acceleration with FileCatalyst
• Speed Improvements with FileCatalyst
• FileCatalyst Workflow 101
• Demo
• Questions
© Copyright FileCatalyst, 2015
What is FileCatalyst?FileCatalyst transfers files at full link speed:
UDP with proprietary retransmission and congestion control
Patented algorithm built from the ground up in-house
Transfer rates up to 10 Gbps (with encryption) using commodity hardware
Not affected by latency and speed degrades, linearly with packet loss
Ability to fully leverage multi-core CPU architecture
Integration with leading Cloud Storage like Amazon S3
© Copyright FileCatalyst, 2015
File transfer Issues with TCP• Flow control limits transmission window, causes dead air with high latency
• Very aggressive in response to network congestion, cannot tune in application layer
• Result is less than ideal performance on wireless, satellite, or long haul links
• Can be tuned but still not ideal for many-one, one-many
TCP is a very serial process. Each packet of data must be received before a new packet is sent = Decreased transfer speed
Source File Destination File
Acknowledgments
Data Packet
© Copyright FileCatalyst, 2015
Acceleration with FileCatalyst
• Ideal for bulk file transfer
• Predictable - Can send at a perfect rate
• Not affected by latency or packet loss
• Congestion Control implemented in application layer
• Tunable congestion control aggression
• Instantly detect link capacity
Source File Destination File
Acknowledgments
FileCatalyst completely saturates the pipe by sending multiple blocks of data = Increased transfer speed
© Copyright FileCatalyst, 2015
FileCatalyst Workflow
Web-based file transfer File Submission• Sending Files to Email Address• Web accessible folders
© Copyright FileCatalyst, 2015
System RequirementsServer• Multi-core CPU with 2Ghz+ per core with
minimum 2 cores• 6GB RAM or more• 80GB of disk space (excluding user data)• Operating system: Windows 2003 or higher,
MacOSX 10.7 or higher, Linux, Solaris• Architecture: 64-bit• Tomcat 7.x (Tomcat 8.x currently not
supported); other containers are not supported.
• MySQL 5.0 or higher with admin rights• Access to SMTP (Outgoing mail server)• Oracle Java SE 7 or higher (64-bit; OpenJDK
not supported)• Internet connectivity: Sub-domain or
dedicated static IP with proper firewall rules
Client• Recent web browser such as Internet
Explorer, Firefox, Safari, Opera or Chrome (Chrome is not supported on Mac)
• Email account to receive emails (for recipient only).
• Java Runtime Environment 7 (JRE) or later (if using acceleration)
• Broadband Internet connection
© Copyright FileCatalyst, 2015
FileCatalyst Workflow 101
Core Components List
Secure Transport Java Applets, Form Upload (if no Java plugin), HotFolder, Mobile and SDK
Intelligence Fields, Order Forms, Sites, Groups, Jobs, Status, File Areas, Users
© Copyright FileCatalyst, 2015
File Transfer OptionsAppletsUpload, download, file areaProtocol detection (UDP, TCP, HTTP) , retry and resumeChecksum and deltas
HotFolderUploads to either a new job or file areaAutomationPre and post taskFolder synchronizationBandwidth Schedule
Native Browser (W3C)Form uploadHTTP linksWhen Java Plugin is not detected 2GB max file sizeNo retry and no resume
Mobile• Uploads into file area
• Job Submission into any order form
• iOS and Android
Future Development• HotFolder job downloads• iOS job submission
© Copyright FileCatalyst, 2015
Workflow ComponentsField Meta data you wish to capture during the job submission process; Input types: Text, Text Area, Drop Down (Select), Date, Quantity (Number) Workflow Modifiers (Smart fields): Recipient Email, Recipient Email CC (Notification List), Site Selector, Email list, Job Expiry, Download Password or automatically generated PIN
Order Form (Main Workflow logic)Collection of fields (meta data) defined by the system adminJob Fields or per file fieldsMultiple order forms per user, a user can execute multiple workflows
SitesAny FileCatalyst Direct Server or 3rd party FTP(s) site Target storage location of files (media) Could be same server but different target path Or a separate geographical locationDynamic path assignment based on the form dataScript execution (Command line OR URL calls)Storage of job artifacts in XML and PDF
© Copyright FileCatalyst, 2015
Workflow ComponentsGroupExtends default user propertiesOrder form assignment (multiple order forms per user)Shared Folders – file area – shared media storageShared transactions (Jobs)Permissions
JobEntity that combines files (media) and order form information (meta data)Transactional information (job history log)
StatusAutomatic status triggers. Incomplete -> Sent, Sent -> Shipped, Incomplete -> ErrorComing Soon: User defined triggers based on the outcome of the script execution or status template
© Copyright FileCatalyst, 2015
Workflow ComponentsUser• Authentication (LDAP, Active Directory, SSO, Internal Database)
• Assigned functionality – submission, distribution, file area, admin or full access• Assigned to one or multiple groups
File Area• Web accessible file share
• Submission of files from file share into Workflow• Automated uploads and downloads via HotFolder
© Copyright FileCatalyst, 2015
User ViewAdministration View
User Authentication
Security
Order Forms Groups Jobs
Fields Users Status
FileCatalyst / FTP Sites
FileCatalyst Workflow
Upload / Downloads (Java Applets, HTTP (Form Uploads), HotFolder , Mobile, API)
Create Job View Job File Area
Building Blocks for any File Transfer Workflow