from mainframe to freebsd - eurobsdcon · from mainframe to freebsd hans-martin rasch data-service...
TRANSCRIPT
![Page 1: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/1.jpg)
From Mainframe to FreeBSD
Hans-Martin Rasch
Data-Service [email protected]
EuroBSDCon 2010, Karlsruhe
![Page 2: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/2.jpg)
Outline
1. The DSS company
2. BS2000 features
3. Migration of peripheral components
4. The main migration project
5. Summary
![Page 3: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/3.jpg)
The DSS company
![Page 4: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/4.jpg)
DSS – who we are
• located in Stockelsdorf (near Lübeck, Germany)
• Founded in 1977
• Now: 45 employees
• 20 programmers
• http://www.dssgmbh.de/
![Page 5: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/5.jpg)
Some of our customers
![Page 6: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/6.jpg)
DSS – what we are doing (I)
• develop customized programs for online and batch mode
• run a computing center, including network, data storage and backup
• provide an online system
• handle automated batch processing
![Page 7: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/7.jpg)
DSS – what we are doing (II)
• data exchange with banks, publishers, post, etc.
• print letters, invoices, reminders, address labels for the mailing of magazines
• franking and enveloping of letters
![Page 8: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/8.jpg)
DSS – printing equipment
VarioPrint 5160160 pages/min.
![Page 9: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/9.jpg)
DSS – printing equipment
PageStream 7550550 pages /min
![Page 10: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/10.jpg)
DSS – inserting systemscapacity:20000 letters/h
currently 1.5million lettersper month
![Page 11: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/11.jpg)
Mainframeenvironment
![Page 12: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/12.jpg)
BS2000 features
• stable and reliable• easy administration and automation• ISAM with shared updates, crash safe• SORT, sorts binary data• job queues• sophisticated backup/restore (ARCHIVE)• integrated SPOOL, printer protocol IPDS• OpenFT: file transfer with job execution,
automatic restart
![Page 13: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/13.jpg)
DSS applications
• master data stored in ISAM files
• application programs in COBOL (4600 programs, 2.5 million lines of code), but own data access interface written in “C”,
• own online transaction server in “C”, format handling with FHS, IFG
![Page 14: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/14.jpg)
Phase I (1982-2000)
BS2000C40
disk(s) printer(s)tape(s)
MSN PDN
X.25
leased line(s)
PDNPDN
PDN
dte
dte
dte
SPD
SR2000VM
IBM 3540
SCSI
shared private disk
LAN
![Page 15: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/15.jpg)
Migration of peripheral
components
![Page 16: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/16.jpg)
First migration steps (I)
• Online– Step 1: online client in “C”, that could
show FHS formats, connection with TCP sockets via ISDN and Internet
– Step 2: JAVA online client connecting to an online proxy, extendable to use graphical based screens
![Page 17: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/17.jpg)
• Spool– Step 1: “PReS”, proprietary product with
page description language, printer communication with IPDS over SCSI
– Step 2: own page description program, output optional PS or PCL5, printer communication with PJL over TCP sockets, compiler “pres2c”
First migration steps (II)
![Page 18: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/18.jpg)
Phase II (2001-2004)disk(s)
SPD
leased line(s)
SCSI
LAN2
BS2000C40
printer(s)tape(s)
MSN
SR2000VM
IBM 3540
PDN
X.25 PDN
PDN
dte
dte
dte ISDN Internet
Router Router
ftp
portal
Firewall
Firewall
Backup ServerBSD
LaserprinterPCL
SpoolserverBSD
LaserprinterPostscript
Mainframe
PC 9750emulation
LAN1
DMZ
![Page 19: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/19.jpg)
The main migration
project
![Page 20: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/20.jpg)
Main migration project (I)• Drawbacks BS2000:
– not easily scalable
– Maintainance and upgrade expensive
– Long support reaction time
• Pros FreeBSD:
– stable
– complete
– consistent
– BSD-licence
– all sources available
![Page 21: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/21.jpg)
Main migration project (II)• General plan:
– Several servers, standard Intel based hardware
– Operating system FreeBSD 4.6
– Use only Open Source software
– Keep all COBOL sources and consequently ISAM data storage and FHS online formats
– Rewrite online server
![Page 22: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/22.jpg)
ISAM Berkeley DB→
• BDB Btree access system is “ISAM”
• rewrite of our file access module
• serialization with flock to avoid spinlocks
• replication: inserted TCP_NODELAY, implemented read_after write
![Page 23: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/23.jpg)
OpenCOBOL
• In 2005 version 0.30, properties missing
• Today nearly complete (85 and 2002 standard), see http://www.opencobol.org
• Added lacking points, removed bugs
• Automatic conversion of all sources, kept sources synchronous during the migration phase
![Page 24: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/24.jpg)
Other Replacements
• SORT own tool “dss_sort”→
• PERCON perl scripts→
• Job queues SGE→
• ARCHIVE Amanda / Bacula→
• PDN Soekris (NanoBSD and pf)→
• Procedures shell scripts→
![Page 25: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/25.jpg)
The actual platform change
• start a job exporting the data from BS2000 and importing them in FreeBSD, runs several hours
• change the destination server in the online proxy from mainframe to the FreeBSD server
![Page 26: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/26.jpg)
Phase III (2005-today)
SCSI
LAN
Etherconnect Internet
SoekrisNanoBSD
SoekrisNanoBSD
ftp
portal
Firewall
Backup ServerBSD
LaserprinterPCL
SpoolserverBSD
LaserprinterPostscript
workstationsBSD
LTO-3Changer
server-1BSD
server-3BSD
server-2BSD
server-xBSD
Firewall
...
ISDN
SoekrisNanoBSD
DMZ
![Page 27: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/27.jpg)
Summary
![Page 28: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/28.jpg)
Migration Result
• Good performance
• Costs reduced
• Scalable system (jails, multiple servers)
• Easy testing and debugging
• Sources available
• Many features for future development
![Page 29: From Mainframe to FreeBSD - EuroBSDcon · From Mainframe to FreeBSD Hans-Martin Rasch Data-Service GmbH rasch@dssgmbh.de EuroBSDCon 2010, Karlsruhe. Outline 1. ... •ISAM with shared](https://reader034.vdocument.in/reader034/viewer/2022042203/5ea48b33f991e34149176619/html5/thumbnails/29.jpg)
Thank You for listening!
• Any questions?