system imager.20051215
TRANSCRIPT
![Page 1: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/1.jpg)
System Installation Suite
![Page 2: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/2.jpg)
Who Am I
– Linux and Open Source Consultant
– „Infrastructure Architect“
– Linux since 0.98
– IANAKH
– Senior Consultant/CTO @ x-tend.be
![Page 3: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/3.jpg)
WARNING
Or Credits ;)
Sean Dague : OLS2002 Talk
Thomas Lange : Fai talk at UKUUG 2005
Own previous talks
infrastructures.org
![Page 4: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/4.jpg)
Today:
– Automating Machine Installs
– Reproducable
– Distro Independent
– FAST
– No Vendor Lock In!
–
![Page 5: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/5.jpg)
Common Problems
• Accidental Identical Installs
• Many manual changes to systems
• Many undocumented changes
• Emergency Administration only
• Computers don’t work hard enough for us
•
![Page 6: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/6.jpg)
Investing in Automation
• How long does it take to reinstall a machine
from 0
• To the exact same point as before ?
• With different Hardware ?
• What about customer/personal data ?
![Page 7: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/7.jpg)
Facts!• Data Backup is only a part
• Sysadmin backup needs to be done also
• Manual Installations = bad
• Bad installations = unusable infrastructure
• Manual efforts = no time
• Bad installations = unproductive users
• Bad installations= manual efforts
• No time = no updates no patches no security
• Manual work = high costs
![Page 8: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/8.jpg)
Do you want to ? (2)• Install the previous racks manually
• Over and over again ?
• And can you guarantee that installs are identical ?
• Sysadmins are Lazy (by default)
•
![Page 9: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/9.jpg)
Do you want to ? (3)• “No simple admin taks is fun more than twice”
• s/twice/once/g;
• Repeating installs are boring and prone to errors
• Each installation is unintentionally Unique
• Manual installs DO NOT scale
![Page 10: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/10.jpg)
Planning your infrastructure(s.org)
• Look at the infrastructure, not at 1 machine
• Plan changes in advance
• Version Control !
• {SystemAdminstration,Security} is a process, not a product, or even a LifeStyle
• Look for Similarities
• And differences
![Page 11: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/11.jpg)
The 10th floor test
• Grab a random machine (don’t take a backup before)
• Throw it out a 10th floor window
• Can you recover it in 10 minutes ?
![Page 12: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/12.jpg)
Imaging vs InstallingImaging
- Speed
- Identical machines
- Multicasting
Installing
- Finegrained
- “slower”
- Then install the delta's
![Page 13: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/13.jpg)
Imaging Stinks ?
“Imaging sucks unless you create your image
with FAI”
Thomas Lange (FAI Presentation UKUUG 2005)
![Page 14: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/14.jpg)
Sisuite History• Spring 2000 , SF Was just announced by VA Linux , RH 6.2 , Xfree86 4.0
• Not many clusters (no Scyld Beowulf 2 yet)
• RedHat had kickstart
• IBM: Lui Linux Utility For Cluster Installation (v1.0 April 200)
– Rich Ferri , IBM
– RH Only
• SystemImager v1.0 (May 2000)
– Brian Finley, VA Linux System
– Redhat and Debian only
![Page 15: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/15.jpg)
Systemimager Suite: systemimager● Image Base
● Captures Images from a golden client
● All images stored on a central server
● Image is a complete copy of all disks on client
● Linuxbased autoinstall system
● Install from Floppy, CD, Harddrive or Network
![Page 16: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/16.jpg)
SystemImager Suite (2)
● SystemInstaller
● Evolved from LUI
● Generates Images based on
● Packagelist
● Distro type
● Partition Definition
![Page 17: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/17.jpg)
`SystemImager Suite (3)
● SystemConfigurator
● Post install configuration
● Hardware detection / bootloader config
● Distro integration
![Page 18: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/18.jpg)
Systemimager Suite: overview●
![Page 19: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/19.jpg)
SIS Image
• A Directory that contains the entire contents of the filesystems of a live
machines
• Stored in /var/lib/systemimager/images/$NAME
• Exported as an rsync module $NAME
• You can chroot into it
• Not as unchangeable as other imaging tools
![Page 20: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/20.jpg)
Fetching an Image
• Install golden client as you would install any other server
• Install systemimager_client on that machine
• Prepare client
– Run si_prepareclient
– Captures all partition info in to /etc/systemimager/
– Starts rsync daemon as rsync module “root”
• Capture Image from server
– Run si_getimage
– Connects via rsync to rsync://golden-client/root and transfers to
/var/lib/systemimager/images/$imagename
– Calls mkautoinstallscript to build the autoinstallscript
![Page 21: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/21.jpg)
My Advise: this is not the way!
• Perfect for Quick and Dirty backups
• Disaster recovery for single image setups
!! Don’t build your infrastructure on this method !!
• Reproducability is low
• Package management is better these days.
• Minimal changes in chroot are still undocumented and error prone
![Page 22: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/22.jpg)
•si_mksiimage
•Takes parameters such as
• Packages list
•Partition list
•Determines the distribution based on the packages
•Determines”best” version to install of a package (version/architecture)
•Issues:
•Keep track of every distro ?
•Staged installes ?
•Ordering ?
•Post installscripts fail in chroot
Building an Image
![Page 23: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/23.jpg)
– Yum –installroot=/path/ -y groupinstall Base
– Debootstrap
– Urpmi –root=/path basesystem urpmi ssh-server
– Yast
– Rpmstrap
Building an Image in 2005
![Page 24: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/24.jpg)
Other Clues
• Mksidisk
• Addclients
• Mksimachine
• Mksirange
(haven’t used them lately might have si_ prepended these days)
![Page 25: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/25.jpg)
Boel
• Autoinstall is driven by Brian’s Own Embedded Linux
– Special kernel and ramdisk
– Boots from floppy,cd, harddrive or pxe
– Kernel + initrd
– Tarbal with busybox, extra modules , other tools are being
rsynced over the network
![Page 26: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/26.jpg)
Image Server
• SystemImager repository in var/lib/systemimager
– images/images
– overrides/hostname : configfiles per host containing network and
hardware configs and custom scripts
– scripts/ the actual machine dependent install scripts with partition
information etc.
![Page 27: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/27.jpg)
Image server (2)
• DHCP Server
• PXE Boot environment
• /usr/share/systemimager Boel environment (mini embedded
environment)
• Rsync server
![Page 28: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/28.jpg)
Bootstrap Procedure• Create a dhcp config file with the appropriate entries
• Machine PXE Boots over the network and downloads the initial kernel
and initrd
• Creates an initial ramdisk and asks ip addres, hostinfo, and in-
stallserver information.
• download boel image and setup a minimal environment (rsync)
• Based on the hostinfo downloads the host specific script (autoin-
stallscript) (hostnameXY.(sh/master))
![Page 29: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/29.jpg)
AutoInstallScript• Partition the harddisk
• create the filesystems
• mount them
• rsync the $image to the harddisk.
• Run systemconfigurator
• Run postinstall script
• Reboot
![Page 30: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/30.jpg)
Systemconfigurator• Problem:
– Network configs
– Hardware config
– Bootloader
• Solution ?
– Build a huge matrix
• Unmaintainable
– Footprinting detect similar configs
• If /etc/sysconfig/network-scripts then create ifcfg-$ETH
• If /sbin/lilo and /etc/lilo.conf exist then configure lilo
![Page 31: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/31.jpg)
Systemconfigurator• Further problems
– Uses perl
– Can grow big
– Needs other tools
– ==> Chroot into the freshly installed system
• Modular approach
– --confighw , --confignet , --configrd , --configboot , --runboot etc
– Or combinations –configsi == --confighw –confignet –runboot
![Page 32: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/32.jpg)
Image Maintenance
• Updateclient
• Please don’t
• Use package management tools
•
![Page 33: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/33.jpg)
Misc Facts and Figures
• OSCAR : Uses SIS
• Installs as fast as < 4 minutes
• Flamethrower adds multicast features
• Xen integration
![Page 34: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/34.jpg)
Alternative Tools !
• Commercial :
• RedHat Network : Satellite
• Novell Zenworks
• Open Source
• Fai
![Page 35: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/35.jpg)
Links
• http://sisuite.org/
• http://wiki.sisuite.org
•
• http://planet.grep.be/
![Page 36: System Imager.20051215](https://reader034.vdocument.in/reader034/viewer/2022052700/55a0b70e1a28ab094f8b45f2/html5/thumbnails/36.jpg)
? !• Questions ?