p.haul: live migration using criu - pavel emelyanov

P.Haul: live migration using CRIU

Pavel EmelyanovContainers MC, Linux Plumbers, Seattle, 2015

Not-so-live migration using CRIU

src_host# criu dump -t 123 -D images/

src_host# scp -r images/ user@dst_host:images/

dst_host# criu restore -D images/ -d

To install a font: Open Fonts by clicking the Start button , clicking Control Panel, clicking Appearance and Personalization, and then clicking Fonts.Click File, and then click Install New Font. ...In the Add Fonts dialog box, under Drives, click the drive where the font that you want to install is located.http://windows.microsoft.com/en-us/windows-vista/install-or-uninstall-fonts

Almost live migration using CRIU

dst_host# criu page-server -D images/

src_host# criu pre-dump -t 123 -D images/pre/
--page-server --address dst_host --port port
--track-mem

src_host# criu dump -t 123 -D images/dump/ --prev-images ../pre/

src_host# scp -r images/dump/ user@dst_host:images/

dst_host# criu restore -D images/ -d


Live migration using CRIU

Perform nodes compatibility checksCPUs

Kernel modules

Available resources

Do pre-dumps in a loop

Or post-copy memory transfer (userfaultfd)

Copy FS if not shared

Don't forget container config


Live migration using P.Haul

dst_host# p.haul-service --port 123

src_host# p.haul ovz 100 dst_host:123


Where P.Haul currently is

Written in python

Lives at github.com/xemul/p.haul

Knows how to live-migration OpenVZ container

Calls rsync for chroot()-ed container on local FS


Future of P.Haul?

Migrate LXC & Docker containers

Smarter iterationsBetter estimate of memory xfer

Synchronize memory and disk/FS xfer

Shared disk/FS auto-detection

Post-copy live migration

Send images over the wire (CRIU)


Thank you

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline LevelSeventh Outline LevelMain Presentation Title.Font: Gotham Light 36 Point.Use Title Case

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level

Seventh Outline LevelPresenter. Font: Gotham Light 22 Points. Title Case


Seventh Outline LevelPresenter Title. Set in Title Case. 18 Points.

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline LevelSeventh Outline LevelSection Title.Gotham Light. 34 Points. Title Case


Seventh Outline Level01


Seventh Outline LevelSupporting text area. Set in sentence case and Gotham Light at 24 points.




Seventh Outline LevelOct. 24


Seventh Outline Levelsection


Seventh Outline LevelSupporting text in sentence case, set in Gotham Light at 20 points.

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline LevelSeventh Outline LevelCreator TitleDepartment or email (24 points)


Seventh Outline LevelCreated ByGotham Light. 34 Points.


Seventh Outline LevelSupporting text in sentence case, set in Gotham Light at 20 points.




Seventh Outline LevelOct. 24

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline LevelSeventh Outline Level

Click to edit the title text formatSample With Bullets

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline LevelSeventh Outline LevelClick to edit Master text stylesSecond levelThird levelFourth level

Fifth level

Click to edit the title text formatDemo Title
Gotham Light. 34 Points. Title Case


Seventh Outline LevelTitle (left)

Click to edit the title text format3-Col: Content, Titles & Descriptions


Seventh Outline LevelTitle (center)


Seventh Outline LevelTwo LinesTitle (right)


Seventh Outline LevelClick to edit Master text styles

Click to edit the title text formatSample With Only Title

Click to edit the title text formatPresenter Name


Click to edit the title text formatImage (Left)


Click to edit the title text formatImage (Right)


Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline LevelSeventh Outline LevelDrag your picture to placeholder or click icon to add.

Click to edit the title text formatLarge Image: w/Slide Title Area

2014 04.01

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline LevelSeventh Outline LevelThis is an image takeover slide. Drag your picture to placeholder or click icon to add.

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline LevelSeventh Outline LevelDrag picture to placeholder or click icon to add


Seventh Outline LevelImage Title. Font: Gotham Light 24 Points. Title Case


Seventh Outline LevelPresenter Title. Set in Title Case. 20 Points.

Click to edit the title text format3-Col: Pictures, Titles & Descriptions


Seventh Outline LevelTwo LinesTitle text (right)


Seventh Outline LevelTitle text (center)


Seventh Outline LevelTitle text (left)


Seventh Outline LevelDrag your picture to placeholder or click icon to add.





Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline LevelSeventh Outline LevelThank you

p.haul: live migration using criu - pavel emelyanov

Software