omnios motivation and design ~ lisa 2012

/

Motivation & Design

Building an Illumos-based OS

Friday, December 14, 12

file://localhost/Users/jesus/Downloads/OmniOS_logo.ai





















































































































































































































































































































































































































































Hi, I’m @postwait

• Theo Schlossnagle

• Founder of OmniTI

• Avid open source developer

• Illumos contributor


Motivation

Galaxy Quest (1999)

Sir Alexander Dane You're just going to have to figure out what it wants.What is its motivation?

Jason Nesmith It's a rock monster.It doesn't have motivation.

Sir Alexander Dane See, that's your problem, Jason.You were never serious about the craft.


http://movieclips.com/W7pEA-galaxy-quest-movie-videos/

http://movieclips.com/W7pEA-galaxy-quest-movie-videos/

http://movieclips.com/UB5q-1999-year-videos/

http://movieclips.com/UB5q-1999-year-videos/

http://www.imdb.com/name/nm0000614/






Where the world is going...


Where the world is today...








Some brief history

• We ran a lot of Solaris (10 GA⇾u9 + SXCE)


Some brief history


• I learned that I like: DTrace, crossbow


Some brief history



• I learned that I love: ABI stability, zones


Some brief history




• I learned that I need: ZFS, open source


Some brief history




• I learned that I need: ZFS, open source

• The future was bright


The Oracle Solar(is) Ecplise: 2013/08/13

http://mail.opensolaris.org/pipermail/opensolaris-discuss/2010-August/059310.html




Pouring a 40 for Sun... and moving on.


UNIX lives on in many of us


The motivation

• We have a lot of customers with“traditional deployments”(servers, not instances)

• We would likely have bought Solaris 11,if I could build it from source.

• We needed a path of least resistance for our Solaris 10 users... that delivered on the promises Sun made.


Actual Motivation

It so happensthere is abusinessmodel.


Goals: set ‘em


Goals

ABI Stability, ZFS,Zones, Crossbow,

DTrace, Open Source

#1


Goals

ABI Stability, ZFS,Zones, Crossbow,

DTrace, Open Source

#1

(+ KVM courtesy of Joyent)


Goals

Traditionally installable (on disk)via network

#2


Goals

Traditionally installable (on disk)via network

#2

kayak

ZFS-based

disk imaging


Goals

Bring userlandrecent to prolong life

#3


Goals


#3

Sadly, Ill

umos needs

OpenSSL, libxml2 and zlib


Goals


#3

gcc 4.6.3(4.4 for kernel)

Sadly, Ill

umos needs

OpenSSL, libxml2 and zlib

(1.0.1)

(2

.9.0)

(1.2.7)


Goals

Build all of OmniOSwith core OmniOS

A subjective, “thick” take on JEOS

#4


Goals



#4

Only 111

pieces

of sof

tware


Goals



#4

Only 111

pieces

of sof

tware

“Put that shit in a box and ship it.”


Goals

Consistent multiinstruction-set-architecture

(ISA) support

#5


Goals

Consistent multiinstruction-set-architecture

(ISA) support

#5

Ship both32-bit & 64-bit libsconsistently


Goals

Establish arigorous

major release cycle(every 6 months)

#6


Goals

Establish arigorous

major release cycle(every 6 months)

#62012-04 r151002....

2012-10 r151004


Goals

Establish anon-disruptive

minor update cycle(every week)

#7


Goals

Establish anon-disruptive

minor update cycle(every week)

#72012-04.2 r151002a2012-04.4 r151002b

.

.

.

.2012-10.2 r151002z


Goals

Commercial support formission-criticality

and/orcompliance requirements

#8


Goals

Commercial support formission-criticality

and/orcompliance requirements

#8


Kayak Installs Simple Stupid

• Kayak (http://omnios.omniti.com/browse.php/core/kayak)

• builds an altroot install

• zfs sends it (to a file, then over HTTP)

• makes a miniroot (served over TFTP)

• written in shell (sysadmins rejoice)

• tiny python web server (not required)


http://omnios.omniti.com/browse.php/core/kayak

http://omnios.omniti.com/browse.php/core/kayak

Release Cycles

r151002a


Release Cycles

r151002a r151003


Release Cycles

r151002a r151003

irregularspasmodic

change


Release Cycles

r151002a r151003

irregularspasmodic

change

r151002c


Release Cycles

r151002a r151003

irregularspasmodic

change

r151002c

r151002d


Release Cycles

r151002a r151003

irregularspasmodic

change

r151002c

r151002d 1 wee

k


Release Cycles

r151002a r151003

irregularspasmodic

change

r151002z

r151002c

r151002d 1 wee

k


Release Cycles

r151002a r151003

irregularspasmodic

change

freeze

r151002z

r151002c

r151002d 1 wee

k


Release Cycles

r151002a r151003

irregularspasmodic

change

freeze

r151002z

r151002c

r151002d

r151004a

1 wee

k


Release Cycles

r151002a r151003

irregularspasmodic

change

freeze

r151002z

r151002c

r151002d

r151004a

26 weeks

1 wee

k


Release Cycles

r151002a r151003 r151005

irregularspasmodic

change

freeze

r151002z

r151002c

r151002d

r151004a

26 weeks

1 wee

k


Release Cycles

r151002a r151003 r151005

irregularspasmodic

change

freeze

r151002z

r151002c

r151002d

r151004a

26 weeks

1 wee

k irregularspasmodic

change


Release Cycles

r151002a r151003 r151005

irregularspasmodic

change

freeze

r151004b

r151002z

r151002c

r151002d

r151004a

26 weeks

1 wee


change


Release Cycles

r151002a r151003 r151005

irregularspasmodic

change

freeze

r151004b

r151004c

r151002z

r151002c

r151002d

r151004a

26 weeks

1 wee


change


Release Cycles

r151002a r151003 r151005

irregularspasmodic

change

freeze

r151004b

r151004c

r151004e

r151002z

r151002c

r151002d

r151004a

26 weeks

1 wee


change


Release Cycles

r151002a r151003 r151005

irregularspasmodic

change

freeze

r151004b

r151004c

r151004e

r151004z r151002z

r151002c

r151002d

r151004a

26 weeks

1 wee


change


Release Cycles

r151002a r151003 r151005

irregularspasmodic

change

freeze

r151004b

r151004c

r151004e

r151004z r151002z

r151002c

r151002d

r151004a

26 weeks

1 wee


change

freeze


Release Cycles

r151002a r151003 r151005

irregularspasmodic

change

freeze

r151004b

r151004c

r151004e

r151004z r151002z

r151002c

r151002d

r151004a

26 weeks

1 wee


change

freeze


Available on EC2


Operating System Holy War Outcomes



Editor: vi (naturally)




Filesystem: ZFS (obviously)




Filesystem: ZFS (obviously)

Packaging: IPS (WTF?!)


IPS Controversy

✓IPS sucks (yes, like the rest)

✓IPS made new problems to solve

✓IPS is uncommon


IPS Justification

• IPS builds are part of Illumos

• ipkg zone is something we use

• I’m disaffected:"It's packaging other people's softwarethat makes system administrators violent people"- http://www.youtube.com/watch?v=ieCTIPG43no

• Avoid “solutions:”I’m looking at you facets

• Minimal use of incorporations


http://www.youtube.com/watch?v=ieCTIPG43no

http://www.youtube.com/watch?v=ieCTIPG43no

IPS niceties

• IPS is a network resource

• pkgsend is tool, not a framework

• All HTTP micro assets (cacheable)

• Handles all the BE magic

• Without the “features” it just works


What we learned.

• We built packages for Solaris 10...and for Linux ...and for FreeBSD

• Because we’re a snowflake...just like very one else.

• Rule: “keep your shit to yourself.”


Minimal: not useful

• OmniOS only ships “core”

• no web server. no database.no proxy cache. no PHP. no Ruby.no bind.

• we ship perl, use your own.

• we ship python, use your own.


Minimal: awesome-sauce

We use OmniOS...

like a layered cake

Publisher URL

ms.omniti.com http://pkg.omniti.com/omniti-ms/

perl.omniti.com http://pkg.omniti.com/omniti-perl/


http://pkg.omniti.com/omniti-ms/en/catalog.shtml

http://pkg.omniti.com/omniti-ms/en/catalog.shtml

http://pkg.omniti.com/omniti-perl/

http://pkg.omniti.com/omniti-perl/

Distro Construction Kit

OmniOS as a base for buildingmore comprehensiveIllumos distributions


Adieu

• Thanks

• Go get it as Vagrant box, ISO, USB, or AMIhttp://omnios.omniti.com/wiki.php/Installation

http://www.flickr.com/photos/theaucitron/5810163712http://www.flickr.com/photos/jefflippold/7237388878/http://www.flickr.com/photos/angietorres/4564135455/http://www.flickr.com/photos/adavey/2102499200/http://www.flickr.com/photos/[email protected]/6551534889/http://www.flickr.com/photos/[email protected]/8085629858/http://www.flickr.com/photos/marc-flores/6629287755/


http://omnios.omniti.com/wiki.php/Installation

http://omnios.omniti.com/wiki.php/Installation

http://www.flickr.com/photos/theaucitron/5810163712

http://www.flickr.com/photos/theaucitron/5810163712

http://www.flickr.com/photos/jefflippold/7237388878/

http://www.flickr.com/photos/jefflippold/7237388878/

http://www.flickr.com/photos/angietorres/4564135455/

http://www.flickr.com/photos/angietorres/4564135455/

http://www.flickr.com/photos/adavey/2102499200/

http://www.flickr.com/photos/adavey/2102499200/

http://www.flickr.com/photos/[email protected]/6551534889/




http://www.flickr.com/photos/marc-flores/6629287755/

http://www.flickr.com/photos/marc-flores/6629287755/