cs80a foothill college open source talk

Netflix & Open SourceFoothill College C S 80A, January 2016

Andrew SpykerCloud Platform Engineer

About Netflix

● 75M+ members● #NetflixEverywhere (Worldwide)● 42.5B hours watched 2015● > ⅓ NA internet download traffic● 1000’s Microservices● Many 10’s of thousands VM’s● 3 regions across the world● 2000+ employees

2

About me● Cloud platform technologies

○ Distributed configuration, service discovery, RPC, application frameworks, non-Java sidecar

● Container cloud○ Resource management and scheduling, making Docker containers

operational in Amazon EC2/ECS

● Open Source○ Organize @NetflixOSS meetups & internal group

● Performance○ Assist across Netflix, but focused mainly on cloud platform perf

With Netflix for ~ 1 year. Previously at IBM.

@aspyker

ispyker.blogspot.

com

3

Why does Netflix open source?● Allows engineers to gather feedback

○ Openly talk, through code, on our approach○ Collaboration on key projects with the world○ Happily use proven outside open source

■ And improve it for Netflix scale and availability

● Netflix culture of freedom and responsibility○ Want to open source?○ Go for it, be responsible!

● Recruiting and Retention○ Candidates know exactly what they can work on○ NetflixOSS engineers choose to stay at Netflix

NetflixOSS is widely used● The architecture has shaped public cloud usage

○ Immutability, Red/Black Deploys, Chaos,Regional and worldwide high availability

● Offerings○ Pivotal Spring Cloud

● Large usage○ IBM Watson as a Service (on IBM Cloud)○ Nike Digital is hiring NetflixOSS experts

● Interesting usage○ “To help locate new troves of data claiming to be the files stolen from

AshleyMadison, the company’s forensics team has been using a tool that Netflix released last year called Scumblr”

Techblog - techblog.netflix.com

● Technical blog across Netflix

● Written by engineers

● Find projects and overviews of future directions

Net

flix

OSS

n

etfl

ix.g

ith

ub

.io

Net

flix

OSS

n

etfl

ix.g

ith

ub

.io

Tools I use every day

Open Sourcesource control, issues,

pull requests

Internalsource control, issues,

pull requests (git)

Dockercontainers

Jenkins Open SourceContinuous Integration

Open SourceContinuous Deployment

Gradle Java build systems

Why work on open source?

● Open source brought me to Netflix○ Ported Netflix cloud platform, delivery tools, and

insight to IBM cloud, middleware○ Was able to work closely with the team I eventually

joined, knew code I would be working on● Open source key aspects of Facebook,

Twitter, Box, Google, IBM, Microsoft● When interviewing

○ Github projects clear view of talent and approach

Questions