spotify guest

8/2/2019 Spotify Guest

1/70

Distributed Systems

Jon slund@jooon


2/70

Who am I?


3/70

Jon slund


4/70

Sweden


5/70

Computer Science


6/70


7/70

Shakespeare

ProgrammingLanguage


8/70

Joined SpotifyAutumn 2006


9/70

April 2006the idea


10/70


11/70


12/70

music itself is going to become

like running water or electricityDavid Bowie, 2002


13/70


14/70


15/70


16/70

Spotify Box

Spotify Box Jordi Parra @zenona


17/70

February 2012


18/70

10+ million users(active within previous 30 days)


19/70

15+ million tracks


20/70

500+ million playlists


21/70

1000+ serversin 3 countries


22/70

Spotify is a distributedsystem


23/70

Fast


24/70

Always working


25/70

How do youaccomplish that?


26/70

Cheatas much as possible


27/70

Fast

vsFeels fast


28/70

Always working

vsPretend there is

nothing wrong


29/70

Build to fail


30/70

Redundancy(talk about waffles)


31/70

Error recovery


32/70

Don't forget to testyour recovery code


33/70

Fire drill: Cut theatlantic cable


34/70

NetflixChaos Monkey


35/70

On January 15, 1990,AT&Ts long-distancetelephone switching systemcrashed.


36/70

Isolation

G tti th i ht t l


37/70

Getting the right tool

for the job


38/70


39/70


40/70

Consistency

AvailabilityPartition tolerance

http://ksat.me/a-plain-english-introduction-to-cap-theorem/
http://ksat.me/a-plain-english-introduction-to-cap-theorem/http://ksat.me/a-plain-english-introduction-to-cap-theorem/


41/70


42/70

user

user


43/70

PostgreSQL

user

user


44/70

user


45/70

search

search


46/70

Lucene index inmemory

search

search


47/70

replaced daily

search

search


48/70

read only

search

search


49/70

scales horizontally

search

search


50/70

sort of

search

search


51/70

How do you replace an

index in memory whenyou are using all of it?

search


52/70

storage

storage


53/70

storage

storage


54/70

sto age

lru cache in nginx

storage


55/70

g

better use of memorywith sharding


56/70

storage


57/70

g

consistent hashing


58/70

playlist

playlist


59/70

cassandra

p y

playlist


60/70

structured key-valuestore

p y

playlist


61/70

high throughput

p y

playlist


62/70

choose redundancy andconsistency level

p y

playlist


63/70

datacentre aware

p y


64/70

p2p


65/70

p2p


66/70

thank you


67/70

Master Thesis?


68/70

Yes, please!


69/70

or come and work for us

Oh and


70/70

Oh, and

we havecake as

well! :D

spotify.com/jobs

spotify guest

Documents