moving hudl from ms sql to mongodb: a two year journey

MOVING FROM MS SQL TO MONGODB: A TWO YEAR JOURNEY

BRIAN KAISER

HUDL

2008 2009 2010 2011 2012 201312 350

2200

6000

12000

15000Hudl Growth

Payi

ng S

choo

ls

650 million clips

99% top recruits:every game

18 Petabytes

ELB

Cluster Router

C o r e H i g h l i g h t s R e c r u i t i n g …

IIS IIS IIS

Chef Server

Deployment Control

Overwatch

Eureka

RabbitMQ

memcache

MongoDb MongoDb

RabbitMQ

IIS IIS IIS IIS IIS IIS

MS SQL

WHY MONGO?

DEVELOPERS

MONGO

MIGRATION TIME• Planning, experiment, iterate• Buy-in• Communication

ClipsClipId longTeamId long… …

ClipAnglesClipId longAngleId LongAngleName Strin

gDuration long

MediaFilesClipAngleId longPath Strin

gQuality IntLength long

ClipDataClipId longColumn StringValue StringType int

ClipsToCutupsClipId LongCutupId LongOrder int

CutupsCutupId longName StringDate date

CHALLENGES• FK Relationships• Developer training• WriteConcerns• Staging environments

RESULTS• Stable consistent growth• Rapid iterations• Ops promotes squad growth, not

holding it back