the secret to scaling a team? strategic architecture · • dev teams can scale & devs enjoy...

The Secret to Scaling a Team?

Strategic Architecture Keeping developers motivated, productive and happy...

Andrew McVeigh, Chief Architect

What Drives Developers?

Participating

in a team

Mastery

of craft

Building

things, getting

stuff done

Architecture &

Dev Happiness A good architecture is like a

well-run kitchen…

A Bit About Me...

Game Client Architecture Modular Architecture = Lots of Independence

Initial Architecture == Major Dev Bottlenecks

UI

Foundation

Feature1 | Feature2 | …

Ember code

Domain models

Data Layer

WAN Comms Layer

Client

Foundation

REST Service REST Service

UI

JS UI Plugin

Framework Data Layer

New Architecture == Space to Do Your Own Thing

JS UI Plugin

Framework Data Layer JS UI Plugin

Framework Data Layer

WAN Comms Layer

Client

REST Service

Tech - General We could make some QoL changes

Tech - Architecture Devs love LCU’s modularity

Tech - Tools Want tool stability & consolidation

Org - Structure Pods seem to be effective

Org - Peers No conflict detected

Org - Leadership Want to rally on vision / contribution

Onboarding We could make some QoL changes

Documentation Devs love LCU’s modularity

“LCU facilitates my work really

well now – a few months ago it

didn’t”

“I spend so much time talking

about how much

I like LCU that my team

gets annoyed”

“I don’t think Ember is the right

tool for the job, but I understand

why we use it.”

Horses for Courses...

Number

of devs

2005 2010 2020 2015

Lessons Learned

Architecture pivoted for

fast creation

• Difference in dev

satisfaction

was extreme

Architecture must be

appropriate for

problem, project phase

and the org

Simplified later for

maintenance

• Smaller team &

product aspiration

Live Video Streaming

Architecture A thousand tiny pieces…

Encoding

Vendor

Encoding

Vendor

Encoding

Vendor

Encoding

Vendor

Video HLS//

Dash Packager

Metadata In Program

Cues (SCTE-35)

Ad

Intelligence

Metadata Service

Metadata Service

Ad Server

Live EPG Data from Networks

(SCTE-224)

Email Other

Sources

VOD Catalog

Data

Client Gateway

Manifest Cache

CDN

Digital Rights

Management

System

Push of Segments

to Origin

Every 4-10

Seconds

Every 4-10

Seconds

Infrastructure for Microservices

Donki PaaS

Apps Apps

Apps

Provisioning System

Apps Apps

VMs

Github Jenkins

Cost of Architecture

Lessons Learned

Costs from fine grained services

• Cross cutting changes affecting 50+

services

• Operational overhead

• Lack of infra gets greatly magnified

Microservices allowed fast

creation, strong ownership

• 15mths from start to significant

OTT player

Massive Data Architecture From a Product to a Platform...

Resolving Identities at Massive Scale...

Offline CRM

Offline Online

Your Customer

Offline Transactions

3rd Party Data …

Scale, Scale and (Some More) Scale

210M+ Active US users


200M+ Active US

consumers


A Massively Successful Product

Data Access Ingestion Activations Distribution

Offline Identity Online Identity

Creating a Platform from a Product

Data Access Ingestion Activations Distribution

Application

Segment

Platform

Apps I D E D2 S

Offline Identity Online Identity

Segment

Creating a Platform from a Product

Platform

App App App App App

Lessons Learned

Use current systems +

signals to form a

platform

Complex products

with massive data

processing reqs are

challenging

Opens up ecosystem:

internal and external

Carefully thought out architecture allows devs to excel

• Demonstrate mastery

• Dev teams can scale & devs enjoy the experience

• Get stuff done!!!

• Virtuous cycle

Unhappy devs is a warning sign

• Exodus not far behind

• Remember - devs love to improve systems and architecture

Summary

For Developers March 2nd – 9 AM – 12:50 PM

San Francisco

• Migration to Google Cloud Platform (GCP)

— a panel with Google’s Kelsey Hightower,

and LiveRamp Engineers

• The Architecture and Future Direction of the

LiveRamp Platform

— Andrew McVeigh, Chief Architect

• The Mechanics Systems behind Lookalike

Modeling

• Privacy: GDPR, CCPA, and Future Data

Regulations

• Enabling Programmatic Integrations and

Flexibility through APIs

• The New TV Landscape: Technical Challenges

and Rewards

Free Registration! Email: [email protected]

the secret to scaling a team? strategic architecture · • dev teams can scale & devs enjoy...

Documents