Managing CloudJingren Zhou

Microsoft Corp.

Mission Impossible?

. . .

. . .

… … …

I can manage 16 machines

Database vs. MapReduceDifferent in design principles

Scale: x100 vs. x1000 or moreHardware: high-end vs. commodityFault-tolerance: hardware vs. software

AutoAdmin: add-on vs. built-in Database: first knobs, then auto managementMapReduce: auto recovery/tuning is part of the

system

SCOPE / CosmosA hybrid of parallel database and

map-reduce systemSCOPE [VLDB’08]:

SQL-like declarative languageRelational data modelDatabase-like query optimization

Cosmos Storage SystemAppend-only distributed file

system for storing petabytes of data

Optimized for sequential I/OData is compressed and

replicated

Common RolesSystem configurationResource management: setting quota on disk,

CPU, network, etc.Security implementationGeneral technical trouble shooting and

consultationPatch systemPlan growth and capacity…

Different FocusDatabase DBA

Focus on database/application performance turning

Database physical design and implementationSystem RecoveryBackup implementation

Cloud AdministratorMain job: keep the system alive

Monitor all kinds of events/alerts Ensure data availability/replication, etc.

Progressive system deployment/upgrade