drupal as a data purveyor, part i

ASTONISH DESIGNC H A N G E G A M E astonishdesign.com@astonishdesign #ddtx13@astonishdesign #ddtx13

Drupal as a Data Purveyor

Layering Drupal with emerging technologies to create a performant, scalable data purveyor.

ASTONISH DESIGNC H A N G E G A M E astonishdesign.com@astonishdesign #ddtx13

ASTONISH DESIGNC H A N G E G A M E

Diana Montalion Dupuis@dianadupuis

Sam Heuck@samheuck

Andrew Elster@filmknurd


ASTONISH DESIGNC H A N G E G A M E

We have a new website: astonishdesign.com

@Astonish_Design


An open-source content management PHP/MySQL framework designed for rapid development of content-rich web applications.


Reasons (among many)

• Growth: evolving tool

• Foundation skill set

• User features


http://jdhancock.com/ • JD Hancock• http://farm9.staticflickr.com/8322/8031897271_9c63e48a29_b.jpg

http://jdhancock.com/

http://farm9.staticflickr.com/8322/8031897271_9c63e48a29_b.jpg


“Big” Data

"Big" in relation to the amount of content Drupal is designed

to manage


Volume


Velocity

BIKE WALLS• http://www.bikewalls.com

http://www.bikewalls.com


Variety


Content

•Every kind of data•Coming from everywhere


Current Issues

•Bootstrapping•Bottlenecks - Normalized - Join Happy•Lack of solution architecture


ViewsRapid

DevelopmentPlatform

Visitors& ContentAuthors

Miners

Who is the user?


Welcome to the future

When modularizing the architecture creates performant applications for all content and all users.


Traditional Optimizations


A Balancing Act


Go for the low hanging fruit


ELENA ELISSEEVA, SHUTTERSTOCK • http://www.shutterstock.com/pic.mhtml?id=61884133

Case Study: NRG

http://www.shutterstock.com


High AbstractionEasy to MaintainCheap

Low AbstractionHard to Maintain

Costly

Views Query BuilderDynamic Queries Static Queries

LowPerformance

HighPerformance


The problem with views...


In other words...


Solution!

Dynamic • Extensible • Integrated

Query Builder API


High AbstractionEasy to MaintainCheap

Low AbstractionHard to Maintain

Costly

Views Query BuilderDynamic Queries Static Queries

LowPerformance

HighPerformance

OLEKSANDR DIBROVA/DEPOSITPHOTOS • http://depositphotos.com/10983976/stock-photo-Brick-Wall.html

http://depositphotos.com/10983976/stock-photo-Brick-Wall.html


DuplicateData

RapidDevelopment

Platform

DenormalizedDocument Storage for READS

NormalizedRelational for WRITES

Data Mining

Content & DataCreation

CoSQL


CAP Theorem


DOUG BEGHTEL/THE OREGONIAN • http://www.oregonlive.com/foodday/index.ssf/2011/09/act_quick_on_those_grocery_out.html

http://www.oregonlive.com/foodday/index.ssf/2011/09/act_quick_on_those_grocery_out.html


In our next session ...


Questions?

drupal as a data purveyor, part i

Technology