visualizing big data in drupal using data visualizations to drive knowledge discovery david hazel -...
Post on 23-Dec-2015
217 Views
Preview:
TRANSCRIPT
Visualizing Big Data In Drupal Using Data Visualizations to Drive Knowledge Discovery
David Hazel - dhazel@uw.edu
Assistant Director - Center for Web and Data Science
Brad Porter - bjporter@uw.edu
Undergrad. Research Assist. - Center for Web and Data Science
PNWDS - 2012 University of Washington, Tacoma
10/21/2012 UW Tacoma / WebDataScience.org
• Consistent Look and Feel• Content Management• Modules• Secure and Solid Code Base• Great Community
Why We Use Drupal?
10/21/2012 UW Tacoma / WebDataScience.org
• HTML5• Slick UI• Fast Query Management• Explore Really Big Data• SCALE
But...I want
10/21/2012 UW Tacoma / WebDataScience.org
So...We turn To
10/21/2012 UW Tacoma / WebDataScience.org
django
10/21/2012 UW Tacoma / WebDataScience.org
RoR
10/21/2012 UW Tacoma / WebDataScience.org
10/21/2012 UW Tacoma / WebDataScience.org
10/21/2012 UW Tacoma / WebDataScience.org
• Tradeoffs• Drupal vs Custom
The Problem
10/21/2012 UW Tacoma / WebDataScience.org
World of BIG DATA
PNWDS - 2012 UW Tacoma / WebDataScience.org 10/21/2012
• Really large data sets• Complex queries• Inconsistent load times• Visualize Data in meaningful ways
Some Real World Examples
PNWDS - 2012 UW Tacoma / WebDataScience.org 10/21/2012
• DDRS• CHF Risk of Readmission• Adoptopedia
Dietary Data Recording System
PNWDS - 2012 UW Tacoma / WebDataScience.org 10/21/2012
CHF Risk of Readmission
PNWDS - 2012 UW Tacoma / WebDataScience.org 10/21/2012
• No reimbursement for readmission within 30 days
• Examine Factors that Contribute to Readmission
• Better Care• Reduced Costs
Adoptopedia
PNWDS - 2012 UW Tacoma / WebDataScience.org 10/21/2012
What do all these have in common
PNWDS - 2012 UW Tacoma / WebDataScience.org 10/21/2012
10/21/2012 UW Tacoma / WebDataScience.org
10/21/2012 UW Tacoma / WebDataScience.org
OSPI Data Dashboard Project
10/21/2012 UW Tacoma / WebDataScience.org
Center for Web and Data ScienceCenter for Strong Communities & Schools
OSPIState Needs Projects
Lots of Data
PNWDS - 2012 UW Tacoma / WebDataScience.org 10/21/2012
• 10 Sites across WA State• 100's of Trainings
• Homemade survey systemo MySQL database (LAMP)o How to merge data
Seemingly missing data Hardcoded modifications
Data + Challenges
10/21/2012 UW Tacoma / WebDataScience.org
• Drupal surveyso Separate PostgreSQL databaseo Webform module
Lacking queue system
Data + Challenges Cont.
10/21/2012 UW Tacoma / WebDataScience.org
Data Flow
10/21/2012 UW Tacoma / WebDataScience.org
Standardized questions integrated into Webform
Drive visualizations
Import into external datamart
Visualizing the Data
10/21/2012 UW Tacoma / WebDataScience.org
• Custom modules• pull data from External Datamart• Load JSON into Browser• Visualize the Data
wds_viz.module
PNWDS - 2012 UW Tacoma / WebDataScience.org 10/21/2012
Why D3.js?
10/21/2012 UW Tacoma / WebDataScience.org
• Transitioning From Flasho Printer Compatibilityo No plugins necessary
• Image Embeddingo Lower Bandwidtho Dynamic Graphs
Pie Chart
10/21/2012 UW Tacoma / WebDataScience.org
Choropleth
10/21/2012 UW Tacoma / WebDataScience.org
Bar Graph
10/21/2012 UW Tacoma / WebDataScience.org
Parallel Coordinates
10/21/2012 UW Tacoma / WebDataScience.org
Implementation / Integration
10/21/2012 UW Tacoma / WebDataScience.org
• Under 40 lines of code
• Completely customizable
Implementation / Integration
10/21/2012 UW Tacoma / WebDataScience.org
Implementation / Integration
10/21/2012 UW Tacoma / WebDataScience.org
Implementation / Integration
10/21/2012 UW Tacoma / WebDataScience.org
• Map is Drawn• Plot svg circles• Calculate x,y = long/lat• Set color palette based on count• Set r = 0• Time series change r
Heat map Constructions
10/21/2012 UW Tacoma / WebDataScience.org
• Heatmap transition• function changeHeat()
CODE DEMO
10/21/2012 UW Tacoma / WebDataScience.org
Vision: To be the Rosetta Stone for Societal Big Data
Center for Web and Data Science
Q&A
10/21/2012 UW Tacoma / WebDataScience.org
top related