using cartodb to analyze openstreetmap data

Post on 15-Jan-2015

5.719 Views

Category:

Technology

2 Downloads

Preview:

Click to see full reader

DESCRIPTION

A brief introduction to CartoDB and some of its powerful features for working with OpenStreetMap data. Given in October 2012 at StateoftheMap PDX

TRANSCRIPT

Analyzing OpenStreetMap using CartoDB

Sunday, October 14, 12

Senior scientist and developer @vizzualityFind me @andrewxhill

Sunday, October 14, 12

User, developer, and pusher of limits @cartodbFind me @andrewxhill

Sunday, October 14, 12

blog.cartodb.comSunday, October 14, 12

So tell me already,What is CartoDB?

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

CartoDB is a tool to build applications and master your geospatial data

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Importing OSM data into CartoDB it’s sooooo easy

Sunday, October 14, 12

We support directly importing OSM and other formats too!

shp, csv, kml, etc

Sunday, October 14, 12

CartoDB uses osm2pgsql it keeps it simple

Sunday, October 14, 12

Sunday, October 14, 12

1 OSM file becomes 4 CartoDB tables

1. Points2. Polygons3. Roads4. Linestrings

Sunday, October 14, 12

Import local data from .org or mirror simple drag-drop support on most browsers

Sunday, October 14, 12

Or! Import directly from URL www.openstreetmap.org

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

From here the sky is the limit combine SQL, CartoCSS, and APIs with ease

Sunday, October 14, 12

no. seriously.

Sunday, October 14, 12

SQLremember. it’s everywhere

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

EMBEDsql is everywhere

Sunday, October 14, 12

Sunday, October 14, 12

SQL APIsql is everywhere

Sunday, October 14, 12

Sunday, October 14, 12

youraccount/osmtable/11/1022/679.png

youraccount/osmtable/11/1022/679.png?yada WHERE rail

Sunday, October 14, 12

CREATIVITYsql is everywhere

Sunday, October 14, 12

not for me

Sunday, October 14, 12

http://goo.gl/orkoqSunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

CLIENT SIDELeaflet, Google Maps, Backbone, D3

Sunday, October 14, 12

Sunday, October 14, 12

ORmore practical things

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

INNOVATIONthey don’t let us sleep...

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

_I want to see ‘X’ over timeusing the SQL API with big data

Sunday, October 14, 12

Sunday, October 14, 12

WITH  hgrid            AS  (SELECT  Cdb_rectanglegrid(Cdb_xyz_extent(8,  12,  5),                                  Cdb_xyz_resolution(5)  *  4,                                                        Cdb_xyz_resolution(5)  *  4)  AS  cell)  SELECT  x,                y,                Array_agg(c)  vals,                Array_agg(d)  dates  FROM      (SELECT  St_xmax(hgrid.cell)                                                                                        x,                                St_ymax(hgrid.cell)                                                                                        y,                                Count(i.cartodb_id)                                                                                        c,                                Floor((  Date_part('epoch',  built)  -­‐  -­‐10418716800  )  /  32837875)  d                  FROM      hgrid,                                us_po_offices  i                  WHERE    St_intersects(i.the_geom_webmercator,  hgrid.cell)                  GROUP    BY  hgrid.cell,                                      Floor((  Date_part('epoch',  built)  -­‐  -­‐10418716800  )  /  32837875)                )  f  GROUP    BY  x,                      y

Sunday, October 14, 12

1

10

100

1000

3mb 70mb 300mb1.5

21.2

300

70

3

Raw Datacube

Payload sizesSunday, October 14, 12

http://goo.gl/TsGsr

Sunday, October 14, 12

https://dl.dropbox.com/u/580074/osm_edits_in_madrid.mov

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

That’s CartoDB + OpenStreetMap in a nutshell come talk to me, I’m sure I missed much more

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Sunday, October 14, 12

Thanks!@andrewxhill

Sunday, October 14, 12

top related