democratising data at the financial timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf ·...
TRANSCRIPT
![Page 1: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/1.jpg)
@commuterjoy
Democratising data at the Financial Times
Matt Chadburn, Principal Engineer, ft.com May 2016
![Page 2: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/2.jpg)
@commuterjoy
![Page 3: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/3.jpg)
@commuterjoy
"It's about getting every part of the organisation to be more effective
with what they do and democratising data across the
organisation," he explained.
!"The challenge is to move beyond a centralised data function to a
decentralised one, where data becomes part of everyone's
responsibility.
!"It's much more than a technology challenge - creating reports and
saying 'there you go'. It's a training challenge, how we help
everyone understand the impact of what they do.
!"Certainly there's a core of experts who sit in the middle offering
expertise and rigour, but this is about having everybody learn
about our customers and ultimately this is a decentralised
capability."
![Page 4: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/4.jpg)
@commuterjoy
source: opendefinition.org
![Page 5: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/5.jpg)
@commuterjoy
• Users of data at the FT
• Systems we built to support them
![Page 6: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/6.jpg)
@commuterjoy
![Page 7: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/7.jpg)
@commuterjoy
![Page 8: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/8.jpg)
@commuterjoy
![Page 9: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/9.jpg)
@commuterjoy
![Page 10: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/10.jpg)
@commuterjoy
![Page 11: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/11.jpg)
@commuterjoy
Matthias Müller
Volkswagen
Germany
Emissions scandal
Frankfurt Stock Exchange
Automotive
located
headquartered inlisted on
industry
CEOabout
![Page 12: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/12.jpg)
@commuterjoy
User
follows
USA
General Motors
lives in
works for
![Page 13: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/13.jpg)
@commuterjoy
![Page 14: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/14.jpg)
@commuterjoy
![Page 15: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/15.jpg)
@commuterjoy
![Page 16: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/16.jpg)
@commuterjoy
![Page 17: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/17.jpg)
@commuterjoy
![Page 18: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/18.jpg)
@commuterjoy
![Page 19: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/19.jpg)
@commuterjoy
![Page 20: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/20.jpg)
@commuterjoy
Lots of users !
Diverse use cases !
Single version of the truth !
No analytics system can do all this :(
![Page 21: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/21.jpg)
@commuterjoy
Events Data WarehouseAPI
![Page 22: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/22.jpg)
@commuterjoy
category:action
email:open
signup:subscribe
page:view
comment:post
page:scroll
payment:failure
…
account:update
![Page 23: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/23.jpg)
@commuterjoy
Event
Context
User
Device
System
Category
Action
Time
![Page 24: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/24.jpg)
@commuterjoy
![Page 25: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/25.jpg)
@commuterjoy
Data WarehouseAPI
Client-side
Offline
Server (go, java, node)
Webhooks
AMP etc
![Page 26: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/26.jpg)
@commuterjoy
Events API
SQS
Kinesis
Neo4J
Elastic Search
RedShift
Ontotext
Keen.io
Hadoop
Redis
Pusher.io
Google Sheets
![Page 27: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/27.jpg)
@commuterjoy
Events Event streamAPI Enrichment
![Page 28: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/28.jpg)
@commuterjoy
![Page 29: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/29.jpg)
@commuterjoy
![Page 30: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/30.jpg)
@commuterjoy
![Page 31: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/31.jpg)
@commuterjoy
![Page 32: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/32.jpg)
@commuterjoy
![Page 33: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/33.jpg)
@commuterjoy
Events Event streamAPI Enrichment
Maxmind
Time
Device Atlas
Content API
AB Test
Propensity
Propensity
License API
RFV
myFT
![Page 34: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/34.jpg)
@commuterjoy
caniuse.com
Events Event streamAPI Enrichment
Weather
Market prices
Offers
Demographics
QV
Freebase
timezone
Sentiment
sharedcount.com
![Page 35: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/35.jpg)
@commuterjoy
Events Event streamAPI EnrichmentValidation
(in progress!)
![Page 36: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/36.jpg)
@commuterjoy
• Focus on the users need
• Learnable (standards)
• Ease of use (APIs to get stuff in and out)
• Iterative (700+ production releases)
• Open for contribution
Democracy?
![Page 37: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/37.jpg)
@commuterjoy
https://bit.ly/ft-csv-job
![Page 38: Democratising data at the Financial Timesmatt.chadburn.co.uk/presentations/csv-conf-2016.pdf · with what they do and democratising data across the organisation," he explained. !](https://reader036.vdocument.in/reader036/viewer/2022062508/6025379f2d2b915ad323918f/html5/thumbnails/38.jpg)