flockdata overview

©2013-2015 FlockData LLC - All rights reserved

Open-source information management and data integration

COLLECT | CONNECT | COMPARE

TURNING DATA INTO INFORMATION


“The evidence is clear: data driven decisions tend to be better

decisions. Leaders will either embrace this fact or be replaced

by others who do.” – Harvard Business Review


Companies resistant to data

do not thrive.


Companies resistant to data

do not thrive.

Even if you have the desire…

you can’t get the data…

It exists in 27 different computer

systems with different structures.


1. 3 V’s of Data

The challenges businesses face


1. 3 V’s of Data

2. Data problems are hard - where do you start?

The challenges businesses face


Data versioning

Data models

27 different systems

New systems accessing data

Additional integrations

Data connectivity

Data silos

Data schemas

Changes to models over time

Audit trails

Compliance

These shouldn’t be problems any more in 2015.

We have the technology. We can make it better.


So what is ?


Data integration Flexible data store Data workbench

APIBatch loaderJava Springframework




Logical datawarehouseSearch indexGraphTimelineVersioning& audit




Logical datawarehouseSearch indexGraphTimelineVersioning& audit

Data workbenchAsk & answer data questionsReportsDashboards


The rise of graph data

“Google's Knowledge Graph and Twitter's Interest Graph are similar to Facebook's Social Graph, and traditional database vendors such as Oracle, IBM, Microsoft Research's “Trinity”

are getting into the Graph…

Source: http://www.zdnet.com/article/facebooks-social-graph-neo4j-show-rising-use-of-graph-databases/


What do the world’s largest & most complex data stores have in common?

Sources: https://gigaom.com/2013/06/06/heres-how-the-nsa-analyzes-all-that-call-data/https://gigaom.com/2013/06/07/under-the-covers-of-the-nsas-big-data-effort/

http://neo4j.com/blog/why-the-most-important-part-of-facebook-graph-search-is-graph/

•multiple instances each storing tens of petabytes •backend of the agency’s most widely used analytical

capabilities •Accumulo is especially adept at analyzing trillions of data

points in order to build massive graphs


What do the world’s largest & most complex data stores have in common?

Sources: https://gigaom.com/2013/06/06/heres-how-the-nsa-analyzes-all-that-call-data/https://gigaom.com/2013/06/07/under-the-covers-of-the-nsas-big-data-effort/

http://neo4j.com/blog/why-the-most-important-part-of-facebook-graph-search-is-graph/

•multiple instances each storing tens of petabytes •backend of the agency’s most widely used analytical

capabilities •Accumulo is especially adept at analyzing trillions of data

points in order to build massive graphs

•Technology giants such as Facebook, Google, and Twitter have all built graph technologies from the ground up to differentiate and grow their business. Building and maintaining one’s own database management system however is not a practical solution if you’re not Facebook.

•PageRank changed the fundamentals of web search - taking into account how the pages are connected

•Facebook = Social graph •Google = Knowledge graph •Twitter = Interest graph


What we’re all fighting for


But the graph isn’t everything…


Not all data is graph data


Multi-model is the key to modern and future data


Graph Search Document


HTTP/REST/JSON

Info Flows Through FlockData

`


HTTP/REST/JSON

Info Flows Through FlockData

• Pipe in data from anywhere through simple REST API, in JSON format

• Model data profile with business context (domain document) and load in that JSON format into flockdata

• Different data tools for different analysis types


FlockData provides a single, unified multi-model access

point for both data storage and information retrieval


Connect Meta Data

Disclaimer: image not generated by AuditBucket

Meta-data captured and stored

Connections are made for analysis

See hidden relationships fast!


Shape the network


Connected Sales Data Analysis

Analyze most sold items, top sellers

View sales channels per item or channel type

Thicknesses and arrows indicate strength and

relevance of data points


Aggregate Insights


Dashboards


Versions of Data


How companies manage data: Evolution towards simplicity

1990s / 2000s


How companies manage data: Evolution towards simplicity

1990s / 2000s 2010+


flockdata vs. ______Product Time to

implementCost of

implemen-tation

Focus of platform

Skills needed Features TCO Approach

to data

FlockData 1-2 Weeks $0-$80KInformation

management, meta-data

& graph

Understand-ing of your

data

Audit, integration,

graph, search, storage

$10s-100s K USD

Business-centric

Hadoop 4-8 Weeks $0-$500K

Storage & platform for

building tools

CodingStorage,

interface to algorithms

$100s K - 1m+ USD

Technically focused

Data Ware-house

6-12 Months $500K-$5M

Data storage in structures

SQL, ETL Storage, aggregates

$100s K - 1m+ USD

Strict structure /

SQL

Elastic Search 4-8 Weeks $50K-

$100KSearch in

clusterCoding & Sysadmin

Storage, search

$10s-100s K USD

Technically focused

Neo4j 4-8 Weeks $0-$100K Graph in cluster Coding Storage,

graph$10s-100s

K USDTechnically

focused


What customers are saying about flockdata

I got goosebumps listening to you talk about data…Smart people heading for a bright future.

- Head of data management, ANZ Bank

Nobody’s talked to me about my data in a business context like this before - CIO, WestStar Mortgage

(FlockData is) the only thing you need to do, to effectively manage information - Big data consultant


Benefits of flockdata

• Integrate information in a logical, context-aware and flexible framework

• Consistent business focused approach to enterprise information

• Builds an enterprise graph and search engine from your data

• Find ANY data tracked from ANY system FAST

• Manage data for audit, governance, lineage, change data control and compliance


What does a flockdata install look like?


So how do you work with flockdata?


FlockData is a simple and fast way to start becoming a

data-driven organization

©2013 AuditBucket Pty Ltd & Entiviti LLC - Proprietary & Confidential - DO NOT SHARE

COLLECT | CONNECT | COMPARE

flockdata overview

Business

data problems

vs of data

rise of graph data

flockdata llc

dataef http

complex data stores

data driven decisions

answer data questions