Big Data Consulting

Belga Big Content platformThe promise of Big Data...delivered

big industries’ dream team

the information tsunami

data relationships

the same story...again

new sources of information added all the time

multi-tenant isolation

scalable solution

realtime processing

we pitched hadoop

and spark

some other stuff

public datasets

modular processing chain

logical view

Stored Data Source

Streamed Data Source

Data Collection Modules Gateway

Content Indexer Online Record Storage

Content Search Engine

Integration Facade

Management Interface

Analysis Chain

component view

ETL toolchain

HDFS

Spark-Streaming

Dbpedia Freebase

SolrCloud

HBase

Cloudera Hadoop

User Application

Node.JS

Titan

Wiktionary

roadblocks■ processing freebase data■ spark-streaming recovery■ spark and java

current status

the front end

future plans