case study: log aggregation and reporting for a leading customer experience company - happiest minds

1
Log Aggregation and Reporting For a Leading Customer Experience Company BUSINESS REQUIREMENT To Determine Marketing Effectiveness and Consumer Behavior Load huge Click Stream logs approx 10GB per hr Aggregation of huge machine data BUSINESS IMPACT Multi-level Aggregation optimized for large volume of data as compared to RDBMS or In-Memory OUR SOLUTION Use Hbase/ Hadoop to extract various statistical insights Store the data in Columnar database for faster read/ write throughout Multi-level Map Reduce based aggregation jobs to handle huge volume Speed Optimized Solution Analyzing multi-structured log data to derive insights Hbase Archived Log Files ETL Tool BATCH SCAN TIME SCAN TIME SCAN B4 B3 B2 B1 M/R Job M/R Job M/R Job Batch Table Batch Aggregation Table Session Aggregation Table Cross Session Aggregation Table Map Reduce Workflow Batch Insert Multi-level Map Reduced Based Aggregation Load Store Process Tables Hbase Case study Happiest Minds has a sharp focus on enabling Digital Transformation for customers by delivering a Smart, Secure and Connected experience through disruptive technologies: mobility, big data analytics, security, cloud computing, social computing, M2M/IoT, unified communications, etc. Enterprises are embracing these technologies to implement Omni-channel strategies, manage structured & unstructured data and make real time decisions based on actionable insights, while ensuring security for data and infrastructure. Happiest Minds also offers high degree of skills, IPs and domain expertise across a set of focused areas that include IT Services, Product Engineering Services, Infrastructure Management, Security, Testing and Consulting. Headquartered in Bangalore, India, Happiest Minds has operations in the US, UK, Singapore and Australia. It secured a $52.5 million Series-A funding led by Canaan Partners, Intel Capital and Ashok Soota. For more information visit www.happiestminds.com. Write to us at [email protected] About Us © Happiest Minds Proprietary

Upload: happiest-minds-technologies

Post on 12-Jul-2015

40 views

Category:

Technology


3 download

TRANSCRIPT

Page 1: Case study: Log Aggregation and Reporting For a Leading Customer Experience Company - Happiest Minds

Log Aggregation and Reporting For a LeadingCustomer Experience Company

BUSINESS REQUIREMENT

To Determine Marketing Effectiveness and Consumer Behavior

Load huge Click Stream logs approx 10GB per hr

Aggregation of huge machine data

BUSINESSIMPACT

Multi-level Aggregation optimized for large volume of data as compared to RDBMS or In-Memory

OUR SOLUTION

Use Hbase/ Hadoop to extract various statistical insights

Store the data in Columnar database for faster read/ write throughout

Multi-level Map Reduce based aggregation jobs to handle huge volume

Speed OptimizedSolution

Analyzing multi-structured log data to derive insights

Hbase

ArchivedLog Files

ETL Tool

BATCHSCAN

TIMESCAN

TIMESCAN

B4

B3

B2

B1

M/RJob

M/RJob

M/RJob

BatchTable

BatchAggregation

Table

SessionAggregation

Table

Cross SessionAggregation

Table

Map Reduce Workflow

BatchInsert

Multi-level Map ReducedBased Aggregation

Load

Store

Process

Tables

Hbase

Case study

Happiest Minds has a sharp focus on enabling Digital Transformation for customers by delivering a Smart, Secure and Connected experience through disruptive technologies: mobility, big data analytics, security, cloud computing, social computing, M2M/IoT, unified communications, etc. Enterprises are embracing these technologies to implement Omni-channel strategies, manage structured & unstructured data and make real time decisions based on actionable insights, while ensuring security for data and infrastructure. Happiest Minds also offers high degree of skills, IPs and domain expertise across a set of focused areas that include IT Services, Product Engineering Services, Infrastructure Management, Security, Testing and Consulting.Headquartered in Bangalore, India, Happiest Minds has operations in the US, UK, Singapore and Australia. It secured a $52.5 million Series-A funding led by Canaan Partners, Intel Capital and Ashok Soota.

For more information visit www.happiestminds.com. Write to us at [email protected]

About Us

© Happiest Minds Proprietary