big data analytics & cloud services - … data analytics & cloud services . ... • aws...

13
TechMileage Confidential – Not for Distribution BIG DATA ANALYTICS & CLOUD SERVICES

Upload: lamthien

Post on 30-Mar-2018

236 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

BIG DATA ANALYTICS & CLOUD SERVICES

Page 2: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

CONTENTS

2

About TechMileage 1

Big Data Services 2

Why TechMileage? 3

Case Studies 4

Page 3: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

Strategy Services

• Technology Assessments and Future State Definition

• Analytics Assessment and Planning

• IT Advisory Services and Planning

Ongoing Support

• Application Management • IT Governance and Oversight • Analytics Governance • IT Managed Services • Back Office Support /

Management

ABOUT TECHMILEAGE

• Founded in 2008 / Tempe, Arizona

• Over 100 engagements

• Full range of business & technology services

• Software Development, Big Data, BI, Advanced Analytics, QA and support

• Cost effective and high quality delivery model

3

• Application Development • Big Data and BI Design &

Implementations • Advanced Analytics • Cloud • QA / Testing, Modeling,

Security and Mobility

Technology Enablement

Page 4: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

TECHNOLOGY SERVICES & SOLUTIONS

4

Mobile Applications

Application Services

Web Development

Data Services

Big Data

Analytics

Web Services & E-Commerce

Cloud Computing

BI & Data Warehousing

Page 5: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

BIG DATA SERVICES

Big Data Development

• High Performance applications with sub-second response time

• Custom development of Hadoop, MapReduce and PIG applications

• Development using frameworks like cascading

• No-SQL databases, such as Cassandra, HBase, MongoDB, etc.

• SOLR, Oozie , Spark

• Data warehousing and BI solutions with Hive, Vertica, MySQL, Pentaho and Datameer

• Messaging mechanisms such as Flume, Kafka and Storm

5

TechMileage knows Big Data. We have extensive experience in developing Big Data solutions, including Cloud infrastructure design and development.

Operations Support

• Big Data deployment and production support

• AWS infrastructure and operations support

• Monitoring mechanisms, such as ZooKeeper, RightScale, EC2, S3Fox Organizer, PagerDuty, Nagios, Splunk, etc.

Cloud Infrastructure Design and Development

• EC2, Elastic MapReduce, S3, SQS, SNS and DynamoDB

• RightScale-based instance templates and custom alerting mechanisms

• Chef-based instance templates

Prototyping Applications for Cloud & Big Data

Page 6: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

BIG DATA TECHNOLOGY EXPERTISE

Big Data & BI

Cloud Computing

Data Warehousing

6

Visualization and Analytics

Support & Maintenance

Big Data Architecture & Development

Exploration and Discovery

Page 7: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

WHY TECHMILEAGE?

• Proven Competency

– Proven & matured process oriented BigData development competency

• Complete Picture

– End to end coverage across different areas & technologies

– Data Governance

– Support and maintenance

7

• Strong Team

– Strong & experienced development team that can quickly adapt to new environment and technologies

• Flexible Approach & Cost

– Flexible engagement approach customized for your business

– Cost effective global delivery model

Page 8: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

CASE STUDIES BIG DATA & HADOOP

8

Page 9: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

REAL TIME FRAUD AND RISK PRODUCTS FOR MAJOR BANKS

Challenge

Major financial client with fraud and risk services was struggling with development of important high performance services with sub-second response time, for its clients

Solution

• TechMileage employed expertise in Big Data architecture and application development to expedite the development process with technologies like Cassandra, Hadoop, SOLR, Cascading

• Provided consulting services on model governance and model implementation on Hadoop platform

• Designed major components for search and reporting

• Real-time processing solutions using SPARK and Cassandra

• Maintenance and support

9

Page 10: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

SOCIAL MEDIA DATA COLLECTION SUITE

Solution

• Business Metrics Dashboard

• Hive + Amazon S3 + MySQL

• Pentaho Business Intelligence Suite

• AWS Cloud-based Production Support

• EC2/S3/SQS-based Application Support

• RightScale-integrated Monitoring

• EC2 Instance Management

• AWS-based Web Services Support

• EC2-based Hadoop/Hive/ Cassandra Support

Challenge

Design and develop a very complex, high availability data collection system, with multiple input streams of structured and unstructured data

10

Page 11: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

DEPARTMENT STORE CHAIN – IMPROVING ANALYTIC PERFORMANCE

Challenge

Major department store chain with innovative rewards program collects enormous amounts of data, but could not turn data into decision-driven reporting in a timely fashion. At best, reports were always at least one day behind; at worst, reports were highly inaccurate

Solution

• TechMileage employed expertise in Big Data architecture solutions to cut over 12 hours of processing time to less than 20 minutes, paving the way for near real-time updates to marketing campaign results

• Provided consulting on defined data definition structure to greatly enhance reporting accuracy

• Decommissioned data from Teradata (traditional data warehouse) and moved processing and storage to Hadoop/HBase/Hive

• Prepared MongoDB/Hadoop-based BI solutions for alerts, fraud and offer management

• Real-time message processing solutions using Storm

• Maintenance and support

11

Page 12: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

GAMING COMPANY – REAL TIME LOG PROCESSING

Solution

• High availability system

• MapReduce and Hadoop processes

• Data aggregation

• Cassandra and MongoDB

• Kafka messaging for receiving client logs

• MySQL for reporting

• Long term maintenance and support

Challenge

Design and architecture of real-time game log processing system from thousands of gaming clients.

12

Page 13: BIG DATA ANALYTICS & CLOUD SERVICES - … DATA ANALYTICS & CLOUD SERVICES . ... • AWS infrastructure and operations support ... Cassandra, Hadoop, SOLR, Cascading

TechMileage Confidential – Not for Distribution

SOCIAL/VISUAL ANALYTICS COMPANY

Solution

• MapReduce processing for identifying patterns in uploaded images and videos

• AWS Cloud-based development and deployment

• Basic image processing application

• Object identification in images and videos

• EC2 auto-scaling

• S3-based object storage

• SQS-based communication and job processing

• AWS Cloud-based production support

Challenge

Real-time pattern matching, tagging and categorizations of images and videos

13