big data just got bigger. - gruter.comgruter.com/download_files/gruter_brochure.pdf · big data...

8
www.gruter.com BIG DATA JUST GOT BIGGER. TECHNOLOGY PRODUCTS GRUTER

Upload: others

Post on 22-May-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

www.gruter.com

BIG DATA JUST GOT BIGGER.

TECHNOLOGY PRODUCTS GRUTER

Big Data Platform DesignGruter specializes in helping companies develop successful Big Dataenvironments by designing carefully-modeled best-fit data platform solutions. Gruter's expertise extends across the full data life cycle, ensuring prescient architecture, robust build, timely deployment and simple operation and maintenance. Through a spirit of partnership and collaboration, Gruter provides its clients with the tools, know-how and support needed to put Big Data to work for immediate bottom-line outcomes.

GOING GLOBALWITH GRUTER

Analytics ServicesGruter provides powerful social networkanalytics and management services which put companies in control of their brand in Asia, and bring local engagement sensitivity to global markets.

Data Feed ServicesGruter also serves rich data feeds to companies which lack internal Big Data facilities. Through simple APIs, data can be accessed and utilized without the cost of maintaining internal platform and systems.

Big Data Platform DeliveryCompanies which are taking the plunge into the Big Data pool can save time and capital by installing Gruter's full end-to-end Big Data platform, complete with in-house training, local customization, and user-friendly web-based management console.

Gruter has the technology to take your company global. Truly global.

YOUR ASIAN PARTNERIN THE BIG DATA REVOLUTION GRUTER

www.gruter.com

The challenge was to help a global web media giant crawl social network sites in Taiwan and Hong Kong in order to provide timely mass coverage data for portal content delivery. Collaborating with Yahoo!, we had to solve a massive problem: we had to acquire content from highly disparate sources across the web, norm-alize their formats, and deliver them in a timely fashion. To get the job done we fine-tuned our in-house smart crawler, Grubot.

Our Team

Data acquisition and delivery

Doo-haeng LeeData Analyst

Hyeong-joon KimChief Architect

The challenge was to enter an entirely new domain in a hot tech area we were unfamiliar with. Our client, we had to solve a massive storage problem: the com-plete genome of each individual maps to hundreds of GB. Our primary architec-tural goal was to design a system which was highly scalable and cost-effective. Moreover, it had to be powerful enough to efficiently index and fetch specific se-ctions of the genome at speed.

Bio-informatics

Jeong-shik JangR&D Leader

The challenge was to design and configure a Big Data platform which could ana-lyze enormous data streams from disparate data sources in real time in order to detect anomalous activity patterns. Collaborating with a global partner, we had to solve a massive problem: performing real-time analysis on data flows requireshighly sophisticated event processing. Fortunately, Hadoop is the ideal solution for this problem.

Security and anomalous transactions

The tech team at Gruter is on a mission to empower companies with better data and deeper insight.

THE DATA DRIVEN COMPANY GRUTER

www.gruter.com

www.gruter.com

User Analysis System (Social CRM, Log Analysis)

QOOBAH COMPONENTS AND APPLICATIONS

Open-source In-house Applications

Distributed Coordinator (Zookeeper) Monitoring / Management (Cloumon)

Data Serialization / Network Protocol (Thrift, Netty)

Data Bus (Bamboo)

Data Flow Management (Cloumon)

File Store (Hadoop File System)

Data Collection(Flume, Sqoop)

User Program (MapReduce)

(Hive)High-level Analysis Script

Language (Mahout)

Machine Learning Batch Analysis Platform(Hadoop MapReduce)

Near Real-time Analysis(Cloustream)

Development API

Search Store(Elastic Search)

Large-Scale Structured Data Store (HBase)

Relational DataStore (RDBMS)

Real-time Analysis(Esper + In-house)

THE MOST SCALABLE BIG DATA PLATFORM ON THE PLANET: QOOBAHQoobah is a revolutionary and fully-scalable Big Data platform based on Hadoop and the Hadoop ecosystem of technologies. Combining a range of powerful open-source and in-house solutions, Qoobah is the culmination of Gruter's extensive data platform experience and can be tailored to suit a wide range of local requirements.

Indexing

FEATURES

Integrated

Data management handles control each step of the data life cycle from harvesting, storage and analysis, to distribution.

Reliable

Data replication and redundancy give robustness to data and meta data processing.

Accessible

User-friendly web UI and management console simplifies queries in distributed environments.

Affordable

High scalability and open-source components on x86 machines support low-cost builds and conserve capital.

Cutting-edge

Integrates the latest technologies into the Hadoop ecosystem ensuring optimalperformance.

Powerful

Distributed architecture facilitates maximum throughput across the system.

Flexible

Modular design enables components to be modified to suit local requirements.

Scalable

Scales to meet data flow requirements without system or service interruption.

CLOUMON (HADOOP & HADOOP ECOSYSTEM MONITORING SOLUTION)

Flume Cluster Cloumon Application Server

DBMS

Flume Manager

Zookeeper Manager

HBase Manager

Hive Manager

Hadoop Manager

Host Manager

Metrics Data Management Data

Job Workflow

Job Scheduler

Alarm Service(Mail, SMS)

Manager View(http)

Zookeeper Cluster

HBase Cluster

Hadoop Cluster

Cassandra Cluster

Flume Master

Zookeeper

HMaster

NameNode

Region Server

DataNode

CassandraCassandraCassandra

Zookeeper Zookeeper

Flume Node

FEATURES

Hadoop File System Manager

System monitoring and status management File management Multi-cluster management Automatic server registration

Hadoop MapReduce Manager

MapReduce cluster management MapReduce job monitoring Job scheduling

ZooKeeper Manager

ZooKeeper cluster management Znode management Znode ACL management Znode watcher management

Hive Management

Schema management Query workbench MapReduce task monitoring

Flume Manager

Flume cluster management Data flow management Additional Source, Sink and Decorator plug-ins

Metrics Monitoring

CPU usage Disk usage (per partition) Network in/out traffic Memory usage

HBase Manager

HBase cluster monitoring HBase data management

THE MOST USER-FRIENDLY HADOOP MANAGEMENT SOLUTION ON THE PLANET: CLOUMON TM

The powerful Hadoop open-source software stack requires careful integration, calibration and moni-toring, which is why Gruter has developed its own in-house cloud management solution, Cloumon. With a user-friendly interface and management console, Cloumon enables system administrators to optimize the Hadoop ecosystem and take control of the cloud across the full data life cycle.

www.gruter.com

www.gruter.com

FEATURESConversation Management

Integrated conversation managementdashboard enhances customer and market engagement.

Influencer Identification

Clever analytics algorithms identify important topics and voices, ensuringeffective and efficient listening.

Sentiment Analysis

Powerful sentiment algorithms convey weighted signals, enabling strategic engagement and risk management.

Languages: Korean; Japanese (under dev.); Chinese (under dev.)Media Channels: twitter; facebook; major local market blogs

Measurable Metrics

Intelligent quantitative metrics facilitate channel management, consumer eng-agement, and message dissemination.

User-friendly data visualization graphsand tools give clarity and poignancy.

SEENAL (SOCIAL MEDIA MONITORING)

THE SOCIAL MEDIA ANALYTICS SERVICE THAT BRINGS ASIAN ECONOMIC GROWTH TO YOUR DOORSTEP

SEENAL Powered by Gruter's revolutionary Big Data platform, Seenal gives you access to Asian language social data from twitter and facebook to local market blogs. With a user-friendly web interface and feature-rich reporting capabilities, Seenal is the global social analytics monitoring and engagement service you've been looking for.

ACTIVITIES

Korea National Big Data Strategy Forum Member

Korea Hadoop User Group Member

Cloudata Open-source Project Member (www.cloudata.org)

Presenter, Korea Community Day 2011

Presenter, Social Analytics Insight 2012

Presenter, KRnet 2012

CLIENTS

Samsung Yahoo! Korea

JoinsMSN SKThe Gvt. of South Korea Cheil Worldwide

Yonsei University The Hankook Ilbo GS SHOP

Yahoo! TaiwanYahoo! Hong Kong

Trusted business partners and active tech community members, Gruter is working hard to help its friends and clients seize the exciting opportunities afforded by Big Data and Asian region growth.

JOIN THE BIG DATA REVOLUTION GRUTER

www.gruter.com

China

Taiwan

Indian Ocean

Pacific Ocean

JapanSouth Korea

GRUTER, INC.5F Sehwa Office Building 889-70,Daechi-dong, Kangnam-gu,Seoul, South Korea 135-839

+82 2 508 5911+82 2 508 [email protected]://www.gruter.com

GAME-BREAKINGTECHNOLOGY

Cutting-edge platformarchitecture

The latest Hadoop ecosystem technologies

User-friendly cloudmanagement tools

TECHNOLOGY

VALUE-GENERATINGPRODUCTS

Powerful analytics and engagement tools

Native Asian language support

Social and internalnetwork analytics

PRODUCTS

THE DATA-DRIVEN COMPANY

Big Data technology and delivery excellence

Located in the tech center of Northeast Asia

The future of business intelligence technology

GRUTER

www.gruter.com

WELCOME TO THE TECH CENTER OF NORTHEAST ASIA