demystify big data breakfast briefing - juergen urbanski, t-systems
DESCRIPTION
Hortonworks Demystify Big Data Breakfast Briefing 9th July, London slides by Juergen Urbanski, T-SystesTRANSCRIPT
Capturing Big Value in Big Dataat Deutsche TelekomJürgen UrbanskiVP Big Data Architectures & Technologies T-Systems Board Member Big Data & AnalyticsBITKOM (German IT Industry Association)
Christian WirthVP BI & Big DataT-Systems
Introducing Deutsche Telekom and T-Systems
Deutsche Telekom is Europe’s largest telecom service provider– Revenue: €58 billion– Employees: 232,342
T-Systems is the enterprise division of Deutsche Telekom – Revenue: €10 billion– Employees: 52,742– Services: data center, end user computing, networking, systems
integration, cloud and big data
2
Disruptive Innovations in Big Data
3
RelationalDatabase
HADOOPMPP
AnalyticsData
Warehouse
SchemaPre-defined, fixedRequired on write
Required on readStore first, ask questions later
ProcessingNo or limited
data processingCompute & storage co-locatedParallel scale out processing
Data typesStructured Any, including unstructured
..
Physical infrastructure
Default is enterprise gradeMission critical
Default is commodityMuch cheaper storage
Target Hadoop Use Cases
4
IT Infrastructure& Operations
Business Intelligence &
Data Warehousing
Line of Business
Potential valueHighModerate
Lower Cost Storage for Tier 3 / 4 workloads (active archive)
Enterprise Data Warehouse Offload
Enterprise Data Warehouse Archive
Telecommunications & Media Data Products Capacity Planning & Utilization Customer Profiling & Revenue Analytics Targeted Advertising Analytics Service Renewal Implementation CDR based Data Analytics Fraud Management
Other Industries Connected Car Smart Home
Cost effective storage, processing, and analysis
Foundation for profitable growth
= Highlighted today
1
2
34
N
Enterprise Data Warehouse Offload
5
The Challenge Many EDWs are at capacity Running out of budget before
running out of relevant data Older data archived “in the dark”,
not available for exploration
The Solution Hadoop for data storage and
processing: parse, cleanse, apply structure and transform
Free EDW for valuable queries Retain all data for analysis!
Operational (44%)
ETL Processing (42%)
Analytics (11%)
DATA WAREHOUSE
Storage & Processing
HADOOP
Operational (50%)
Analytics (50%)
DATA WAREHOUSE
Cost is 1/10th
1
Data Products: ImmobilienScout (a DT subsidiary)
6
The Situation Europe‘s leading real estate
marketplace with data on...– 1m properties listed currently– 20m properties cumulative– 6 million saved searches– Geographical coordinates– Enriched by socio-demographic
data on 19m properties Team
– Product Manager– Data Scientists– 2 Scrum Teams
The Solution “Market Navigator” service
– Supports realtors in acquiring customers
– Local market analysis helps with price setting for rent and buy
– Integrates third-party data Functionality includes
– Price heat maps & trending– Demand- and supply-side info– Local area information– Comparable transactions
2
Seite 7
Bild durch Klicken auf Symbol hinzufügen
Turning Big Data into Products!2
Connected Car (a T-Systems offering)
When cars go online...
Calling the repair center
Werkstatt
Read out vehicle data
On-Board signaling
Onlinecombinations
Machine data enriched withWeb data Based on
Cloud Technology
Reduced incidence ofproduct recalls
Better management
of product life cycle
Earlyerror detection
Direct online linkto dealers and the OEM
Preventative maintenancequicker repair turnaround
Usage-based feedback
for product development
40 millon new mobile contracts
Highercustomer satisfactionV
VolumeVelocityVariety
Value
3
8
Smart Home: Gigaset (a T-Systems customer)
Gigaset Elements is a sensor- and cloud-based solution
for home networks
Cutting-edge sensors are combined with each other and
linked with an Internet-capable DECT ULE base station
and a secure Web server
That permits a large number of applications in the home
notably home security and elderly assisted living
The intelligent, learning system is powered by Hadoop
At a price of less than €200 for a Starter Kit, the system
is intended to be suitable for the mass market
4
9
Which Distribution is Right for You Today and Tomorrow? 13 original Apache Hadoop projects No commercial support
Fully open source distribution (incl. management tools) Reputation for cost-effective licensing Strong developer ecosystem momentum GTM partners incl. Microsoft, Teradata, Informatica, Talend, NetApp
Widely adopted distribution Management tools and Impala not fully open source GTM partners include Oracle, HP, Dell, IBM
Appeals to some business critical use cases prior to Hadoop 2.0 GTM partner AWS (M3 and M5 versions only)
Just announced by EMC, very early stage
Open
Open & proprietary
Proprietary
10
How We Evaluate Hadoop Distributions
11
Hortonworks well positioned prior to HDP2.0
HDP 2.0 is Architected to be a Good Fit with these Enterprise Requirements
12
T-Systems Approach to Big Data ProjectsAssessment in three phases:
1 week
with 2 Senior
Consultants
€9.850
6 weeks
Hadoop as a
Service
€23.000
Maturity & Potential Evaluation Capability maturity
benchmarking Identification and
prioritization of potential vs. challenges
Deliverables: Current versus future mode gap analysis
1Proof of Concept Selection of initial use case Standup of test environment
with customer data Validation of feasibility and
potential
Deliverables: Testing of customer-specific scenario including cost-benefit analysis
2
Strategy & Roadmap Development of enterprise-
wide Big Data strategy Prioritization of road map Implementation planning
Deliverables: Business case, prioritized roadmap, implementation plan
3
13
Deutsche Telekom Perspective The Hadoop ecosystem delivers powerful innovation in storage, databases and
business intelligence, promising unprecedented price / performance compared to existing technologies
Hadoop is becoming an enterprise-wide landing zone for big data. Increasingly it is also used to transform data
We look forward to realizing cost reductions in areas such as enterprise data warehousing. More importantly, Big Data opens up new business opportunities for ourselves and our customers
In that journey we are partnering closely with
14
