exalead & big data - sesam world - viden gennem netværk€¦ · · 2015-04-29sub-second...
TRANSCRIPT
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
1
3DS
.CO
M ©
Das
saul
t S
ystè
mes
| C
onfid
entia
l In
form
atio
n | 2
/24/
2013
| r
ef.:
3D
S_D
ocum
ent_
2012
Exalead & Big Data
It‟s All About Usage!
Lars Nordengren Dassault Systemes / Exalead
Bo M. Andersen IdéPro / Exalead
VALUE
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
2
1
What is „Big Data‟? 2
Where‟s the Value? 3
What‟s Search Got to Do With It? 4
Exalead Big Data Case Studies 5
Dassault Systèmes & Exalead
On the menu
6 Why Exalead CloudView?
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
3
1
What is „Big Data‟? 2
Where‟s the Value? 3
What‟s Search Got to Do With It? 4
Exalead Big Data Case Studies 5
Dassault Systèmes & Exalead
On the menu
6 Why Exalead CloudView?
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
4
About Dassault Systèmes
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
5
3DEXPERIENCE Platform
Social/Collaborative
ENOVIA, 3DSWYM
Information Intelligence
EXALEAD, NETVIBES 3D Modeling
CATIA, GEOVIA,
SOLIDWORKS
Content & Simulation
3DVIA, DELMIA, SIMULIA
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
6
EXALEAD delivers
Big Data discovery applications that
accelerate innovation
EXALEAD‟s Mission
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
7
Search as an end user
application
Every employee must be able to
access relevant data
Search is the data access
infrastructure, content
distribution platform,
innovation driver and main
differentiator of web
businesses
Web -driven innovation allows
powerful new Search-based
applications combining
structured & unstructured data
EXALEAD
Founded in 2000 by Search Pioneers, HQ: Paris
Clients: + 350, Staff: 180, 41% in R&D
Uniquely engineered for dual Web/Enterprise use
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
8
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
9
1
What is ‘Big Data’? 2
Where‟s the Value? 3
What‟s Search Got to Do With It? 4
Exalead Big Data Case Studies 5
Dassault Systèmes & Exalead
On the menu
6 Why Exalead CloudView?
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
10
Is it new?
Really large data collections have been around a long time, as have:
Grid computing
Super computers
High-end datawarehouses
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
11
+40%
year
1 petabyte/
15 sec.
What is new? Rate of increase!
2015
8 zettabytes 8 trillion GBs
1 PB/sec
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
12
1
What is „Big Data‟? 2
Where’s the Value? 3
What‟s Search Got to Do With It? 4
Exalead Big Data Case Studies 5
Dassault Systèmes & Exalead
On the menu
6 Why Exalead CloudView?
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
13
Value is in Usage
Big Data Value Proposition
Use new & evolving technologies to drive innovation & productivity
by revealing the hidden information intelligence in data that is
voluminous, variable or fast-moving to exploit with conventional technology
Like Cloud before it, heavy hype, but fundamental shift
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
14
1
What is „Big Data‟? 2
Where‟s the Value? 3
What’s Search Got to Do With It? 4
Exalead Big Data Case Studies 5
Dassault Systèmes & Exalead
On the menu
6 Why Exalead CloudView?
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
15
Search-Based Applications Business applications built on a search infrastructure rather than RDBMS
COLLECT (Exalead Connectivity)
TRANSFORM (Semantic Factory)
MANAGE (CloudView Index)
INTERACT (Mash-Up Builder)
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
16
Where does search fit in Big Data world?
? ?
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
17
Search is Pivotal Driving force behind Big Data
2008 Seminal «Big Data Study Computing Group»
Top Scientists from Industry, Academia & Government
“Advances in sensor, networking, computing, and storage technologies have made it possible to
collect and store very large (beyond one terabyte) data sets capturing scientific, medical, business,
and worldwide web information.…How can the capability for computing over large data sets be
provided in a way that is cost effective, reliable, and generally usable? Toward this end, we draw
inspiration from the computing systems that have been developed at search engine companies...”
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
18
Search is Pivotal Driving force behind Big Data
What inspired «Big Data Study Computing Group»?
• Scaleable, distributed architecture w/commodity hardware
• Flexible data model
• Pivotal technologies: machine learning, auto-classification & clustering, text mining,
sentiment analysis, inverted indexing, pattern recognition, relationship-mapping, natural
language processing, data fusion, probabilistic computing…
3DS ahead of HP, Oracle & IBM in recognizing Big Data value of search/SBA!
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
19
"What do I need to get value from Big Data?”
PhD “data scientists” Unfamiliar technologies
with funny names A multimillion-dollar
Big Data appliance
Oozie
Mahout
Flume
Pig
Jaql
Whirr
Chukwa
Hadoop
PATIENCE: 3 years, 5 years, a decade….
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
20
Big Data Value Leader: Exalead SBAs deliver Big Data value to ordinary
users in just weeks, using existing systems and staff, with an ROI in 2-6 months
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
21
Search Delivers High Value, Fast
Faceted natural language search & navigation
Data fusion (semantic aggregation)
Web mining
Sentiment analysis
Content recommendation
Multimedia access
Exploratory analytics for business users
Operational reporting & analytics
Search-based business applications!!!
Capture, Store, Process, Analyze, Use Big Data
Both complement
& alternative to
NoSQL & SQL
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
22
1
What is „Big Data‟? 2
Where‟s the Value? 3
What‟s Search Got to Do With It? 4
Exalead Big Data Case Studies 5
Dassault Systèmes & Exalead
On the menu
6 Why Exalead CloudView?
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
23
Machine Data: Production/Consumption Real-Time Operational Reporting
Smart meters – consumer meters for a utility Wind power production regulation – equipment readings
Smart meters (manage production, consumption)
Logistics (detect/react exceptions, optimize flows)
eCommerce (recommendation engines)
GPS (location-based marketing)
Healthcare (ICU/ home monitoring)
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
24
Structured Enterprise Content Full-text, semantic search; SQL-free global reporting and analytics
Gefco: track & trace for millions of vehicles
Real-time, consolidated reporting
Non-specialist DB access
Asset sharing and re-use
Research (QoS, compliance, etc.)
Hypermarket: exploratory analytics on fusion of cash
register receipts (Teradata DW) & loyalty program data
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
25
Data Aggregation/Fusion Integration of structured, unstructured, Web content
• Database enrichment
• 360-degree views
• Micro-segmentation
• Content recommendation
Large pharma: 360° decision intelligence – SAP, 2 CRM,
Lotus, Twitter & other social media
Voyages-SNCF: Real-time mash-up databases,
Web UGC, editorial content, maps, etc.
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
26
Data Aggregation/Fusion Agile Customer Service for 217 Million Subscribers
360° View of All Relevant Customer Service Info One stop access to all relevant sources:
CRM
Provisioning
Network monitoring
Contracts
Interventions
Easy monitoring of KPIs and service delivery
Sub-second responsiveness and zero-training usage
Business Advantages Increased revenue: higher customer satisfaction,
reduced customer churn
Reduced costs: Less training, higher productivity,
shorter calls, reduced staff churn
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
27
Data Fusion: Exalead ii for Frontlines Usability: Simple interface & interaction, unified data access
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
28
Dashboards
transactional &
machine data
Map-based
navigation
Web-style natural
language search
Mashup RDBMS, Machine, Unstructured
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
29
Global KPIs
Dashboards
call log data
Mashup RDBMS, Machine, Unstructured
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
30
Operational Business Intelligence for Letter Mail Processing
Machine Data for Logistics
Mail sorting equipment
(apps, machines, platforms)
OCR & video-coding equipment
Datawarehouses/biz apps for
high-level data ontology
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
31
Capture: 60 million letters, 300 million events daily (3500 events/second avg)
Process: 9TB index against 90TB of raw data (1.6 PB annually)
Store: Sliding 3 weeks data (6-7 billion events); images one week
Access: Natural language, full-text, faceted search
Analyze: Dashboards w/ad hoc drilling
Innovate: New services
Real-time operational business intelligence
Machine Data for Logistics
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
32
Machine Data for Logistics “Impossible to do with any other technology”
Existing data
In-house talent plus limited consulting
8 commodity servers 1 connectors
2 Push API
4 Index
1 Search API
Proof of concept iterations: Nov „10-May „11
Prod. dev: Summer 2011
Go live: December 2011
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
33
Web Mining Market Intelligence – quantitative analytics from unstructured content
Real-time & historic real estate market analytics from online ads– Akerys
Real-time dashboards
Trend detection
Historical analysis
Location-based analysis
Resell markets
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
34
Multimedia - Video Search/explore/analyze the content INSIDE video
• Law enforcement
• Government
• Media
• Education
• Preservation
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
35
Multimedia - Images Content-Based Image Recognition (CBIR)
• Point-and-know
• Research
• Sales
• Travel & Entertainment
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
36
1
What is „Big Data‟? 2
Where‟s the Value? 3
What‟s Search Got to Do With It? 4
Exalead Big Data Case Studies 5
Dassault Systèmes & Exalead
On the menu
6 Why Exalead CloudView?
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
37
Performance Extreme performance & massive linear scaling (at a low hardware cost!)
Universal data connectivity with low latency indexing
Secure enforcement of rights at infrastructure level
Agility Non-intrusive to deploy and operate
Semantic factory & Mash-up Builder for easy data fusion & rapid app development
Multitude of Big Data uses in one platform
Usability Zero-training usage for information retrieval or analytics
Mature, packaged product accessible to existing staff
Rapid deployment – app in weeks, POC in days
Exalead Big Data Advantages
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
38
Takeaway
For any user to search, navigate & analyze Big Data―whether direct
from original Big Data sources or from specialized Big Data systems
For IT to rapidly deploy process-driven business applications enriched
with information intelligence from Big Data
For 10 years, Exalead has offered a safe, secure, easy and cost-effective way:
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
39
Proof of Concept Success Criteria
POC • Proof of Concept
• Exalead drives the
POC
• Extract of data
• Limited Scenarios
• Proof point – not
production
Functional Workshop
Technical
Session
Value Proposal
Sharing Experience
Presentation
Restitution
Business Development Proof of Concept
POC Definition
Define priorities
Agreement
Value Proposal Customer
Adoption
Value proposal
Solution Proposal
User Interface
Indexation
Knowledge Transfer / Training
Data Collection
5-15 Days 1-2 Weeks 1 Month 1-2 Weeks
Scenarios (3-4)
Business Meeting
Functional Workshop
3DS
.CO
M/E
XA
LE
AD
© D
assa
ult
Sys
tèm
es |
Con
fiden
tial
Info
rmat
ion
| 2/2
4/20
13 |
ref
.: 3
DS
_Doc
umen
t_2
012
40
More info: SBA book, Big Data guide, Website (Solutions)
+
Lars Nordengren +46 736 20 5832
Bo M. Andersen +45 2944 7195