big data’s surprising reach · – spss – internal ibm technologies from open source like...
TRANSCRIPT
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Big Data’s Surprising
Reach
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
What I Will Cover
• The Environment • The Spectrum • Options • Vendor Snapshots • Observations
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Email: [email protected] Voice:+1 502 777 2890
New studies “The New Landscape of Open Source Search, IDC, July 2012
“Adding Value to Corporate Libraries and Information Services” January 2012
“Next-Generation Corporate Libraries and Information Services” October 2009
Additional information at
www.arnoldit.com/sitemap.html
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
The Environment
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Data Management Tools Distributed
Parallel Processing
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Vendors Offer Three Options
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
On Premises: Control
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Hybrid
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Spectrum
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
The Four Big Data Vendor Sectors 1
• Major Enterprise Vendors – EMC – HP – IBM – Oracle – SAP (Hana)
• Emerging Enterprise Vendors – Amazon – Connotate (Fetch) – Google (Recorded Future) – Palantir
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
The Four Big Data Vendor Sectors 2
• Big Data Vendors from Intelligence Sector to Verticals – Agilex – Digital Reasoning – Jack Be
• Early Stage Innovators – Cybertap – Kaggle – Quid
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
IBM
• Acquiring companies to dominate the enterprise market – Cognos – i2 Group – SPSS – Internal IBM technologies from open source like Hadoop to
proprietary inovations like DB2, Power7 servers, IBM XIV Gen 3
• Selling – Solutions / consulting – Hardware – Engineering services
• “No one gets fired for buying IBM.”
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
IBM Storage: Very Key Technology
http://www-03.ibm.com/systems/storage/news/announcement/big-data-20110712.html
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Recorded Future
• Top person is Christian Ahlberg, who developed SpotFire and sold that visualization technology to TIBCO
• Recorded Future has funding from In-Q-Tel and Google
• System processes via open source and proprietary technology: – Large flows – Real-time – Unstructured and semi-structured content – Displays “what you need to know”
• Important because it is a precursor of what Google is likely to implement
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Recorded Future Output
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Agilex
• Agiliex was founded in 2007 • Technology VP is Roger Bradford
– Content Analyst technology – SAIC’s data analysis system – Supports open source data management systems and uses
proprietary technology
• Intelligence-agency centric system which has migrated to perform: – Financial analyses – Fraud detection – “Person of importance” identification
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Agilex: Profitable and Growing
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Quid: Start Up in a Vertical
• Start up: “make sense of the world around them so they can make truly informed decisions.”
• Headquarters in San Francisco • $10 million in funding from high-profile venture firms
from U.S., Korea, Singapore, the U.K, and Switzerland • Solutions based on open source and proprietary
technology: – Mobile – Medical – Finance
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Quid Web Presence
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.
Observations • Consolidation • Lack of Differentiation • Theory Falls Short
– Practical Implementation Preferred
• Price competition evident: – Open source price pressures – IT Budget Constraints – Lower Cost Alternatives Available
• Volume of Customer Data – Social Content – Commercial Systems – AND....
Confidential Document. © Stephen E. Arnold, 2013. No Reproduction or Reuse without Prior Written Permission.