everything as a service, including big data: bdaas
Post on 25-Feb-2016
46 Views
Preview:
DESCRIPTION
TRANSCRIPT
Everything as a Service, including Big Data: BDaaS
Franco-British bilateral workshop on Big Data
LondonNovember 2012
Mick SymondsPrincipal Solutions Architect, Atos MS NL,7 November 2012
2
MAS 07 November 2012Franco-British bilateral workshop on Big Data
Introducing Atos
Atos is an international information technology services company, delivering hi-tech transactional services, consulting, systems integration and managed services. Atos is focused on business technology that powers progress and helps organizations to create their firm of the future. It is the Worldwide Information Technology Partner for the Olympic Games and is quoted on the Paris Eurolist Market. Atos operates under the brands Atos, Atos Consulting & Technology Services, Atos Worldline and Atos Worldgrid.
▶ Annual revenues of € 8,6 billion (pro-forma 2010) ▶ Almost 74,000 business technologists worldwide
in 42 countries▶ Worldwide headquarters in Bezons / Paris, France▶ Atos was established on July 1st 2011, following the
successful integration of Atos Origin and Siemens IT Solutions and Services and the establishment of a global strategic partnership with Siemens AG
3
MAS 07 November 2012Franco-British bilateral workshop on Big Data
Foundation IT Services:Global Delivery to Trusted Partner
ERP Applications
Desktop
Server Management
900,000 SAP users
2,4 Million Seats45 Million calls / year
105,000 managed server instances (74,000 managed physical servers)
Data Centers
13 Global Data Centers +50 Local / Regional Data Centers
93,000 sq meters Data Center1.42 average global virtualization ratio
Hosting:▶ 40,000 MIPS▶ 41,500 terabytes storage ▶ 6000 COD/IaaS/Cloud instances
Enterprise Management Centers
Global EMC’s in Timisoara and Kuala Lumpur & 15 local EMCs with almost 700 staff
Network & Security services
40,000 switches, 6,000 routers, 12,500 WLAN access points, 327,000 voice end users, 350,000 RAS users, 31,000 unified communications end users, filtering for 146,000 email mailboxes
4
MAS 07 November 2012Franco-British bilateral workshop on Big DataPowering progress for our clients
Financial Services
Public Sector, Healthcare & Transport
Energy & Utilities
Manufacturing, Retail & Services
Telecom, Media & Technology
5
MAS 07 November 2012Franco-British bilateral workshop on Big Data
What I want to tell you about
▶ It feels strange to come and tell Researchers about “Innovation”▶ Most of our “innovation” is finding out what researchers and vendors are
reporting– we are a long way down the food chain in most respects
▶ However, we find that one man’s business-as-usual is sometimes another man’s innovation
▶ The real development in Cloud in general and Helix Nebula in particular is not really technology– it is deploying services, between suppliers, and making it work as a business
▶ In Cloud, everything is “as a Service” (XaaS)– including, potentially, Bid Data storage and management
▶ You can liberate yourselves from the tedious grind of production operations:– a. by delegating the structured deployment of rules and policies to us– b. by using us to supply point/niche capabilities– c. to provide enabling facilities for people who provide real added value
6
MAS 07 November 2012Franco-British bilateral workshop on Big Data
What is Big Data, the 3-4 traditional V’s
Source: Oracle
7
MAS 07 November 2012Franco-British bilateral workshop on Big Data
From the traditional 3-4 V’s towardsthe 5-6 V’s
Viscosity – Viscosity measures the resistance to flow in the volume of data. This resistance can come from different data sources, friction from integration flow rates, and processing required to turn the data into insight. Technologies to deal with viscosity include improved streaming, agile integration bus’, and complex event processing.Virality – Virality describes how quickly information gets dispersed across people to people (P2P) networks. Virality measures how quickly data is spread and shared to each unique node. Time is a determinant factor along with rate of spread.
Value
8
MAS 07 November 2012Franco-British bilateral workshop on Big Data
▶ Large Hadron Collider: An example of sensor and machine data is found at the Large Hadron Collider at CERN, the European Organization for Nuclear Research. CERN scientists can generate 40 terabytes of data every second during experiments.
▶ Boeing Jets: Boeing jet engines can produce 10 terabytes of operational information for every 30 minutes they turn. A four-engine jumbo jet can create 640 terabytes of data on just one Atlantic crossing; multiply that by the more than 25,000 flights flown each day, and you get an understanding of the impact that sensor and machine-produced data can make on a BI environment.
▶ Twitter: The micro blogging site Twitter serves more than 200 million users who produce more than 90 million "tweets" per day, or 800 per second. Each of these posts is approximately 200 bytes in size. On an average day, this traffic equals more than 12 gigabytes and, throughout the Twitter ecosystem, the company produces a total of eight terabytes of data per day. In comparison, the New York Stock Exchange produces about one terabyte of data per day.
▶ Wal-Mart: Transactional data has grown in velocity and volume at many companies. As recently as 2005, the largest data warehouse in the world was estimated to be 100 terabytes in size. Today, Wal-Mart, the world's largest retailer, is logging one million customer transactions per hour and feeding information into databases estimated at 2.5 petabytes in size.
▶ Financial services: Discover fraud patterns based on multi-years worth of credit card transactions and in a time scale that does not allow new patterns to accumulate significant losses. Measure transaction processing latency across many business processes by processing and correlating system log data.
▶ Internet retailers: Discover fraud patterns in Internet retailing by mining web click logs. Assess risk by product type and session Internet Protocol (IP) address activity.
▶ Retailers: Perform sentiment analysis by analysing social media data.▶ Drug discovery: Perform large-scale text analytics on publicly available information sources.▶ Healthcare: Analyse medical insurance claims data for financial analysis, fraud detection, and preferred patient treatment
plans. Analyse patient electronic health records for evaluation of patient care regimes and drug safety.▶ Mobile telecom: Discover mobile phone churn patterns based on analysis of call detail records and correlation with activity
in subscribers' networks of callers.▶ IT technical support: Perform large-scale text analytics on help desk support data and publicly available support forums to
correlate system failures with known problems.▶ Scientific research: Analyse scientific data to extract features (e.g., identify celestial objects from telescope imagery).▶ Internet travel: Improve product ranking (e.g., of hotels) by analysis of multi-years worth of web click logs.
Big Data is transforming business, as well as research
9
MAS 07 November 2012Franco-British bilateral workshop on Big Data
Long-term service trends
Shorter lifecycles
Change in ownership and business model
Consult-build-operate
Assess-compose-orchestrate
Assemble from stock
Rapid assembly and integration of services, to address customer’s
changing business needs and opportunities
Build to orderBespoke systems, tailored, put in place and dedicated to running one application
for one customer, for a number of years
10
MAS 07 November 2012Franco-British bilateral workshop on Big Data
Towards an open future …
▶ As a Tier 1 player in Cloud, Atos is becoming much more pro-active in moving developments forward – often in an open and collaborative manner with others,
who may also include our competitors▶ Examples of this include:
– the Open Data Centre Alliance: a cloud user group, defining common requirements for how cloud services are delivered to (initially) large enterprises. See: https://www.opendatacenteralliance.org
– Helix Nebula: an initiative to deliver cloud services (initially) to European-based scientific research organisations
▶ Both are cases where an initial development and deployment is expected to propagate to a much wider community, over time
▶ Another common factor between these developments is the prevalence of Open Standards and Open Source tooling, and close involvement with the research community which pioneers them– Atos have an inside track on these developments with Atos
Research and Innovation (ARI), who live in this world: see http://www.atosresearch.eu
11
MAS 07 November 2012Franco-British bilateral workshop on Big Data
▶ Addressing the issue will help avoid local (re-)inventions▶ What can we do about it?– Training– Re-deployment– Recruitment– Alliances– Acquisitions
Staffing trends and approaches with Utility and Cloud
+Increase ability to analyse customer needs (solution architecture)
+Plan capacity, manage risks+Address governance issues within
customer+Develop more flexible services+Developing and using Solutions
Templates
- Automate, e.g. using RBA - Off-shore+Monitor operational exceptions
- Further automate- Outsource to vendors
Operations
Administration
Design
12
MAS 07 November 2012Franco-British bilateral workshop on Big Data
Big Data competences and roles
▶ New rolls and skills arise:– Data Scientist– Data Virtualization Specialist– Data Stewards– Big Data Architects– Big Data Analists– ….
▶ New knowledge is necessary!
13
MAS 07 November 2012Franco-British bilateral workshop on Big Data
Atos’ services during a migration and services lifecycle
Customerto be
Service implementation and integration▶ Transition, standardisation, consolidation▶ Conversion and migration▶ Identity management▶ Service integration
▶ Infrastructure, Platform, Software as a Service
▶ Service aggregation▶ Identity, authorisation,
security monitoring▶ Contingency, recovery
Operational Cloud Services
▶ Optimize legacy useTraditional Services
Solutions architecture and planning▶ Opportunity
assessment to determine business needs
▶ TCO analysis, norms, trends, to help build a business case
▶ Establish portfolio of Cloud offerings and capabilities
▶ Solutions selection, architecture and brokerage
▶ Plateau Planning Customer
as is
9. Contract, SL
different-iation
8. Run Book
automation
4. Global
sourcing/off-
shoring
5. Physical
consolidation
6. Demand/
Supply
structures
7. Rational
consolidation
3. Logical
consolid-
ation
10. Information
lifecycle
management
11. On Demand,
Utility Computing
2. Outsourcing
1. Select
standards
14
MAS 07 November 2012Franco-British bilateral workshop on Big Data
Service component relationships
Services
What: service portfolio
Who:supplierinvolvement and integration
Processes
ToolsOrganisation
How: common techniques
Cost
sPr
ices
Environment(s) to be
managed
Inputs
Demand Supply
Business (= customers)Governanc
e
Datacentres
Directories
Workplace
Storage
Security
Networks
Servers
Database Middleware
Specificapplications
Genericapplications
Outputs
Outcomes
15
MAS 07 November 2012Franco-British bilateral workshop on Big Data
Dynamic Management of Data/Information
Tiered Storage Solutions
Storage On DemandCentral Backup
ServicesArchiving on Demand
ILM Application Integrated Solutions
Tier 2 Tier 3 Tier 4 Tier 5Tier 1
Mission critical
Business Critical
Productivityimportant
Compliant Archive
InstantAccess Archive
Tier 6
Archive and Backup to
tape
ILM service offerings:Consult - Build - Operate
Business Goals
Data/Information
TechnologyAlignment of
ILM Consultancy Services
ILM Quick Scan – ILM Assessment – ILM Business Case
16
MAS 07 November 2012Franco-British bilateral workshop on Big Data
Using IaaS as a basis for adding value
Big DataProcessing facilitiesNetwork access
PaaS:test and development facilitiesto create added value services
SaaS:use AppStore and DevPay-type facilitiesdeliver added value informationpay-per-use, with transactional charging
IaaS:from HNsuppliers
PaaS
SaaS
17
MAS 07 November 2012Franco-British bilateral workshop on Big Data
EO Application Platform
ESA UNCLASSIED - For Offical Use 05/07/2012
Data & CatalogueUser (CNR)
Cloud Controller
API
OCCI
Web Interface
Sandbox private
public
18
MAS 07 November 2012Franco-British bilateral workshop on Big Data
User
EO Application Platform at work
1. Instantiates the virtual machine and a development environment
2. Uploads his/her software and defines input data3. Adapts applications to the Cloud to exploit the
distributed computing (PaaS abstraction of the Hadoop MapReduce model)
4. Uses the available toolbox that makes easier the transition between the local development environment (local workstation) and the Cloud
5. Tests, re-test, re-re-test, …6. Transparently deploys the application and runs in
cluster mode against large archives of data!
ESA UNCLASSIED - For Offical Use 05/07/2012
For more information please contact:Mick SymondsPrincipal Solutions Architect/Loose Cannon AtosB.5.L08, Papendorpseweg 93, 3528 BJ Utrecht The Netherlandsmichael.symonds@atos.netm +31 651 755 779
19
20
MAS 07 November 2012Franco-British bilateral workshop on Big Data
More information and details…
▶ More information is documented in various White Papers– Shaping the Cloud
▶ And from the scientific community and others
▶ Cloud Orchestration– Written in summer 2010– Proof of concept created with Cordys
and Open Source▶ Augmented by: A Cloud Message Broker– Extending connectivity to whatever else
is out there▶ Downloadable from the Atos web site:
– http://atos.net/en-us/about_us/insights-and-innovation/scientific_community/scientific_community_whitepapers/default.htm
21
MAS 07 November 2012Franco-British bilateral workshop on Big Data
More on the Atos Cloud platforms…
Platform Canopy Yunano CIS Trusted Agile Infrastructure
A3C, Azure Oracle Extreme Performance Cloud
Helix Nebula Anytime Workplace
AIX
Owner-ship, control
Separate company, with VMware, EMC
JV with Yunano Atos Atos Atos with Microsoft partnership
Atos with Oracle partnership
Consortium: Atos prime role
Atos Atos, with IBM support
Location(s) Cloud hubs ? Cloud hubs and satellites
Initially Munich Initially Paris, UK, Munich
Initially Eindhoven Tbd: Europe Cloud huba and satellites
France
SaaS Yunano, Zimbra, ISV’s, via AppStore
Ufida CRM, ERP Sharepoint aaS, Anytime Files, Enterprise Project Mgmt
ISV’s - XenDesktop, XenApp, App-V, ThinApp
PaaS Java development environment, vFabric
On Canopy Web aaS, SAP FH: Middleware for SAP hosting, etc.
Development environments
Azure Oracle DB - - IBM development and middleware
IaaS VMware On Canopy VMware, Windows, Linux
VMware - Oracle Exadata/ Exalogic
Open Nebula - AIX as a Service
Hyper-visor
VMware VMware VMware Hyper-V Oracle KVM XenServer
Usages Yunano ERP/CRM, AppStore, Hosting for ISV’s, rigid stack, limited customisation
SME’s wanting best-in-class business systems as a service
Professional hosting for customer’s business-critical systems, flexible solutions and customisation
Cloud-based test and development environment
Office 365 and Azure as a service on Atos private cloud
Performance boost for Oracle-based systems
Scalable infrastructure for scientific research organisations
Hosted virtual workplaces, XenClient
Enterprises wanting to continue use of AIX in a flexible environmentCloud Services
top related