CLOUD COMPUTING

CORNERSTONE OF CONVERGING TECHNOLOGIES

LEEN BLOM

May, 2014

ABOUT ME

Leen Blom

Manager Research & Development at Centric

Background in software development, database management, application design, head software development, architect, R&D manager

Consultant, Manager consultancy, R&D manager

Now member of team Enterprise Innovation

Member of Contact Group Universities, guest lecturer at Rotterdam University of applied sciences

STRUCTURE OF THIS LECTURE

Converging technologies What is Cloud

The basics Public cloud providers State of art Legacy applications and Cloud

Cloud and converging technologies Internet-of-Things Big Data Mobile

Discussion

CONVERGING TECHNOLOGIES

WHAT ARE CONVERGING TECHNOLOGIES?

IDC: vision on IT 3rd Platform" for IT growth and innovation, built on Mobile devices, Cloud services, Social

technologies and Big Data

Gartner: vision on businesses Nexus of Forces mobile, social, cloud and information

Science: second stage Convergence of knowledge and technology for the benefit of society (CKTS)

NBIC convergence is connecting emerging technologies based on their shared elemental components such as atoms, DNA, bits, and synapses (all with shared abstractions from information science), integrated across scales

See: Converging of Knowledge, Technology and Society: Beyond Convergence of Nano-Bio-Info-Cognitive Technologies (July 2013, Mihail C. Roco et al)

Wikipedia Nanotechnology, Biotechnology, Information technology and Cognitive science (see

Emerging technologies#Acronyms)

WHAT ARE CONVERGING TECHNOLOGIES?

For this lecture we will look into the relevance for Internet of Things

How will centralized Cloud match distributed IoT?

Big Data Cloud is big, so Big Data matches Cloud?

Mobile Apps for the enterprise: do they need Cloud or just Cloud principles?

CLOUD: THE BASICS

CLOUD COMPUTING BY NIST

Service Models

source: http://www.nist.gov/itl/cloud/index.cfm

CLOUD SERVICE MODELS

source: https://www.e-education.psu.edu/cloudGIS/cloud_introduction

Capex

Opex

CHARACTERISTICS OF CLOUD

On-demand self-service A consumer can unilaterally provision computing capabilities without requiring human

interaction with each service provider. Broad network access

Capabilities are available over the network and accessed through standard mechanisms

Resource pooling The providers computing resources are pooled to serve multiple consumers Customer generally has no control or knowledge over the exact location of the

provided resources Rapid elasticity

Capabilities can be elastically provisioned and released, in some cases automatically, often appear to be unlimited and can be appropriated in any quantity at any time.

Measured service Cloud systems automatically control and optimize resource use by leveraging a

metering

See also: http://arxiv.org/pdf/0901.0131

CLOUD PROMISE: ELASTICITY

PURE CLOUD IS PUBLIC

Google, Amazon, Microsoft and others like Rackspace

Randy Bias, Cloudscaling.com

PUBLIC, COMMUNITY, PRIVATE OR HYBRID

Public cloud Cloud services are provided in a virtualized environment, constructed using pooled shared

physical resources, and accessible over a public network such as the internet

Private cloud (including on-premises with Cloud-principes) Is a particular model of cloud computing that involves a distinct and secure cloud based

environment in which only the specified client can operate

Community cloud Is a collaborative effort in which infrastructure is shared between several organizations from a

specific community with common concerns (security, compliance, jurisdiction, etc.), whether managed internally or by a third-party and hosted internally or externally

Hybrid cloud Is an integrated cloud service utilizing both private and public clouds to perform distinct

functions within the same organization.

CLOUD: PRIVACY AND SECURITY

What is more secure: Private Cloud or Public Cloud? Private

Pro: easier to isolate Con: need to keep knowledge up-to-date

Public Pro: may expect top security measures Con: dependent on provider

What would respect privacy more: Private Cloud or Public Cloud? Private

Pro: no intrusion of people outside Con: need to keep knowledge up-to-date

Public Pro: easier to uniform policies Con: conflicting laws and jurisdiction in some cases

more than 77 million accounts affected, 12 million had unencrypted credit card

numbers

National security electronic surveillance program operated by the United States

National Security Agency (NSA) since 2007

WHY DO ENTERPRISES NEED CLOUD?

Is it just like outsourcing? Using data center services?

How can businesses benefit from Cloud? What do we do with legacy software?

Some Cloud characteristics can be fulfilled in outsourcing scenario Sharing resources means lower costs But is contradicting to customization and unique selling points

CLOUD VERSUS CLOUD PRINCIPLES

Can we benefit from Cloud advantages without Cloud? Answer is: Yes, by adopting Cloud principles

Characteristic Cloud Cloud principle

On-demand self-service Indispensible to be costeffective

Possible and preferrable, by providingusers a provisioning portal

Broad network access Indispensible In your own hands

Resource pooling Indispensible to be costeffective

Possible and preferrable, by virtualisation

Rapid elasticity Mandatory to fullfil Cloud promise

Depending on business, f.i. seasonalfluctuations

Measured service Mandatory for billing Not mandatory, internal charging

CLOUD REQUIREMENTS FOR ENTERPRISES

Pure Cloud Public Cloud

Outsourced Hybrid Public Cloud + Outsourced Private Cloud

Private Hybrid Outsourced Private Cloud + On Premises Private Cloud

Mixed Cloud On Premises Private Cloud + Own data center

Note On Premises Private Cloud = using Cloud principles! Own data center = traditional system management

CLOUD REQUIREMENTS FOR ENTERPRISESpure cloud

outsourced hybridprivate hybdrid

mixed cloudprivatly owned

Requirement Public cloud Outsourced Private cloud On premise Private cloud Own data center

On-demand self-service Must Wise Wise Depends

Broad network access Must Must LAN LAN

Resource pooling Must Wise Difficult Difficult

Rapid elasticity Must Must Not possible Not possbile

Measured service Must Depends Internal charging Internal charging

Security Ultimate Ultimate Depends Depends

Privacy Depends on jurisdiction Depends on jurisdiction Local jurisdiction Local jurisdiction

Availability Depends SLA Own hands Own hands

Freedom of choice More Lock-in Lock-in Less Lock-in Less Lock-in

NIS

T

WHAT ABOUT CLOUD ADOPTION?

Research by Everest Group, March 2013 See: Enterprise Cloud Adoption Survey 2013: Summary of

Results

CLOUD VERSUS INTERNAL DATA CENTER

84% thinks Cloud will reducedependence from internal

data center provisioning over

the next 3 years Issues currently with vendor

management, floor space,

cross-vendor incompatibility

CLOUD GROWTH

Source: Keala Consultancy, februari 2014

CLOUD LOCK-IN

IaaS: moving towards standardisation OpenStack, open source cloud infrastructure components Support from HP, Cisco, Red Hat, Canonical (Ubuntu) and VMware. Infrastructure components accessible via OpenStack API

PaaS: lock-in inevitable Development: SalesForce One, Google Apps Engine, Microsoft

Azure: all proprietary Deployment: Windows stack, LAMP: you are on your own

SaaS: complicated Data structures cause lock-in Need regular and readable backup on premises

From my Blog (Dutch) 'Nummerbehoud in de cloud' http://t.co/NgdCI1sfmv

CLOUD:

PUBLIC CLOUD PROVIDERS

PUBLIC CLOUD PROVIDERS COMPARED

Research in progress

The Big Three Google Cloud Platform

Started with PaaS and added IaaS in 2012 Amazon Web Services

Started with IaaS and added some PaaS services Microsoft Azure

Started with PaaS and added IaaS in 2012

Not easy: not all concepts are equal But we are seeing closer convergence

COMPUTE COMPAREDCloud characteristic Amazon Web Services Google Cloud Platform Microsoft Azure

Virtual Servers Amazon EC2 instances (general purpose) Compute Engine Compute

Virtual Images Amazon Machine Image (all OS-es) Standard Images (mostly Linux) Windows Server and Linux

Hypervisor Xen KVM Hyper-V

Distribution of images AWS Marketplace Public images Marketplace

Application Development Specific images with development tools App Engine Visual Studio Online, SDK's

Programming languages No limits Java, Python, PhP, Go .Net, Java, Python, PHP, Ruby, Node.js

Specific applications Micro-instances: low cost Web Sites: automatic scaling

GPU-instances Mobile Services: authentication, push

Memory-optimized Cloud Services: reliable API provisioning

Storage-optimized StorSimple

High Performance Computing

Enhanced Networking: SR-OIV Open Source Grid Engine Windows HPC pack (MPI)

Cluster-networking: MPI standard

STORAGE COMPAREDCloud characteristic Amazon Web Services Google Cloud Platform Microsoft Azure

Standard service Amazon Elastic Blockstore Cloud Storage Block blobs

Organization of data Block blobs Blobs, access RESTful API Simple structure, RESTful API

Persistent storage (f.i. files) Standard volumes (EBS) buckets and objects Page Blobs and Disks in VHD format

Optimized for IO Provisioned IOPS volumes n/a n/a

Relational SQLAmazon Relational Database Service

(RDS)Cloud SQL Azure SQL Server

Database typeMySQL, PostgreSQL, SQL Server or

OracleMySQL SQL Server (and Oracle RDBMS)

Non-Relational NoSQL Cloud Datastore NoSQL, Azure Tables

NoSQL-typesDynamoDB, EMR (Hadoop),

marketplaceunknown MongoDB, CouchDB, etc

Big Data Amazon SimpleDB Hadoop, Hive, Pig, BigQuery Azure HDInsight, Hadoop

ACID Eventually consistent, Consistent Eventually consistent, Consistent Eventually consistent

Public datasets Public Datasets Program BigQuery

SERVICES COMPARED

Cloud characteristic Amazon Web Services Google Cloud Platform Microsoft Azure

DirectoryAWS Identity and Access Management

(IAM)GITKit for OpenID, Google Apps Directory

SyncAzure Active Directory

DNS Dynamic DNS Service Cloud DNSWindows Azure-provided name

resolution

Virtual Private Cloud Amazon VPC, VPN Integrated in Google Compute Engine Site-to-site VPN, ExpressRoute

Load balancer Needs Amazon support AutomaticallyAzure Load Balancer, Traffic Manager,

CDN

Regions US, EU, ASIA and regional locations US, EU, ASIA and regional locations US, EU, ASIA and regional locations

Management AWS Management Console Cloud Deployment Manager Azure Management Portal

Billing Per hour Per minute, minimum 10 minutes Per minute

Messaging Amazon Simple Queue Service Task Queues Azure Queues

Service Bus Service Bus Queues, BizTalk Services

Notification Amazon Simple Notification Service Google Cloud Messaging Notification Hub

Scheduling Scheduled Tasks Scheduler

Workflow Amazon Simple Workflow

Development Visual Studion Online

CLOUD WORKSPACE OR DAAS

Price Per user per month

Lower prices mean Unmanaged No backups No end user

support Office functionality

only

Global playersstandard services only Has its value!

Amazon stillmissing

Characteristics Centric

Online desktop

Managed

Local jurisdiction

Rapid elasticity

Adaptive: legacy application exposure

Adaptive: integration other SaaS and Cloud services

Adaptive: Customizable

Private Cloud

Self service

Unified communications

Two factor authentication

VPN

Back-up data and e-mail

End user support

Price (indicative> 50-75,- 75-100,-

MORE RESEARCH ON CLOUD PROVIDERS

What is the impact of PaaS on Independent Software Vendors?

What is the impact of OpenId or OAuth on Identity & Access Management in a Hybrid Cloud scenario?

How to avoid vendor lock-in in a SaaS scenario?

CLOUD: STATE OF ART

CLOUD TODAY

Moving to hybrid cloud Many reasons

Focus from IaaS to PaaS IaaS: modern outsourcing of data center services PaaS: modern outsourcing of deployment and development

services

New authentication methods Like Fast Identity Online (FIDO)

HYBRID CLOUD: IAAS

At this moment associated to IaaS combined with on premises data center

HYBRID IAAS CLOUD: 5 REASONS

Ad hoc fluctuation because of unexpected success Increase capacity instantly

Real-time analysis combined with data warehouse in the cloud If in-house equipment produces high volumes of data

Isolating mobile app traffic from data center To prevent high bandwidth access to own premises

Data center virtualization Business continuity

Moving into the cloud step-by-step To prevent big bang, taking time to learn Taking personnel turnover into account

Source (my blog in Dutch): http://www.centric.eu/NL/Default/Themas/Blogs/2014/01/24/Nummerbehoud-in-de-cloud

HYBRID CLOUD: SAAS

Where is my data being stored? Privacy

Which jurisdiction? Geopolitics?

Security Corporate espionage

Performance Latency?

Analytics Where do I consolidate? Local or in the cloud?

Integration?

FOCUS ON PAAS

Not on PaaS providers A lot of people want to say PaaS is DOA dead on arrival,

Tim Crawford of Avoa

PaaS is lock in by definition (IMHO)

Deployment Automation: as an accelerator for DevOps Standardisation: to provide Development and Test environments

Development Online and offline development tools, deploying on standardized

platforms or Cloud

Productive and efficient application development and maintenance

PAAS GROWTH

See green bars Top

Database management systems Second best

Application Infrastructure & Middleware

Application Development

Note growth of Management (f.i. no. 4, yellow) Needed for DevOps

PAAS MARKET FORECAST

65% of PaaS Support development But are not development

environments by itself

BPM services More SaaS than PaaS

NEW AUTHENTICATION METHODS

Multi-factor authentication Like Google: username/password followed by text message May add more than 2 factors

Biometric security Face recognition Fingerprints Iris scan

If MFA becomes more secure It will be trusted by Cloud providers De facto solution for Single Sign On

Source: http://alexbilbie.com/2013/02/a-guide-to-oauth-2-grants/

NEW AUTHENTICATION METHODS

FIDO Alliance To develop a standards-based open approach that automatically

detects when a FIDO-enabled device is present and offers users the option to replace passwords with more secure authentication techniques such as biometrics

FIDO protocols are based on public key cryptography and are strongly resistant to phishing Universal Authentication Framework Universal 2nd Factor protocol (by Google)

Samsung and PayPal recently announced adoption Competitive projects: Google Authenticator

Includes implementations of one-time passcode generators for several mobile platforms, as well as a pluggable authentication module (PAM).

Source: http://fidoalliance.org/specifications

FIDO: ALL ABOUT STANDARDS

FIDO Registration FIDO Login

CLOUD: WHAT ABOUT LEGACY?

LEGACY

How many apps did you install on your smartphone? How many apps do you really use? In NL smartphones average user has 28 apps installed

How many applications do companies use? Harris Interactive (2012)

Surveyed 150 senior IT decision-makers from organizations with $500 million or more in annual revenue.

50%: more than 500 applications deployed (34%: more than 1,000 applications deployed).

57% of users use fewer than 249 applications on a typical day 28% of users use fewer than 50 apps a day.

Software is main inhibitor for moving to the Cloud! Software vendors and in-house development

LEGACY AND THE CLOUD

How do we deal with this? The Centric-case

Infrastructure-as-a-Service in place Adaptive Infrastructure Services Standardisation on infrastructure Fail-over, scalable, managed services

Platforms almost in place Standardisation on deployment architecture Isolation of customer data Security measures

Software in transition Web-enabled Multi-tenant

ADAPTIVE INFRASTRUCTURE SERVICES

AIS scope Shared Processing Power Shared Storage System Managent services

IT Stack

Storage

Networking

Business-

Apps &

Customer

Content

Users & desktop configurations

File S

erv

ices

Deplo

ym

ent

Serv

ices

Publishin

g S

erv

ices

E-m

ail s

erv

ices

Print

Serv

ices

Virtualization

PaaS

ontwikkel-platform

Computing

Adaptive Infrastructure Services

PLATFORM STANDARDISATION

Example choices by Centric

Linux Red Hat Linux 6, HP UX 11iv3, AIX 7, Oracle L6

Microsoft .Net 4.0/4.5 SQL Server 2008 R2 IIS 7.5 Windows Server 2008 R2 Windows 7/8.1 Terminal Server 2008 R2

Oracle Database Appliance X4-2 Forms & Reports 11.1.2.1.0 WLS 10.3.6

ON-PREMISES LEGACY TO THE CLOUD

From a Providers perspective!

What characteristics do applications lack when not built for the cloud?

Applications have to be made accessible on Internet Web-based Security policies

Applications should support more tenants Multi-tenancy is more than just adding metadata

APPLICATIONS FOR WEB

Techopedia.com Any program that is accessed over a network connection using HTTP, Web-based applications often run inside a Web browser.

There is a lot of confusion created by the use of terms like Web-based, Internet-based and cloud-based Web-based applications actually encompass all the applications that communicate

with the user via HTTP.

Centric has several Oracle Forms applications via Java-applet Within definition, but not ideal because deployment needs Java runtime

Newer applications accessible via http.

MULTI-TENANCY

Research with Utrecht University Faculty of Computer Science Sharing is caring

Definition Multi-tenancy is a property of a system

where multiple varying customers and their end-users share the system's services, applications, databases, or hardware resources, with the aim of lowering costs.

Infrastructure not in scope, IaaSassumed

Scope

Download report: http://www.cs.uu.nl/research/techreps/repo/CS-2013/2013-015.pdf

12 MULTI-TENANT ARCHITECTURES

MTAS

At Centric Variability (customization)

Less multitenancy

Maintainability of software More multitenancy

Software Complexity Less multitenancy

Deployment Time More multitenancy

Matter of optimizing No extremes

Less More

MAKING APPLICATIONS MULTI-TENANT

What can be shared? What can be modified to

enable sharing? New non-functional

requirements!

Which interfaces are single-tenant?

Some governmental externalservices are single-tenant! Due to security constraints

Our PaaS should support allMTAs Adaptive Application Platform

Landelijke voorzieningVSV

Oracle database

Oracle WebLogic serverKey2Jongerenmonitor schema

Key2Berichtenmodule schema

MWF client schema

MWF server schema

Oracle Forms services

Applicatie server

E-Diensten

Koppelvlak verlof & vrijstelling

Koppelvlak aanvraag vervoer

Conductor

Statusupdates koppelvlakken

UBM StUF client

Module workflow webservices

VSV Client

MWF client service

GWS koppelvlak

UBM StUF webservice

UBM GBA-V client

Key2Datadistributie

GWS4all

MDU

Cognos

Applicaties (lokaal of gehost)

SQL*Net ADO.Net

SOAP of HTTP

Netwerkshare

Printerverbinding

Applicatie architectuur Key2Jongerenmonitor

GebruikerKey2Jongerenmonitor

Dient meerdere keren geinstalleerd worden

Kan eenmaal geinstalleerd worden

Kan hergebruikt worden door x organisatiesAuteur: Arjan van BartVersie 1.1 (21-06-2013)

Afhankelijkheid met ander schema

Apps

Jongerenmonitor App

WebAPI (Perimeter Service Routing)

Koppelvlak App(WCF)

Key2GBA-VGeneriekBevragingsComponent

GBA-V

ADAPTIVE APPLICATION PLATFORM

Starting points Share to cut cost Guarantee Isolation Secure access Integration with on-

premises

Calculations showedcost of specific-per application-ratio: 10:1

Tenant Isolation

Share everything

Per application sharing

Tenant specific

RESEARCH TOPICS

Legacy Application Modelling to find the most suitable MTAs

Legacy Application Modelling for right sizing deployment architecture To answer the question: why should I go into the Cloud?

Customization vs standardisation: how to combine OperationalExcellence and Customer Intimicy (Treacy & Wiersma)

Cloud computing, especially PAAS (similar to Google App Engine) In cooperation with Prof. Butincu, Technical University of Iasi

PART 2: CORNERSTONE?

CLOUD AND IOT

INTERNET OF THINGS

Sundmaeker H. Guillemin P. Friess P. and Woelffle S. (2010). (Vision and Challenges for realising the Internet of Things)

in the nineteenth century, machines learned to do; in the twentieth century, they learned to think; and in the twenty-first century, they are learning to perceive they actually

sense and respond.

Some figures OECD (2012)

50 billion devices connected to mobile networks at the end of this decade

Rafi Haladjian (2009) number of objects to be connected to the Internet arises to 100,000 billion

Source: http://www.actif-europe.eu/index.php?option=com_docman&task=doc_details&gid=20&Itemid=68

IOT: PARADIGMA SHIFT

IT people are used to centrally managed systems Like how armies were organized before the 2nd Gulf War

But what IoT needs is a Network Centric approach Based on doctrines from Network Centric Warfare

Interoperability in a Network Centric approach Ad hoc coalitions of systems

Temporary, not predetermined Interoperability of information

Is more than technically connected! Purposeful

Combination is more than just the sum

NETWORK CENTRIC APPROACH

Demand driven

One way

Top down

One world fits all

Passive

Massive information /

information overload

Information driven

Autonomy

Bottom up

Best of all worlds

Active

Just enough / just

in time

NetworkTraditional

EXAMPLES DEVELOPED BY CENTRIC

Network Centric by design (IMHO) Compact systems

Often small extension to existing systems Multiple application of systems

Subscriptions on data instead of integration: API world In control of your process without being the owner of the systems

No big data warehouses: access data directly from the source One truth

No difference between administration and facts Real-time information

Decisions on most recent information System of systems: Ultra large systems

EXAMPLE: SMART CONNECTED CONTAINERS

Actual status of shipload not available real-time Dangerous goods only, other goods 48 hours

In an emergancy situation information needed instantly Our concept for container transport

Freight Containers Mobile HUBs Permanent HUBs

Authority

Business

Very short distance

RFID (Optional)

Short distance

wireless

Medium/long distance

wireless

Any place

Internet

Authorities and

Businesses

Standards to be developed

Lading information

Security

Extensibility

Standards to be developed

Information

Security / certification

Extensibility

Local storage

Standards to be developed

Information

Security / certification

Extensibility

Protocol for addressing/

routing/locating

Local caching

Decoupling wirelessand wired

Decoupling private data and public data

EXAMPLE: SMART CONNECTED CONTAINERS

Network of Containers (atomic)

Passive component

Ships Mobile hub Active transmitter already available

Radar stations Permanent hub Connection to the cloud already in place

Solution Low cost, decentralized, open Situational awareness of emergency response within minutes

EXAMPLE: EMERGENCY RESPONSE

Proposal FP7, Security Research Call 6, SEC-2013.5.3-1

Definition of interoperability specifications for information and meta-data exchange amongst sensors and control systems

Enabling interoperability of sensor and control systems by context sharing on a technical level to enable context awareness for key stakeholders in the civil security field.

Development of an architecture for sensors and control systems like cameras for ad hoc participation in an emergency situation making them accessible for mandated stakeholders like authorities or emergency

responders Based on the Interoperability Framework of Van Lier (2009)

to achieve a sound basis for context awareness and situational awareness to all parties involved in civil security.

EXAMPLE: EMERGENCY RESPONSE

CLOUD AND IOT

Cloud is a cornerstone for IoT? Yes

Clearly the size of IoT demands for cloud services Cloud is everywhere and of low cost, it is flexible for data collection,

opprtunities to create overview and form new combinations Ultra large systems need large backend systems

To be solved Cloud is centralized, IoT is decentralized

Cloud federation (competition is inhibitor), no one-size-fits-all (Geo)Location of objects is important

But even IPv^6 doesnt include location in addressing scheme

RESEARCH TOPICS

Context and situational awereness

Connecting humans in near distance by using wearables Ad hoc collaboration without knowing each other

Swarm intelligence (agents, boids, ants etc). In cooperation with Prof. Butincu, Technical University of Iasi

CLOUD AND BIG DATA

BIG DATA

Looks like a no-brainer!

Cloud = Big so Big Data needs Cloud?

Internet-of-Thingsproduces huge volumes

of data* so Big Data is

part of IoT, so Big Data

needs Cloud? *aka exhaust data

WHAT IS BIG DATA ANYWAY

Data whose size forces us to look beyond the tried-and-true methods that are prevalent at that time. Adam Jacobs (ACM, 2009)

The next frontier for innovation, competition, and productivity McKinsey, 2011

Big data is any data too overwhelming to mine for insight with naive methods. Daniel Hardman, Adaptive Computing, March 2014

Big Data is a new term primarily used to describe the data sets that are so large and complex that they require advanced and unique storage, management, analysis and visualization technologies Chen et al., 2012, Georgia Fotaki, 2013

BIG DATA VS TRADITIONAL DATA

Source: Exploring Big Data opportunities for Online Customer Segmentation, Georgia Fotaki

THE VALUE OF BIG DATA FOR BUSINESSES

Creating transparency Making data available cross-department

Enabling experimentation to discover needs, expose variability, and improve performance Root cause analysis of variability

Segmenting populations to customize actions Real-time microsegmentation

Replacing/supporting human decision making with automated algorithms Not necessarily be automated but augmented

Innovating new business models, products, and services Context awareness, location and time independent

Source: McKinsey 2011 http://www.mckinsey.com/insights/business_technology/big_data_the_next_frontier_for_innovation

BIG DATA MARKET FORECAST

Wikibon Big Data-related services

revenue made up 40% of the total market, followed by hardware at 38% and software at 22% in 2013

Less software revenue due to open source frameworks like Hadoop

Distribution will not change significantly

Source: http://wikibon.org/wiki/v/Big_Data_Vendor_Revenue_and_Market_Forecast_2013-2017

BIG DATA PRODUCT TYPES

Main Hadoop software NoSQL database software Next-generation data warehouses/analytic database software and related hardware and services

Other Non-Hadoop Big Data platforms In-memory databases Data integration and data quality platforms, tools and services Advanced analytics and data science platforms, tools and services

Application of Big Data Application development platforms, tools and services Business intelligence and data visualization platforms, tools and services Analytic and transactional applications and services

Cloud Cloud-based Big Data services

Other Big Data support, training, and professional services.

WHAT IS HOT IN BIG DATA?

Come back of SQL? Facebook Presto, Amazon RedShift, Stinger, IBM BigSQL, Clouderas Impala Hadoop 2.0,

replaces the MapReduce code in Hadoop with YARN (Yet Another Resource Negotiator) Brings Hadoop to the Enterprises

Learning from visualizations Well known: Infographics Startup: Visualisation based on cortex of the human eye

Maximizes pattern recognition

Topological data analysis Focuses on the shape of complex data To identify clusters and any statistical significance that is present

Predicting the future Descriptive analytics: what happened in the past? Predictive analytics: what is probably going to happen in the future? Prescriptive analytics: recommendation for key decisions based on future outcomes

what will happen and when it will happen, but also why it will happen

BIG DATA AND CLOUD

Cloud is a cornerstone for Big Data? Yes

Big 3 support for Hadoop on bare-metal or low cost commodity Support for multi-terabyte volumes of data Fluctuating volumes need cloud scalability and flexibility

To be solved Enterprises struggle with Business Intelligence and Big Data will

not solve this. Comeback of SQL will help. "A fool with a tool is still a fool"--words of wisdom in IT

Knowledge of new frameworks not wide-spread

RESEARCH TOPICS

Sentiment analysis on social networks (twitter feeds, facebookfeeds etc.) In cooperation with Prof. Butincu, Technical University of Iasi

CLOUD AND MOBILE

MOBILE

We need to narrow the scope Mobile applications for the enterprise Mobile application development for enterprises

Mobile applications On smartphones, tablets, wearables Any functionality in relation to business processes No consumer apps

Mobile application development Different from normal application development? Do we need cross platform development?

MOBILE APP DEVELOPMENT PARADIGM

Do not move applications simply to smartphone or tablet Mobile working is different from behind the desktop work User interaction is different from mouse/keyboard

Responsive is the buzzword today, new: behavioural design Requirements for mobile

Context aware, like location aware Future mobile apps: forget the screen

No typing, moderate typing, just hitting buttons Start a business process, or complete it, no other tasks

Business apps: Low volumes of users Do not use app stores unless large volumes or app used by

anonymous users BYOD may require cross platform development

Which can be expensive

CROSS PLATFORM DEVELOPMENT

Which is better: native, web app or hybrid? Despite html5 progress most development is

native, although this will change in future Native

Full capabilities, best performance My opinion: best for smartphone, smaller granular

tasks (click-and-go) Web app

Cross platform Sensor access needs wrapping (hybrid) allways up-to-date My opinion: good for tablets, complex tasks

And we have a iOS, Android vs Windows Phone dilemma

API ECONOMY

Definition is informal The economy where companies expose their (internal) business assets or

services in the form of (Web) APIs to third parties with the goal of unlocking additional business value through the creation of new asset classes.

Also related to Big Data!

According to Steven Willmott, CEO of 3scale 77% of top-50 free and top-50 paid apps connect to backend services of

some kind 23% are completely standalone

Entering the API world Not the Cloud Management APIs like OpenStack But f.i. Google: Cloud Backend API on App Engine

Source: http://www.cutter.com/content-and-analysis/resource-centers/agile-project-management/sample-our-research/apmu1306/apmu1306.pdf

API TECHNOLOGY

Web API is described as A set of Hypertext Transfer

Protocol (HTTP) request messages, along with a definition of the structure of response messages, which is usually in an Extensible Markup Language (XML) or JavaScript Object Notation (JSON) format.

Dominant API protocol appears to be REST, while the most common data formats are XML and JSON

Source: http://www.3scale.net/wp-content/uploads/2013/10/Winning-in-the-API-Economy-eBook-3scale.pdf

API STRATEGY

Architectural approach Providing self-service, one-to-many, reusable interfaces. Every software system may one day be addressed by multiple

different, as-yet-unknown groups for unknown purposes Sounds familiair? Internet-of-Things and Interoperability! APIs

Restructure and organize internal systems to support innovative new projects in a uniform mannerreducing maintenance costs and increasing agility.

They provide new opportunities to generate new ways to reach customers, generate revenue and build partnerships.

APIS AND MOBILE

Yesterdays Enterprise Mobile applications for specific platforms Separate code base and ad-hoc server back end.

The API Driven Enterprise A single backend API, addressable from clients on any platform and a

succession of different front-end clients.

Mobile and cloud are pushing increasing amounts of economic transactions from HTML web over to API-driven interactions B2B supplier relationships replacing human web-based flows Multi-channel plays in retail, many interface points feeding a single

transaction process

CLOUD AND MOBILE

Cloud is a cornerstone for Mobile? Yes

As internal systems open up via APIs served by Cloud providers Isolation of internal domain from internet accessible data

To be solved Most enterprises dont have millions of app users

Generic apps too limited for in house developed back end systems Back end systems need APIs

SUMMARY

SUMMARY

Cloud for enterprises IaaS is here to stay PaaS is evolving into standardized development and deployment SaaS lagging due to legacy applications

Cloud lock-in avoidable IaaS by follwing open standards and open frameworks PaaS no way SaaS data is inhibitor

SUMMARY

Cloud and converged technology Internet-of-Things

Yes, due to its scale, but inherent distributed

Big Data Yes, fluctuating data sets suit Cloud scalability and flexibility But: difficult to find real use cases

Mobile Yes, following the API Economy But, real benefits if enterprises provide API access

THANK YOU!

ANY QUESTIONS?

Leen Blom

+31-653562767

leen.blom@centric.eu