Emerging trends in software development: The next generation of storageDonnie Berkholz, Ph.D.Research Director — Development, DevOps & IT Ops

SNIA Storage Developer Conference, Sept 2015

2

Technology adoption

is increasingly bottom-up

Wikipedia: G.dallorto

3

App-dev workloads are quickly moving to the cloudCurrent Future

On-Premises, Non-Cloud

Off-Premises, Non-Cloud

On-premises Private Cloud

Hosted Private Cloud

Infrastructure-as-a-Service (IaaS)/Public CloudSoftware-as-a-Service

(SaaS)

59.0%

7.9%

14.2%

5.2%

6.6%

7.1%

n = 146

37.3%

6.1%

19.1%

9.9%

15.2%

12.4%

n = 134

Source: 451 VotE Cloud, Q2 2015

4

CLOUD COMPUTINGQ1 2015

Q. Estimate the percentage of your organization’s data currently stored in off premises cloud environments? Q. How many terabytes of data does your company currently have under management across all environments?*Terabytes of Data Stored in Off-Premises Cloud" is calculated from an organization's total data and the percent they store in off-premises cloud environments.

Data Storage - Cloud Respondents

> 1000TB

750TB-1000TB

500TB-749TB

250TB-499TB

10TB-249TB

<10TB

20.0%

7.5%

7.3%

6.3%

42.8%

16.2%

Percent of Samplen =877

Percent of Organization’s Data Stored in Off-Premises Cloud

Total Data at Organization

Source: 451 Research, Voice of the Enterprise: Cloud Computing Q1 2015

> 1000TB

750TB-1000TB

500TB-749TB

250TB-499TB

10TB-249TB

<10TB

3.8%

1.4%

2.5%

3.1%

42.0%

47.1%

Percent of Samplen =766

Terabytes of Data Stored in Off-Premises Cloud *

> 80%

60%-80%

40%-59%

20%-39%

< 20%

7.8%

6.4%

6.9%

14.6%

64.3%

Percent of Sample

n =896

5

The new stack?

An infinite array of possible stacks.

6

The API economy

7

What do enterprises think of storage vendors?

Source: 451 Storage Wave 19, June 2015; n=250ç

Development trendsthat will transform storage use

8

9

Docker Docker Docker

Source: 451 Research, “Now Shipping: The Docker and containers ecosystem rapidly takes shape”

Developers loveDocker

Donnie Berkholz Source: http://www.slideshare.net/dberkholz/is-your-community-healthy-metrics-on-the-top-cm-software

10

*

But it’s not just a toy

11

21%}Source: 451 VotE Cloud, Q1 2015; n=991

Unfamiliar

No Plans

Discovery and Evaluation

Running Trials/Pilot Projects

Used for Test and Development Environment

Initial Implementation of Production Applications

Broad Implementation of Production Applications

3.1%

19.8%

56.1%

10.7%

3.9%

4.2%

2.1%

12

Docker to microservices

13

Loosely coupled teams

“ One of the biggest changes is that we no longer have an official ‘architecture’ team. Instead, we have made ‘architecture’ an ‘ingredient’ on each of our teams.”

http://tech.gilt.com/post/102628539834/making-architecture-work-in-microservice

– Lauri Apple, Gilt Groupe, 14 Nov 2014

14

The foundation of microservices

15

Disruption in data processing

16

Spark came out of nowhere

Donnie Berkholz Source: http://redmonk.com/dberkholz/2015/03/13/the-emergence-of-spark/

17

On Hacker News, too

Donnie Berkholz Source: http://redmonk.com/dberkholz/2015/03/13/the-emergence-of-spark/

18

The market is coming

Source: 451 Research Total Data: Platforms & Analytics Market Monitor, May 2015

19

Storage-class memory

20

Concurrency for developers

Donnie Berkholz Source: http://redmonk.com/dberkholz/2014/03/18/go-the-emerging-language-of-cloud-infrastructure/

Development trendsthat will transform storage vendors

21

22

What in the world is DevOps, anyhow?

23

Agile, truly tip to tail

Business to customer

24

3 pillars of DevOps

Culture

Automation

Measurement

25

Culture:Tear down all the silos

Flickr: kalandrakas

26Flickr: respresFlickr: hartvig, snapeverything, roymaloon

Automation:Pets vs Cattle

27

Automation: Infrastructure as code

28

Knight Capital and the $460 million bug

Wikipedia: Jericho

Release management – quarterly to dailyGary Gruber, HP

29

Automation: Continuous delivery

continuousautomation.com

30

Measurement: #monitoringsucks/monitoringlove

DevOps is reaching DBAs

451 DevOps study, Q3 201431

32

33

Adopting open-source technologies

Blogspot: ThatsABigIf

34

The changing role of standards

35

The changing role of benchmarks

36

Wrapping up• Docker and microservices will exacerbate hypervisor-style

use & increase demands on the network

• Spark will drive requirements for memory and memory-like storage

• DevOps & continuous delivery will transform how you deliver storage software

• The interplay between open source, standards and benchmarks continues to tilt toward agility

37

Global Digital Infrastructure Alliance — 20,000 strong

Share your thoughts, get our data451alliance.com

Storage needs to cope with agility.Donnie Berkholz@dberkholzdonnie.berkholz@451research.com

Some images from this presentation are Creative-Commons licensed.

https://creativecommons.org/licenses/by-sa/https://creativecommons.org/licenses/by/

39