© Copyright 2015 Vivit Worldwide

How U.S. Government Clients are Leveraging HP

ALM Solutions in a "CLOUD"

July 30, 2015

© Copyright 2015 Vivit Worldwide

Brought to you by

Vivit Testing, Quality and Application Lifecycle

Management Special Interest Group (TQA-SIG)

Leaders: Bernard P. Szymczak Jr, Andreas Birk, Robert Linton,

Christopher J. Scharer, Damian Versaci

www.vivit-worldwide.org

© Copyright 2015 Vivit Worldwide

Hosted by

Bernard Szymczak

IT Systems Engineer Lead at

Progressive Insurance

Vivit Director and

Vivit TQA-SIG Leader

© Copyright 2015 Vivit Worldwide

Today’s Presenter

Robert L. Linton

VP ALM at CorTechs Inc

Vivit TQA SIG Leader

© Copyright 2015 Vivit Worldwide

Housekeeping

• This “LIVE” session is being recorded

• The recording will be available on BrightTALK

immediately after this session

• Q&A: Please type questions in the Questions

Box below the presentation screen

• Additional information available for you

behind the Attachment button and later on the

Vivit website

WHY

ME ?

This Hour ?

WHY are you “not” testing ?

• WHY ?

• Excuses of not Testing

• HP Solutions– Application Lifecycle Management (ALM)

• Cloud Based Hosting of HP ALM Solutions– Center of Excellence ( CoE )

• Cloud based

• Center of Excellence

• TaaS – *Testing* as a Service

• Subscription Model

• Benefits

• Hosted Service – explanation

• Summary

• Q & A

Agenda

• No Tools– Don’t own

– Don’t have access

• No Time

• No Environment– Can’t test in Dev

– Can’t test in Prod

– Don’t have a TEST environment

• No Code – None to Test or not stable enough to Test

• No Staff– Not trained

What we hear

HP Apps 12 addresses the spectrum of ALM stakeholders

HP ALM

Unified, Automated, Collaborative

Manual tester

Business analyst

Quality Assurance Developer (SAP/ORCL)

Developer (Java/.Net)

Mobile tester

Performance engineer

VP of AppsScrum Master

Functional test engineer

HP Unified Functional Testing (UFT)

HP Sprinter

HP Agile Manager HP Executive Scorecard

HP Performance Center

HP Mobile Center

70+ Developer Tool integrations

HP Requirements Management

HP Quality Center

Stakeholders use their tool of choice, while sharing resources with complete traceability for a unified ALM experience

Included with ALM

Separately Licensed

HP Business Process Testing (BPT)

HP Network Virtualization

HP Service Virtualization

HP LoadRunner

HP StormRunner Load

HP Application Lifecycle Management 12.x

Requirements Management

DevelopmentManagement

QualityManagement

Requirements Management

Requirements Definition

Agile Project Management

Defect Management

Functional Performance Security

Foundation

Traceability ReportingProcess Agnostic

(i.e. Waterfall, Agile)

Extensibility

(Open APIs)

AGILE integrations

Application Lifecycle Management 12.x

Project Planning &

Tracking

Enterprise Release Management

Secure Development

Application Lifecycle Intelligence

Service VirtualizationNew

Updated

Fortify

Mainframe

Client/Server(including packaged Apps such as SAP, Siebel, Oracle…)

Composite( Custom Applications,SOA, Cloud, Mobile )

… 1980 … 1985 … 1990 … 1995 … 2000 … 2005 … 2010 … 2015

ConstraintsComplexity

Costs

Changes in software development

Traditional Testing Tools and

Methodologies

RMI Objects

Messaging

Service

BI Tools

Busines

s Rules

File

System

ESB

Web

Interface

Content

Database

Data

Warehouse

Financials

Mainframe

Web/WAP

Interface

EJB

Virtual

Service

Routing

Service

SOAP

CRM

App

Products

Collaboration

App Portal

Help

Engine

BPMSLegacyInfrastructure

Internal

External CloudPartners

# of Interconnected Components # of Inter-dependent Teams

# of Heterogeneous Technologies

Increase Rate of Change

Change and Complexity Increasing:Composite Application Environments

Government IT Projects

Budget Schedules Staffing

Using traditional methods, government agencies cannot precisely represent real-world operating conditions in their application development and testing environments.

Procurement can be the biggest bottleneck for IT.

This can introduce risks like:

Technical problems Servers

Networks

Security vulnerabilities

Schedule delays

Budget overruns

Quality Issues

Defects in Production

Challenge for Government Agencies: - development and testing environments

Real World Government Entity’s dilemma

• Performance Testing

– Owned the software – still in the BOX

• Authorized a STUDY to calculate - plan and costs

• Came back with 6 months to one year

• Costs would be close to $ 100K before it started

• RFPs – Award

• Assign tasks to Gov. and contractors

– Then they could start Performance Testing

• Possibly, if the environment is ready…

“ Testing as a Service “ - TaaSWhat one Government Agency had to decide -

What is a Center of Excellence ( CoE )?

A logical or physical “service bureau” providing expertise across projects in a

“shared services model” to drive standardization of quality products and

processes across the enterprise.

Non-CoE Approach

Team B

Team DTeam C

CoE Approach

Applications

Expertise

InfrastructureTeam D

Team A

Team BTeam A

Team C Team D

• IaaS - Infrastructure as a Service

• PaaS - Platform as a Service

• EaaS - Email as a Service

• DaaS - Desktop as a Service

• MaaS – Monitoring as a Service

• SaaS – Software as a Service

• RaaS – Recovery as a Service

• TaaS - Testing as a Service

– Test Data management

– Functional

– Performance

– Services

– Security

– Monitoring

“ X “ as a Service

Cloud Based : TaaS –Test when you need to

Production

Infrastructure

1) Pool Lab Resources Together

(Leverage the existing capacity - CoE)

2) Implement virtual lab provisioning

2a) Catalog the VM Images

3) Bring additional teams into the

cloud to use centralized resources

Catalog Central Repository

Functional Testing

Performance Testing

Application Under Test

Service Virtualization

Volatile Utilization of Lab ResourcesVariable demand in allocating Dev and Test computing capacity

Variable consumption over time

Dev Team A, B, C…

Scalability of the Cloud

ELASTICITY of Cloud

Lab

Cap

acit

y &

Co

st

Development and Test: as a Service

20

DTaaS delivers everything you need to implement efficiency in every step of the development life cycle. Self Service Access Portal:• Enterprise-class ApCreate environments quickly and easily, with minimal

procurement activity

• Deploy in minutes and build complex environments in hours rather than weeks or months

• Manage users, access, configurations, and templates and monitor actual usage with real-time visibility

Common Operating Environment - Application Lifecycle Management tools support traditional or agile software development and Test practices for rapid deployment

• Enables standardization for access, tools, and media library

Robust Application Infrastructure Offerings:• Core range of vApps and software configurations

• Configurable and comprehensive media library of development and testing tools, COTS and open source

• Value-add services to customize VDC and ability to add to existing software offerings

CorTechs Experiences with DTaaS

• DTaaS was Deployed in a Government Private Cloud• The System was certified in November 2011

• CorTechs has 3 years of experiences in supporting DTaaS

• Assisted SI with implementing DTaaS• Defined Testing Requirement and CLINs

• Design, Build, Test HP testing solutions Provisioning Capability

• Component Briefings • Onboarding

• Scope

• Cost

• Components are Using DTaaS– Several Modernization projects

– 100s of VMs and Users currently active

– More Onboarding

Testing Tool CLINs in Cloud Portalxxxx1AA-xxx0 Quality Center Environment

xxxx1AA-xxx1 Quality Center User Licenses

xxxx1AA-xxx2 Functional Testing

xxxx1AA-xxx3 Test Data Management (1-500GB Database)

xxxx1AA-xxx4 Test Data Management (500GB+ Database)

xxxx1AA-xxx5 Performance Center - Controller

xxxx1AA-xxx6 PC - Standard Protocols (each) - 1,000 Virtual User Test

xxxx1AA-xxx7 PC - Standard Protocols (each) - 5,000 Virtual User Test

xxxx1AA-xxx8 PC - Standard Protocols (each) - 10,000 Virtual User Test

xxxx1AA-xxx9 PC - Standard Protocols (each) - 25,000 Virtual User Test

xxxx1AA-xx10 PC - Enhanced Protocols (each) - 1,000 Virtual User Test

xxxx1AA-xx11 PC - Enhanced Protocols (each) - 5,000 Virtual User Test

xxxx1AA-xx12 PC - Enhanced Protocols (each) - 10,000 Virtual User Test

xxxx1AA-xx13 PC - Enhanced Protocols (each) - 25,000 Virtual User Test

xxxx1AA-yy00 On-Demand Support - Grade 1

xxxx1AA-yy01 On-Demand Support - Grade 2

xxxx1AA-yy02 On-Demand Support - Grade 3

xxxx1AA-yy03 On-Demand Support - Grade 4

xxxx1AA-yy04 On-Demand Support - Grade 5

xxxx1AA-yy05 On-Demand Support - Grade 6

Compare - Traditional Costs vs. DTaaS

Typical- separate Costs and Effort

• TOTAL COST to Test

• Tool Admin $

• Hardware $

• OS , DB License $

• Lab Space $

• O&M $

• C&A $

• Outages $

DTaaS –

All included in ONE price

• TOTAL COST for - DTaaS

• Tool Admin - included

• Hardware - included

• OS , DB - included

• Test Lab Space - included

• O&M - included

• C&A - included

• SLAs- included

• End-to-end Test Orchestration

• Automated test lab provisioning– Application under test – accessible

– Test Tools provisioned

– Test Scenarios ( test plans, test data, test scripts, test results, defects )

• Central Repository for secure test library - Reuse

• Functional Testing

• Performance Testing

• Metering Usage – Chargeback mechanism – Pay as you Go

– Meter Virtual Machine usage

• Services– Consulting

– Mentoring

– Training

– Turnkey testing

Dev and Test as a Service

Key Features

The Defense Information Systems Agency sharing what to expect before moving to a virtualized environment and how that knowledge acts as a precursor to the cloud.

What the road to virtualization looks like and what it means for employees and stakeholders from the National Agricultural Statistics Service of the USDA.( cultural change )

The HHS Office of the Inspector General discussing reduced operating costs and physical data space when moving to virtualization.

KPMG 2014 Cloud Survey Report: "Cloud has clearly come of age. Driven by the demand for speed, flexibility, scale and anywhere access, consumers have fully embraced a cloud-enabled world."

What Government Agencies are saying

Presenting a look of -

AWS GovCloud

Hosting HP ALM

solutions

Hosted Solutions

Availability Zone (only one planned)

CorTechs, Inc. – AWS GovCloud Server Architecture Diagram

AWS security group

Amazon Machine Instance(AMI)

EC2

Oracle

Server

11.2.0.4

App Server Snapshot

Default VPC (Internal IPs)

Elastic IP (Public IP)

Red Hat Linux 64 Bit

M3.LARGE Elastic Block

Storage(EBS)

Data Volume

Instance(aka SAN)

shows as a mounted

(E:) drive in EC2

App Server OS

EBS

120Gb

AWS security group

Amazon Machine Instance(AMI)

EC2 HP

AGM

Server

App Server Snapshot

Red Hat Enterprise Linux

M3.Large

Data Volume

Instance(aka

SAN)

shows as a

mounted (E:) drive

in SQL Server OS

Elastic Block

Storage(EBS)

EBS

120Gb

AWS security group

Amazon Machine Instance(AMI)

EC2 SQL

Server

App Server Snapshot

Microsoft Windows

Server 2008 R2 Standard

M3.MEDIUM Elastic Block

Storage(EBS)

Data Volume

Instance(aka SAN)

shows as a mounted

(E:) drive in EC2

App Server OS

EBS

120Gb

AWS security group

Amazon Machine Instance(AMI)

EC2 ALM

12.2

Server

App Server Snapshot

Microsoft Windows

Server 2012 R2

M3.LARGE

Data Volume

Instance(aka

SAN)

shows as a

mounted (E:) drive

in SQL Server OS

Elastic Block

Storage(EBS)

EBS

120Gb

CorTechs, Inc. – Gov client Server Architecture Diagram

CLIENT.URL

Elastic Load

Balancing

Amazon EBS

snapshots

logs

Availability Zone #1 – RDS Multi-AZ Master

security

group

Auto Scaling group

security

group

root

volume

data

volume

EC2

instance

ALM

App

Server

RDS Oracle DB

security

groupsecurity

group

root

volume

data

volume

EC2

instance

AGM

App

Server

RDS Oracle DB

security

group

root

volume

data

volume

EC2

instance

HP Synchronizer

Auto Scaling group

Auto Scaling group

Availability Zone

#2

AZ #2 to mirror

AZ #1 but only

spun up by way

of JSON script via

Cloud Formation in case of failure

Amazon Route 53

RDS Standby

security

group

RDS Standby

security

group

CorTechs, Inc. – AWS GovCloud Environment

AWS GovCloud Login

CorTechs, Inc. – AWS GovCloud Environment

AWS GovCloud Dashboard

AWS GovCloud Dashboard

CorTechs, Inc. – AWS GovCloud Environment

AWS GovCloud EC2 Servers

CorTechs, Inc. – AWS GovCloud Environment

AWS GovCloud EC2 Elastic IP Assigned to Each EC2 Machine

CorTechs, Inc. – AWS GovCloud Environment

AWS GovCloud Security Groups to Define Inbound (and Outbound) Ports

CorTechs, Inc. – AWS GovCloud Environment

AWS GovCloud Volumes (Storage)

CorTechs, Inc. – AWS GovCloud Environment

AWS GovCloud Snapshots (Backups)

CorTechs, Inc. – AWS GovCloud Environment

ALM Application from Outside AWS Network

Cloud Based TaaS Benefits = more ROI

• Immediate Benefits:

– “Ready to Use” Implementation for HP ALM Solutions

• HP ALM

• HP Performance Center / LoadRunner / StormRunner

• HP UFT

• HP Fortify

– Test More, Test Earlier, Utilize gov resources effectively

– Elasticity and Scalability when you need it !

• Reoccurring Benefits:

– Eliminate ongoing maintenance, administration, upgrades• Same Test Resources get more testing done sooner

– Reduce cost – Hardware, Software, Resources, Setup Time

– Constant Improvement of Software deliverables• Higher Quality Business Applications

• Better Continuous Development

• Increased Stability of Applications in production

• Security – Ports

– Email integration

• Gmail

– LDAP

– Databases

• Oracle vs. SQL

• Backups

• Cost– Design VPC

– Switch from Hourly

• Test- Everything

Lessons Learned

• 700 Different OS

• More App Versions and connection options

• 2,500 Mobile Device Types

• 40% of companies report– Not enough time to Test

• 40% of Test Cases Targeted for Automation

• 52% of Testing Budgets– New Development

– Not Maintaining current applications

RESULTS = Demand for Test Solutions and Testing Expertise is on the Rise.

More organizations are moving their Applications into the cloud !

Dev and Test

As well as Production

Quality - Agile

There has never been as much Change….Quality is Being Re-defined

Cloud

Agile Composite

Responsiveness

Quality

Durability

Elasticity

Scalability

Reduced Cycle

Time

Reusability

Modularity

Modernization requires discipline

“The market is shifting as organizations seek

greater business value and agility. Agility

doesn’t mean run as fast as possible, it

requires great discipline”

Gartner Research, “Don’t let Short-Term Agile Create Long-Term Pain”

Modernization does not grant IT a “hall pass” for

quality

SUMMARY

Are you Testing enough ? B.F.O.

You gotta “WANNA”

Questions and Answers

Build the

Quality

Into your

application

© Copyright 2015 Vivit Worldwide

Thank you

www.vivit-worldwide.org

CorTechs, Inc.

13921 Park Center Road

Herndon, VA 20171

(703) 968 – 7021

rlinton@cortechs.com

© Copyright 2015 Vivit Worldwide

HP Big Data Conference 2015

• August 10-13, 2015 at Westin

Waterfront Hotel in Boston, MA

• All members can Register Now via the

unique Vivit link:

https://hpbigdata2015.wegbox.com/vivit

© Copyright 2015 Vivit Worldwide© Copyright 2015 Vivit Worldwide