voke research & skytap webinar: virtual and cloud based labs
TRANSCRIPT
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Web Premiere Market SnapshotTM Report:
Virtual and Cloud-based Labs
Theresa Lanowitz
voke Founder
2 December, 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Agenda
• Trends
• Embracing Virtual and Cloud-based Labs
• voke Research Data – Virtual and Cloud-based Labs
- The Problem
- The Solution – Virtual and Cloud-based Labs
- ROI – Virtual and Cloud-based Labs
• Net/Net
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Current Reality
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Why Are Software Failures Making Headlines?
• Economy
- Is your budget expanding, declining, or remaining flat?
• Faster, faster, faster
- Does your organization prioritize speed-to-market at the exclusion of cost and
quality?
• Old technology
- Are you up to date on the latest version of your testing platform?
- Are you using new technologies to increase your productivity?
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
๏ Embracing Virtual and Cloud-based Labs
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
Virtual and Cloud-based Labs – The creation of a virtual
instance of a physical environment to enable anyone to
access a virtual equivalent of any environment on demand at
any time without the need to wait for a physical machine set-
up or additional hardware.
Cloud and virtual labs offer the server virtualization
equivalent for the dev/test use case.
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
◉Virtual and Cloud-based Labs – Definition
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
1. Cost, quality, schedule complexity
2. Release frequency and parallel development
3. Immediate defect reproduction
4. Proliferation of mobile devices and platforms
5. Internet of things
6. Demand for quality
7. Global workforce and on-demand access
8. Budgetary constraints
9. Desire for simplicity
◉The Need for Virtual and Cloud-based Labs
Nine Market Forces and Trends
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs– August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
๏ voke Research Data –
Virtual and Cloud-based Labs
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Survey Methodology
• Conducted by voke from March – June 2014
• Interviews on-line and in-person (over 500 participants)
• Survey participation is anonymous
• Responses are confidential
• Question types
- Multiple choice
- Check all that apply
- Open-ended
Thank you to all survey participants!
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
๏ The Problem
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
Environment – the collection of hardware and software used by
development and testing for pre-production purposes.
Environment examples include: development, QA/test, regression
test, system test, UAT, production reference, performance, pre-
production, staging, archive of current release, maintenance, etc.
◉Environment – Definition
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Waiting for Environments – Availability
63%Development
work delayed
while waiting
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
68%QA work
delayed while
waiting
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Access to Lab Environments – Scheduling
46%Required to
schedule
access to labs
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Lab Access – Wait Time
18 days
average
wait
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs– August 2014
Wait Time to Access Lab Participant PercentagesOn Demand 19%
1-3 Hours 5%
4-5 Hours 5%
1 Day 14%
2 Days 11%
3 Days 10%
1 Week 10%
2 Weeks 9%
3 Weeks 10%
1 Month 4%
2 Months to 1 Year 3%
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Lab Configuration Time – Dev and QA/Test
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs– August 2014
Development Setup Time Participant PercentagesImmediate 9%
30 minutes or less 9%
1 hour 10%
2-3 hours 8%
4-6 hours 9%
1 day 17%
2 days 8%
3 days 5%
1 week 12%
2-3 weeks 7%
1 month or more 6%
QA/Test Setup Time Participant PercentagesImmediate 4%
30 minutes or less 10%
1 hour 15%
2-3 hours 8%
4-6 hours 7%
1 day 17%
2 days 7%
3 days 7%
1 week 9%
2-3 weeks 10%
1 month or more 6%
14 days
average
setup for dev
12 days
average
setup for
QA/Test
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Lab Access – Restrictions
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
43%Lab access
restrictions14
Day average
time limit for
lab use
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉The Problem – Shrinking Lab
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs– August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Physical Labs – Average Cost
$12Million average per lab
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs– August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
๏ The Solution –
Virtual and Cloud-based Labs
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Virtual and Cloud-based Labs – Adoption
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
54%Virtual and
cloud-based
labs used more
than 2 years
Length of Use Participant PercentagesLess than 1 year 21%
Between 1 to 2 years 25%
Between 2 to 3 years 28%
Between 3 to 4 years 8%
Between 4 to 5 years 4%
More than 5 years 14%
Virtual and cloud-based labs are preferred
over generic cloud solutions for
development and test labs to gain the full
benefit of an “out of box” solution
customized to deliver full featured on-
demand access for development and test
lab use scenarios.
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Virtual and Cloud-based Labs – Use
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
62%Project and
departmental
Nature of Use Participant PercentagesPilot project 20%
Project-based 35%
Departmental 27%
Available via center of excellence (CoE) 17%
Enterprise-wide 27%
Accessible to third party offshore teams 10%
Accessible to entire software supply chain
including third party partners and suppliers 6%
44%CoE or
Enterprise-wide
16%Third-party
access
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Virtual and Cloud-based Labs – Benefits
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
Benefits of Cloud and Virtual Labs Participant PercentagesOn-demand access to environments 58%
Reduced capital expenditures (CAPEX) 53%
Reduced operational expenditures (OPEX) 46%
Consistent environments as close to production as possible for
testing with no time constraints
41%
Sufficient environments available for parallel development 40%
Eliminate defects prior to production 39%
Improved availability of maintenance environments 38%
The ability to test in an isolated environment outside of a
development or production environment
38%
Improved audits and compliance 33%
Efficient defect reproduction 31%
Improved time-to-market 31%
Less dependencies on other organizations to create and maintain a
lab environment
30%
Configuration files under version control (“ configuration as code” ) 18%
Improved relationships with other functional groups 16%
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
๏ ROI –
Virtual and Cloud-based Labs
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉ROI – Before and After Virtual and Cloud-based Labs
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
41%Provisioning time
2 weeks – 3
months
75%Provisioning
time 1 day or
less
Before Virtual and Cloud-based Labs After Virtual and Cloud-based Labs
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉ROI – Reduced Defect Reproduction Time
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉ROI – Reduced Production Defects
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉ROI – Reduced Total Defects
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉ROI – Increased Platforms Tested
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉ROI – Increased Versions Tested
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉ROI – Increased Test Coverage
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉ROI – Increased Tests Executed
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉ROI – Reduced Test Cycle Times
Source: voke Market SnapshotTM Report: Cloud and Virtual Labs – August 2014
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
๏ Net/Net
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉Net/Net
• Consequences of software failures are real
• Embrace virtual and cloud-based labs to manage cost, quality, and
schedule
• Virtual and cloud-based lab solutions deliver double digit
improvements in
- Reduced time to reproduce defects
- Reduced defects entering production
- Reduced total defects
- Increased platforms tested
- Increased versions tested
- Increased test coverage
- Increased number of tests executed
- Reduced testing cycles
• Virtual and cloud-based lab solutions offer a purpose-built dev/test
lab
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
Thank You!!!
© 2014 voke media, llc. All Rights Reserved. Reproduction and distribution are prohibited.
◉ voke Contact
voke, inc.
2248 Meridian Boulevard
Suite H
Minden, NV 89423
P: +1.866.895.9045
W: www.vokeinc.com
T: @vokeinc
© 2014 Forrester Research, Inc. Reproduction Prohibited
Full On-Demand Webinar
Click Here:
http://bit.ly/vokeresearch