testops in the cloud
Post on 15-Jul-2015
305 Views
Preview:
TRANSCRIPT
@jonathon_wright
#esconfs www.eurostarconferences.com
TestOps in the Cloud
BetterTestOps
27th April 2015
jonathon.wright@hitachiconsulting.com
TestOps in the Galaxy
Jonathon Wright, Director, Testing, Quality, Assurance
1
2
@jonathon_wright
#esconfs www.eurostarconferences.com
Hitachi - a Digital Enterprise Company.Society Changes, Hitachi Transforms It.
$93.4
Billion947Companies
320,000+Employees
$3.4
Billion
Hitachi ranks 78th on the 2014 FORTUNE Global 500®.
© Hitachi Europe Ltd. 2014. All rights reserved.
3
@jonathon_wright
#esconfs www.eurostarconferences.com
Mission Objectives
TestOps in the Galaxy
I. What is BiModal? and how is FluidIT going to affect CoreIT?
II. How to move away from Testing as a Function to Testing as an Activity?
III. What is Solution Delivery Lifecycle integration (SDLCi)
IV.Introduction to Model Based Design (MBD)
V. Introduction to Model Driven Delivery integration (MDDi)
VI.Distributed Engineering Agile Delivery (DEAD)
VII.The Force Awakens (TestOps)
Episode
Episode
Episode
Episode
Episode
Episode
Episode
5
@jonathon_wright
#esconfs www.eurostarconferences.com
Hitachi – Digital Business in Europe
Information & Telecommunication Solutions Distribution Solutions
Railway Solutions Smart Cities
Service Opportunities
IT Service, Data Centre Solutions, Consulting
System Solutions
Large-scale systems, Highly reliable systems
Finger Vein Authentication
Worlds FastestElevator (40mph)
Hardware, Software
Rolling stock + maintenance
Electrical components
Signaling / Train control systems
Nuclear Power Business
Mining Equipment
Platforms
Smart eco cities
Big Data Infrastructure
Energy Consumption
@jonathon_wright
#esconfs
Water & Natural Resources
Floating train 500kmph
6
@jonathon_wright
#esconfs www.eurostarconferences.com
What is BiModal? and how is FluidIT going to affect CoreIT?
6
@jonathon_wright
#esconfs
“the creation of new business designs
that connect people, business and things
(physical objects that are active players
and contribute to business value)
to drive revenue and efficiency. ”Gartner ® 2014
Episode I
7
@jonathon_wright
#esconfs www.eurostarconferences.com
Digital Enterprise - BiModal
How is FluidIT going to affect CoreIT?
Fluid IT• Agile and fluid
• Innovation, brand,
profit measures
• Think continuous
• Think days, weeks
Core IT• Reliable,
compliant, secure
• Think price/performance
• Plan and approvals driven
• Long life-cycles
Episode I
8
@jonathon_wright
#esconfs www.eurostarconferences.com
Digital Enterprise is not about “disrupters”
6
@jonathon_wright
#esconfs
Episode I
9
@jonathon_wright
#esconfs www.eurostarconferences.com
Digital Business Transformation
Testing in the Digital Transformation Age
Core IT Fluid IT
Digital Transformation
Assisting Clients(Journey to value?)
Episode I
“Bet on technical insight,
not market research.”
*Jonathan Rosenberg & Eric Schmidt, 2014, ‘How Google Works’, ISBN: 9781455582341, 23rd September 2014
10
@jonathon_wright
#esconfs www.eurostarconferences.com
How to move away from Testing as a Function to Testing as an Activity?
10
@jonathon_wright
#esconfs
“How we bring Digital Enterprise to life”Gartner ® 2014
Episode II
Digital Transformation
*All Original Content ‘The Force Awakens” (Trailer B) ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 23rd April, 2015
11
@jonathon_wright
#esconfs www.eurostarconferences.com
Testing as a Function
Legacy 1.0 Methodologies
Software Development Lifecycle
Hardware Analysis
Testing
Process
MethodologyBusiness
Software Development Lifecycle (SDLC) Model
Episode II
12
@jonathon_wright
#esconfs www.eurostarconferences.com
Testing industry is changing forever
Intel© XDK IoT in 2015
Does ‘Testing as a Function’ still have a future?
Episode II
13
@jonathon_wright
#esconfs www.eurostarconferences.com
Testing as a Activity
Future Methodologies
Solution Delivery Lifecycle
Application
Portfolio
Business
IntegrationEnterprise
Management
* Testing as a Service Models – Discussion Paper, TestingAsAService.com or https://leanpub.com/taas
Solution Delivery Lifecycle integration (SDLCi) Model
Episode II
14
@jonathon_wright
#esconfs www.eurostarconferences.com
What is Solution Delivery Lifecycle integration (SDLCi)
14 Episode III
*All Original Content ‘Star Wars: Rogue One” ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 16th December, 2016
Internet of Everything
15
@jonathon_wright
#esconfs www.eurostarconferences.com
SMART (Sensors, Making machines, Augmentation, Robotics, Thinking machines)
Global challenge not suitable ‘Agile’ silos (not small a)
Complex eco-
infrastructures
intelligent
machine-to-
machine inter-
connections
empowered by
‘Big Data’
* http://www.libelium.com/libelium-smart-world-infographic-smart-cities-internet-of-things/
Episode III
16
@jonathon_wright
#esconfs www.eurostarconferences.com
Lean = Open
Open (Digital) Innovation results in Open (Digital) Businesses
Open Digital Platforms
Lean Testing
Enterprise
Practices
BlueprintsSmart
Episode III
“Sharing intellectual property such as software code or research
rules, adhering to open standards rather than creating your own,
and giving customers the freedom to easily exit your platform”
@jonathon_wright
#esconfs *Jonathan Rosenberg & Eric Schmidt, 2014, ‘How Google Works’, ISBN: 9781455582341, 23rd September 2014
Open Digital Enterprises
17
@jonathon_wright
#esconfs www.eurostarconferences.com
Open Innovation 1.0 - Real World Example
SDLCi - Grid-Tools connected intelligence to PerfectoMobile
Business
Solution Discovery
Business
Solution Delivery
@jonathon_wright
#esconfs
Episode III
*Llyr Wyn Jones, ‘End-to-end vs. interface testing: the mathematics’, 31st March 2015
18
@jonathon_wright
#esconfs www.eurostarconferences.com
Connected Intelligence - Real World Example
Support for business intelligence powered by ‘small data’
✔
Hitachi Content Platform Solution
During deployment of
the Hitachi Content
Platform Solution
70TB of satellite
information was
ingested into the
solution platform with
a daily growth rate of
50GB/day.
Business
Intelligence
Platforms
Business
Intelligence
Infrastructure
* http://www.hds.com/assets/pdf/hitachi-storage-solutions-at-work-nasa.pdf
Episode III
19
@jonathon_wright
#esconfs www.eurostarconferences.com*Jonathon Wright, 2011, ‘Testing as a Service’ presented at BCS SIGIST, London, 5th December 2011
Solution Delivery Lifecycle Integration (SDLCi)
TestOps – Gone in Sixty Seconds
Testing as a Service - Models
Portfolio Lifecycle Management
Business Lifecycle Management
Solution Lifecycle ManagementBusiness Delivery Management
AdviceProblem
Business
Solution Discovery
Business
Solution DeliveryContinuous Delivery Continuous Deploymentvs.
Service Layer (Lean)
Episode III
20
@jonathon_wright
#esconfs www.eurostarconferences.com
Introduction to Model Based Design (MBD)
20 Episode IV
@jonathon_wright
#esconfs
Business
Solution Discovery
Business
Solution Delivery
*Jonathon Wright, 2014, ‘Testing as Service’ Models’ discussion paper published, 26th October 2014
‘Testing as a Service’ Models
21
@jonathon_wright
#esconfs www.eurostarconferences.com
New Model for Testing*
Model Based Testing (MBT)
*Paul Gerrard, 2014, ‘New Model for Testing’ discussion paper published, 6th August 2014
New Model for Testing
Episode IV
22
@jonathon_wright
#esconfs www.eurostarconferences.com*Jonathon Wright, 2014, ‘Testing as Service’ models’ discussion paper published, 26th October 2014
Testing as a Service - Models
@jonathon_wright
#esconfsTesting as a Service - models
https://leanpub.com/taas
Episode IV
23
@jonathon_wright
#esconfs www.eurostarconferences.com
Introduction to Model Based Design (MBD)
Testing as a Service - Models
Blueprint(s) Pattern(s) Recipe(s)
@jonathon_wright
#esconfs www.eurostarconferences.com* Test Automation Patterns, testautomationpatterns.wikispaces.com & testing-store.com
Episode IV
24
@jonathon_wright
#esconfs www.eurostarconferences.com
Model Based Design (MBD) – Blueprint(s)
Testing as a Service - Models
We used drawing (visual 2D art)
to represent the foundation
of basic blueprints
GEN 1
GEN 1k
“Truly wonderful, the mind of a child is.”
This demonstrates that models created from
a single entity (transcendence) only represent
ontology of the domain of discourse and
exclude the quantitative intelligence of others.
“No matter their experience, masters can still
learn from their apprentices.“
“That’s No Moon!”
In Digital Enterprise
= Business on a Page
Enterprise Collaboration is the Evolution
(not revolution) of detailed expert Blueprints
Episode IV
25
@jonathon_wright
#esconfs www.eurostarconferences.com
Model Based Design (MBD) – Blueprint(s) – Real World Example
SAFe™ 4.0
An example
Blueprint(s) could
be any process
template that
defines the
high level
flows
“The best aspects
of these proven
test approaches
demonstrate how
they have evolved
over the past
decade, and this
echoes some of
the changes
towards more lean
and agile business
methodologies.
They are in a
constant state of
evolution – just as
the underpinning
technology evolves
over time.”
Episode IV
26
@jonathon_wright
#esconfs www.eurostarconferences.com
Model Based Design (MBD) – Pattern(s)
Testing as a Service - Models
Death Star Interior / Inner Chasm & Corridors
Collaboration of individual applies unique
patterns that will refine, predict and
inform the model through exploration
(enquiring and challenging) each other
Quantum Multifractality
Applying constructive patterns
from two or more point sources
(interference) to render multi-
dimensional (3D) models
GEN 2k
GEN 1080Each iteration can increase the
representation of the model by
applying and interpreting data
Episode IV
27
@jonathon_wright
#esconfs www.eurostarconferences.com
Model Based Design (MBD) – Pattern(s) – Real World Example
Test Infrastructure as a Service (TIaaS.net) – TestOps 1.0 (VM Role Dispenser)
* Test Automation as a Service – Architecture, TAaaS.net or TestOps.net
“The best aspects
of these proven
test approaches
demonstrate how
they have evolved
over the past
decade, and this
echoes some of
the changes
towards more lean
and agile business
methodologies.
They are in a
constant state of
evolution – just as
the underpinning
technology evolves
over time.”
“Over the last five
years we have been
developing a azure
cloud based solution to
provide true
Test Automaton as a
Service using the
hybrid approach
specifically designed
with the Hybrid Cloud
(Private/Public) in
mind to utilise the
instant scalability,
flexibility and
availability of the
Cloud.”
Episode IV
28
@jonathon_wright
#esconfs www.eurostarconferences.com
Model Based Design (MBD) – Recipe(s)
Testing as a Service - Models
Early recipes date back to
1600BC, IFTTT recipes
(conditional statements) =
DestroyDeathStar1.0I. All wings report in
II. Lock S-foils in attack position
III. Switch deflectors ON
IV. Keep visual scanning
V. Start attack run
VI. Move into position
VII. Stay in attack formation
VIII. Stay on target
IX. Use the FORCE
GEN 4k
• Channels are the basic
building blocks
• Triggers are the "this" part
of a recipe
• Actions are the “that” part
of the recipe
• Recipes are the
“equations” made from
Triggers and Actions
• Ingredients are the basic
data model, node, quantum
materials (dot) particles
or even atom(s)
Enterprise Gamification
represents the success criteria
e.g.
“Great shot kid that
was one in a million.”
Episode IV
29
@jonathon_wright
#esconfs www.eurostarconferences.com
Model Based Design (MBD) – Recipe(s) – Real World Example
Test Automation as a Service (TAaaS.net) – TestOps 1.0 (>5 Years)
Select the Business Process Tests Generated Recipe
“The best aspects
of these proven
test approaches
demonstrate how
they have evolved
over the past
decade, and this
echoes some of
the changes
towards more lean
and agile business
methodologies.
They are in a
constant state of
evolution – just as
the underpinning
technology evolves
over time.”
“Based on
business process
modelling to
create business
level keywords
written in natural
language
validated against
content sensitive
validation to
create reusable,
jigsaw pieces
representing the
Solution Under
Test (SUT).”
Episode IV
Test Automation as a Service
* Jonathon Wright, 2010, STARWest Track, ”Test Automation as a Service”, http://www.TaaS.net, 2nd October 2012
@jonathon_wright
#esconfs
30
@jonathon_wright
#esconfs www.eurostarconferences.com
Distributed Enterprise Agile Lifecycle (DEAL) Collaboration in the Wild
Model Based Design (MBD) – TestOps - Blueprints > Patterns > Recipes
@jonathon_wright
#esconfs
Team - Confederacy of Independent Systems
Enterprise Architect - Wilhuff Tarkin
Sprint 1 - Top-secret Imperial weapons project
Sprint 2 – Raids on Vergesso and Raltiir
Sprint 3 – Technical Data from Tantive IV
Sprint 4 – Battle of Toprawa
Sprint 5 – Raid on Polis Massa
Sprint 6 – Moff Kalast and the Bothan Spynet
Colla
bora
tion
“The Death Star
blueprints are
not in the main
computer”
- Stormtrooper
Blueprint – Death Star
Data Storage – R2-D2
Sprint 7 – Delivery blueprints to Bail Organa
Sprint 8 – Delivery blueprints to Jan Dodonna
CIBD - Release Management – General Jan Dodonna Showcases “Thermal Exhaust Port”
Pattern – Featuring Fleet of 22 X-wing, 8 Y-wing, 2 R-22 Spearhead Starfighters Defect – Found by Skywalker
* Release notes: Death Star, http://starwars.wikia.com/wiki/Death_Star_plans
Deliv
ery
Pattern
sR
ecip
es
Recipe - DestoryDeathStar1.0 - Continuous, Integration, Build and Delivery
Define
Design
Develop
(Plan)
Deploy
Deliver
Episode IV
31
@jonathon_wright
#esconfs www.eurostarconferences.com
Introduction to Model Driven Delivery integration (MDDi)
Agile Engineering
Core IT Fluid IT
Agile Engineering
Episode V
* Adam Mann, Google Innovation Officer, ‘Creating the inter-planetary Internet protocol’, Wired.com, 6th May 2013
Open Innovation
32
@jonathon_wright
#esconfs www.eurostarconferences.com
Introduction to Model Driven Delivery (MDDi) - Mission(s) / Charter(s)
Test First Delivery (TFD) First Day Delivery (FDDi)
TDD
* Jonathon Wright, 2014, Gartner, http://www.slideshare.net/mobile/Jonathon_Wright/addi-ha-apiytestinghybridcloud
Domain Driven Design (DDD) Domain Driven Delivery (DDDi)
Transcendence Driven Delivery (TDDi)
Test First Delivery (TFD)
Episode V
33
@jonathon_wright
#esconfs www.eurostarconferences.com
Mission / Charter – First Day Delivery (FDDi)
Model Driven Delivery (MDDi) integration
*The Advanced Research Projects Agency Network (ARPA) Network, 1969, 2 & 4 Nodes the precursor to the Internet
Business Process Modelling
Blueprint
Business Process Scenarios
Patterns
Business Process Components
RecipesNode Maps Node Learning Node Strengthening
• Model the proposed solution • Learning (Turing machine)
adapting to simulate logic
algorithms
• Validate all possible states
Smart Learning Machines
Episode V
34
@jonathon_wright
#esconfs www.eurostarconferences.com
Mission / Charter – Transcendence Driven Delivery (TDDi)
Model Driven Delivery (MDDi) integration
Business Process Scenarios
Patterns Node (View)
• Each Node creation (LOC)
passes requirement, story,
behaviour, acceptance test
• Each Node generates a
testable view (UI, Service,
or Data layer) of the solution
• Models Nodes and Links
Business Process Components
Recipes NodeJS (Controller)
Business Process Modelling
Blueprint Node (Model)
* Visual Studio 2015 CP6 & NodeJS, https://www.visualstudio.com/en-us/news/vs2015-vs.asp http://nodejstools.codeplex.com/
Episode V
35
@jonathon_wright
#esconfs www.eurostarconferences.com
Mission / Charter – Domain Driven Delivery (DDDi)
Model Driven Delivery (MDDi) integration
Business Process Modelling
Blueprint
Business Process Scenarios
Patterns
Business Process Components
RecipesNode Discovery Node ValidationNode Systems
• Model the current solution • Validate all possible states
@jonathon_wright
#esconfs
• Apply:• Systems Dynamics
(epistemic & systemic
entropy)
• Systems Thinking
• Learn:• Ontology – formal naming,
definition of node types,
properties and
interrelationships
• Domain – universal set of
nodes (domain of discourse)
• Context – nouns/verb
discovery to enable context
sensitive validation.
* Huw Price, 2015, Grid-Tools, http://www.agile-designer.com/resources/model-based-testing-using-agile-designer/
Episode V
36
@jonathon_wright
#esconfs www.eurostarconferences.com
Model Driven Delivery (MDDi) integration
Advanced Modelling Simulation Technologies
Watershed management
Pipe-network Management
Prediction of water pollution
Pipe-network analysis
© Hitachi Europe Ltd. 2014. All rights reserved.
Models can be analysed, visualized, and optimized
Models can provide assurance through, analysis, simulation and prediction
* http://www.computerweekly.com/news/2240233919/Societys-values-moving-from-Mono-to-Koto-says-Hitachi
Episode V
37
@jonathon_wright
#esconfs www.eurostarconferences.com
Connected Intelligence – Real World Example
First Day Delivery integration (FDDi) – Wearables - Apple iWatch
“The physical nature of wearables
technology makes it vital to testing using
real devices…. helps to mitigate
syncing/connectivity issues.”
Episode V
38
@jonathon_wright
#esconfs www.eurostarconferences.com
Distributed Engineering Agile Delivery (DEAD)
38 Episode VI
*All Original Content ‘The Force Awakens” (Trailer B) ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 23rd April, 2015
@jonathon_wright
#esconfs
Ultimately, all businesses will be
‘digitally re-mastered.’Gartner ® 2014
39
@jonathon_wright
#esconfs www.eurostarconferences.com
Enterprise Collaboration in the Crowd – Real World Example
Test Intelligence 2.0 – Global Testing Insight (UX, Exploratory & Testing in the Wild)
Request1
Run2
Test3
* Real Crowd Tester, Liam Warrilow, 24th Friday 2015 @15:13 (Ramp up to 100 iWatch testers in under 24hrs)
Episode VI
Enterprise CrowdTesting
40
@jonathon_wright
#esconfs www.eurostarconferences.com
Agile 1.0 Legacy
Legacy Methodologies
Agile Development Practices
Waterfall Engineering
Delivery
Processes
MethodologywAgile
Manifesto for Agile Software Development (1957-2001)
Software
Hardware
Business
Episode VI
41
@jonathon_wright
#esconfs www.eurostarconferences.com
Metrics Driven Delivery vs. Results Driven Delivery
Distributed Engineering Agile Delivery (DEAD)
* Scrumtroopers: AxisAgile.com.au, http://www.axisagile.com.au/resources/scrumtrooper-images/
Episode VI
Open Enterprise Collaboration
42
@jonathon_wright
#esconfs www.eurostarconferences.com
The Agile Legacy – Agile Strikes Back
Agile DAD(MoM)
SAFe(Committee)
LeSS(Anarchy)
Rey SoloPrincess Leia Organa SoloQueen Padmé AmidalaEmperor Palpatine
Role – Supreme Leader
Alignment - Empire
Goals – Rule the galaxy
Role – Galactic Senate
Alignment - Republic
Goals – Peace
Role – Senator Alderaan
Alignment – Rebellion
Goals – Freedom
Role – Jakku Citizen
Alignment – Rogue
Goals – Anarchy
*All Original Content ‘Star Wars: Episode 1 to 7” ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 25th May, 1977
Episode VI
43
@jonathon_wright
#esconfs www.eurostarconferences.com
Agile is DEAD
Agile 2.0 models (LeSS SAFe than DAD)
Distributed Enterprise Agile
Application
Organisation-wide
Engineering
AnarchyBusiness
Waterfall
Distributed Enterprise Agile Lifecycle (DEAL)
Delivery
Management
Lifecycle
Episode VI
44
@jonathon_wright
#esconfs www.eurostarconferences.com
Enterprise Collaboration CrowdTesting in the Wild
Han Solo (Anarchy) vs. Jedi (Agile) Order
Han Solo - Iteration VI Han Solo - Iteration VII
Follow your own path– “What the galaxy needs is one language, one system of
measurement.”
Look after yourself– “Look, I ain't in this for your revolution, & I'm not in it for you.”
Do what you think is right– “Hokey religions (Agile) and ancient weapons (Scrumban) is no
substitute for a (Waterfall) blaster.”
Forget the Results or Metric Driven Delivery– “Never tell me the odds.”
Become part of the team– “The biggest problem in the universe is no one helps each other!”
Evolution not revolution– “There has been an awaking, have you felt it?”
Teamwork equals success– “Try not. do… or do not. There is no try.”
Never underestimate the value of individuals– “Sometimes it is the people no one imagines anything of who do the
things that no one can image?”
– “Wars not make one great!”
@jonathon_wright
#esconfs
Episode VI
45
@jonathon_wright
#esconfs www.eurostarconferences.com
Agile Engineering – Real World Example
The Force Awakens
* Proton beams are back, 5th April 2015, http://home.web.cern.ch/about/updates/2015/04/proton-beams-are-back-lhc
2 Year Iterations = 6.5 to 13 TeV per beam
2 Week Iterations = 50 to 25 nanoseconds
Episode VI
Agile Engineering Practices
46
@jonathon_wright
#esconfs www.eurostarconferences.com
The Force Awakens (TestOps)
38 Episode VII
*All Original Content ‘The Force Awakens” (Trailer A) ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 28th November, 2014
@jonathon_wright
#esconfsThe dark side (DevOps) and the light (TestOps)
“DevOps is a framework that
allows development, testing,
and operations to meet
customer needs. This
integrated team approach
facilitates communication,
collaboration, and integration
to manage today’s rapidly
changing business
demands.”
47
@jonathon_wright
#esconfs www.eurostarconferences.com
The Force Awakens - Test-Ops in the Cloud
• Automate solution delivery release times and ramp up release velocity
– Infrastructure as code (topology-base model(s) - HP Codar/Release Management)
• Automate build to Cloud 2.0 (platform / technology agnostic solution delivery)
– Infrastructure to code (automation (build) model(s) – Chef)
• Automate deploy to reduced failure rates, lead times between fixes and rates of recovery
– Platform as code (deployment model(s) - HP DevOps Insight/Jenkins/IDE)
• Monitor release in the wild
– (release model(s) – HP AppPulse / Operational Insights)
• Report on Portfolio Lifecycle Management (PLM) with support for Enterprise Gamification
– Build(s) / release(s) / Quality index scores (reporting model(s) - HP Executive Scorecard/PPM)
• Collaborate with enterprise grade communication (between Dev, Test & Ops)
– Connected lifecycle intelligence (synchronisation model(s) - HP OneSync/ALI)
Solution Delivery Lifecycle Integration (SDLCi) = Unified Lifecycle Management (ULM)
Episode VII
HP Codar / DevOps Insight / AppPulse / OneSync
48
@jonathon_wright
#esconfs www.eurostarconferences.com
The Force Awakens - Test-Ops in the Cloud
TestOps BUILD then TEST vs. DevOps BUILD then Deploy?
De-coupling
Solutions (SOA)
Continuous
Build, Integration
& Delivery
Good Coding
PracticesConfigurability &
Maintainability
Ops Hub
Infra as Code
Extend QA
(Ops)
Resolution
Practices
Agile
Engineering
(Shift Left)
Agile
Engineering
(Shift Right)
CodarBlueprints Recipes PatternsHelionBlueprints Recipes PatternsUFT SV
TestOps (Test-Dev) with Automated Testing DevOps (Dev-Test) with Automated Deployment
Journey to DevOps with HP
Ops
Monitoring
(Testing)
Monitoring
(Ops)
Modelling
(Testing)
Modelling
(Ops)
Episode VII
Dev Test
* Ajay Nair & Faraz Syed, ‘Journey to DevOps with HP’, BrightTALK, 23th April 2015
49
@jonathon_wright
#esconfs www.eurostarconferences.com
Codar
The Force Awakens - Test-Ops in the Cloud
TestOps BUILD then TEST vs. DevOps BUILD then Deploy?
Blueprints Recipes Patterns
TestOps (Test-Dev) with Automated Testing
UFT SV Blueprints Recipes Patterns
DevOps (Dev-Test) with Automated Deployment
Helion
Episode VII
Journey to DevOps with HP
50
@jonathon_wright
#esconfs www.eurostarconferences.com
Codar
The Force Awakens - Test-Ops in the Cloud
TestOps BUILD then TEST vs. DevOps BUILD then Deploy?
Blueprints Recipes Patterns
TestOps (Test-Dev) with Automated Testing
UFT SV Blueprints Recipes Patterns
DevOps (Dev-Test) with Automated Deployment
Helion
Episode VII
* Ajay Nair & Faraz Syed, ‘Journey to DevOps with HP’, BrightTALK, 23th April 2015
@jonathon_wright
#esconfsJourney to DevOps with HP
51
@jonathon_wright
#esconfs www.eurostarconferences.com
Test-Ops in the Cloud
QualityGate™ Map
• Predictive ALM
– Machine Learning
– Code Analysis
• Predictive Analysis
– Prediction(Cost/Accuracy/Defects)
– Predictive Planning
– Velocity / QA Impact
• Predictive Testing
– Smart Test (Test Impact Analysis)
– Open Test Frameworks
(SeleniumRWD/Phantom.JS/xCode/jUnit/qUnit/nUnit/TestNG)
• Predictive Builds
– Smart Build (Analyze Commits)
• Predictive Release
– Release Health
QualityGate™ Map
Confidence Level 74%
QualityGate™ Recommendations PBIs
Episode VII
52
@jonathon_wright
#esconfs www.eurostarconferences.com
Test-Ops in the Cloud – XaaS – Design
@jonathon_wright
#esconfs
Episode VII
HP Codar feat. Chef
53
@jonathon_wright
#esconfs www.eurostarconferences.com
Test-Ops in the Cloud – XaaS – Define / Architect (3-Tier)
@jonathon_wright
#esconfs
Episode VII
HP Codar feat. Chef
54
@jonathon_wright
#esconfs www.eurostarconferences.com
Test-Ops in the Cloud – XaaS – Deploy - Testing
@jonathon_wright
#esconfs
Episode VII
HP Codar feat. DevOps Insight
www.eurostarconferences.com
55
@jonathon_wright
#esconfs www.eurostarconferences.com
Test-Ops in the Cloud – XaaS – Manage - Testing
Episode VII
HP ALM 12.5 feat. Jenkins/Chef
56
@jonathon_wright
#esconfs www.eurostarconferences.com
Test-Ops in the Cloud – XaaS – Testing in the Wild
Episode VII
HP AppPulse
57
@jonathon_wright
#esconfs www.eurostarconferences.com
Test-Ops in the Cloud – Gone in Sixty Seconds
0-6 secs – Minor UX change (Dev to TestOps)
6-8 secs – Click Save button (VS2015-CTP6) feat. CodeLens
10-20 secs – Predictive Build (Jenkins) 50-60 secs – Predictive Release (HP Helion)
20-40 secs – Predictive Testing (ALM 12.5)
8-10 secs – Check-in / Analyse / Commit (GIT)
6% chance to break build
74% Quality Gate Map (confidence rate)
40-50 secs – Predictive Deploy (HP Codar)
88% Quality Gate Map (confidence rate)
66% Quality Gate Map (confidence rate)
92% Quality Index Score (Predictive Analysis)
* Visual Studio 2015 CP6 (incl. TypeScript 1.4), http://www.typescriptlang.org/playground & http://go.microsoft.com/fwlink/?LinkId=400496
Predictive vs. Smart
Episode VII
Ask a Jedi?http://testhuddle.com/forums/topic/testing-as-a-service-models/
59
@jonathon_wright
#esconfs www.eurostarconferences.com
TestOps in the Cloud - Summary
BusinessAssurance
BusinessQuality
BusinessTesting
Business Assurance provides the visibility and
transparency throughout the solution delivery lifecycle• Digital Enterprise
• Business on a Page
• Business Delivery Management
• Business Intelligence (Actionable Business Insight)
• Business Innovation (Enterprise Gamification)
Business Quality allows enforceable quality across the
entire solution delivery lifecycle owned by everyone• Business Lifecycle Management
• Business Solution Discovery / Delivery
• Business Enterprise Collaboration
• Business Acceptance Testing
Business Testing
• Testing as a Service - Models
• Solution Delivery Lifecycle integration (SLDCi)
• Test First Delivery / First Day Testing
• Continious, Integration, Build & Delivery
• Shift Everywhere (UP/DOWN/LEFT/RIGHT)
• All Channel Customer Experience
60
@jonathon_wright
#esconfs www.eurostarconferences.com
Hitachi ConsultingHitachi’s Global Management Consulting & IT Services Business.
$740
MillionFY13 Revenue
6,500experienced &
dedicated
professionals
Better Approach. Better Results. Better Experience.
$10 Billion
results
© Hitachi Europe Ltd. 2014. All rights reserved.
top related