cloudteams methodology: a roadmap for customer-driven software development
TRANSCRIPT
The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
CloudTeams Methodology: a Roadmap for Customer-
Driven Software Development
Iosif AlvertisNational Technical University of Athens
2The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
“A Product Manager (PM) is responsible for making sure
that a team ships a great product.”
Product Management in Software Engineering: from Theory to Practice,16/2/2017
“Cracking the PM Interview: How to Land a Product Manager Job in Technology.”
3The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Product Management in Software Engineering: from Theory to Practice,16/2/2017
This one?“like a mini-CEO of their product.”
4The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Product Management in Software Engineering: from Theory to Practice,16/2/2017
You can be this!
->Knowledge!!
Reading ListDesign
Thinking
Jobs To Be Done
Sprint
Lean Startup
Lean Analytics
BullsEye Framework
Customers’ Developme
nt
“It’s all about the design”
“It’s all about the jobs of the customers”
“Prototype in 5 days"
“Learn how to become efficient (lean)”
“Actually become lean”
“Lean Marketing”
“Put everything together”
The tools
WILL IT BLEND?
7The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
The Theory: The CloudTeams Methodology
Step IA. Ideation
Step IIA. User Experience
Step IIIA. System Backlog Definition/ Update
Step IB. Market Test
Step IIB. User Acceptance Testing
Step IIIB. Regression and Functional Testing
Software Authoring &Testing
Operations performed
using preferred services/Tools
Management and Monitoring
through the CloudTeams
Platform
Operations performed using the
CloudTeams Platform
Product Management in Software Engineering: from Theory to Practice,16/2/2017
8The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
The Tool: CloudTeams Platform
Product Management in Software Engineering: from Theory to Practice,16/2/2017
9The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
CloudTeams in 60”
https://www.youtube.com/watch?v=OpPrR4uXchY&t=2s
Product Management in Software Engineering: from Theory to Practice,16/2/2017
10The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
The Manual: The CloudTeams Playbook
+=
DRAFT
Product Management in Software Engineering: from Theory to Practice,16/2/2017
12The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
We need your feedback! (NOT THIS!)
Worksho
p
Product Management in Software Engineering: from Theory to Practice,16/2/2017
13The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
The Workshop Structure
Step IA. Ideation
Step IIA. User Experience
Step IIIA. System Backlog Definition/ Update
Step IB. Market Test
Step IIB. User Acceptance Testing
Step IIIB. Regression and Functional Testing
Software Authoring &TestingProduct Management in Software Engineering: from Theory to Practice,
16/2/2017
14The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
The Methodology Unfolded
Ideation
User Experience
System Backlog Definition/ Update
Market Test
User Acceptance Testing (UAT)
Regression & Functional Testing
Sprint Backlog Definition
Design & Visual Modelling
Coding
Automated Acceptance Testing
Continuous Integration Testing
Automated Unit Testing
Software Authoring &Testing
Idea Validatio
n
Scenarios
Validation
User Stories
Validation
Product Validation
Release Validation
UAT Plan
Build Verification
Testing Plan
Development Cycle (“Sprint”)
AGILE
Validation
Verification
BacklogVerification
ModelVerification
CodeVerification
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
15The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Combining with Methodologies
Time
User Validation
Market Validation
FunctionalVerification
Build Verification
Product Ideation
Requirements
Development
Product Definition
Lean WaterfallAgile (Scrum)
Product Management in Software Engineering: from Theory to Practice,16/2/2017
16The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Step 1: Ideation
Step1: IdeationIdea
Validation
Validation
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
BUSINESS MODEL & LEAN CANVAS
BUSINESS GOALS & NEEDS
IDEAS BACKLOG
MARKET SIZING &
COMPETITION ANALYSIS
DESK RESEARCH & TECHNICAL SOLUTIONS
EPIPHANY & BRAINSTORMIN
G
TEAM MEETING
CUSTOMER
FEEDBACK
10 SLIDES PITCH &6 PAGER REPORT
MANAGEMENT APPROVALNO
YES
NOYES
EXTERNAL ADVISOR
PERSONAS LIBRARY
PROBLEM QUESTIONNAIRES
PROBLEM INTERVIEWS
BUILD PERSONAS IN CLOUDTEAMS
FIND CONTACTS FOR INTERVIEWS
DATA ANALYSIS
MEETING
CLARIFY BUSINESS MODEL
MANAGEMENT APPROVAL
RATE IDEA ON BUSINESS CRITERIA
Step1: IdeationIdea
Validation
BRAINSTORMING MEETING
10 SLIDES PITCH &6 PAGER REPORT
(UPDATED)
STEP 2
18The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Step 2: User Experience
Step1: Ideation
Step 2: User Experience
Idea Validatio
n
Scenarios
Validation
Validation
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
SCENARIOS
VALIDATION PLANNING MEETING
BRAINSTORMING MEETING
MANAGEMENT APPROVAL
IDEAS &PERSONA
S
VIDEOS
VIDEO
UAT PLAN
SOLUTION INTERVIEW
S
LANDING PAGE
EVALUATE ON CRITERIA
STRATEGY
CROWD-SOURCIN
G
COLLABORATION SESSIONS
VOTING DATA
ANALYSIS
AD CAMPAIG
N
2 LANDING
PAGESA/B
TESTING
MOCKUPS WIREFRAMES
QUALITY EVALUATION MEETING
YES
YES
NO
NO
Step 2: User Experience
Scenarios Validatio
n
STEP 1
STORYBOARDS
10 SLIDES PITCH &
6 PAGER REPORT(UPDATED)
STEP 3
20The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Step 3: System Backlog Definition
Step1: Ideation
Step 2: User Experience
Step 3: System Backlog Definition/Update
Idea Validatio
n
Scenarios
Validation
User Stories
Validation
Validation
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
USAGESCENARIOS
IDEA PERSONAS
COLLABORATION ROUND 1
USER STORIES*
BUSINESS
MODELSCENARI
OSMEDIA
MATERIAL
TECHNICAL TEAM: ESTIMATIONS & CONSULTATION
COLLABORATION ROUND 2
VOTING
PRIORITIZEDUSER
STORIES
COLLABORATION ROUND 3
USER STORIES BACKLOG
TECHNICAL CHARACTERIST
ICS
USAGE WORKFLOW
SCOLLABORATIO
N ROUND 4
UPDATED USAGE
WORKFLOWS
CUSTOMERS’ INTERVIEWS
FINAL USER STORIES BACKLOG
FUNCTIONAL REQUIREME
NTS
NON-FUNCTIONAL
REQUIREMENTS
PROTOTYPE**
QUESTIONNAIRE
ANALYSIS MEETING
Step 3: System Backlog Definition
User Stories Validation
STEP 2
+
STEP 4
22The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
*User Stories Hierarchy
22
JOB TO BE DONE (JTBD) FOR THE
WHOLE OFFERING
HIGH-LEVEL USER STORIES FOR PERSONA
#1
HIGH-LEVEL USER STORIES FOR PERSONA
#2
HIGH-LEVEL USER STORIES FOR PERSONA
#N…
CASE-SPECIFICUSER STORIES
FOR STAKEHOLDER
#1
CASE-SPECIFICUSER STORIES
FOR STAKEHOLDER
#2
CASE-SPECIFICUSER STORIES
FOR STAKEHOLDER
#M
Customer Segments
Explored & Unexplored
Markets
Users of the
offering
• “As a user, I want to call the vehicle on the place I am, so that I don’t have to walk around to find a taxi”
• “As a user, I want to split the fair with another passenger, so that we don’t have to exchange cash after the trip”
• “I want to move from place A to place B fast and easy”.
Examples for Uber
• “As an asset manager, I want to move from home to work and back, fast, easy and inexpensive, so that I make my living”
• “As a college student, I want to return home safe after a drinking night out, so that I don’t have to drive and lose my driving license”
Hierarchy in User StoriesGoal
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
23The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
**Prototyping (Vs MVP)
PrototypeA primitive model, sample or version of a product for testing an idea or a process, or acting as a means of learning
MVPThe product with the highest return on investment versus
risk. It has just those core features that allow the
product to be deployed, and no more, and allow customers to start paying for the service
and giving feedback. It is a version of the product
to maximize customer understanding, with the least
effort.Feasibility test, Controlled sample of users, Design Thinking
Tests hypotheses, Tries to reach the customer, Lean Startup
Learn fast your user Learn fast your customer
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
24The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Development Cycle (“Sprint”)
Steps 4-9: The “BLACK BOX”
Step1: Ideation
Step 2: User Experience
Step 3: System Backlog Definition/Update
Market Test
Step 11: User Acceptance Testing (UAT)
Step 10: Regression & Functional Testing
Idea Validatio
n
Scenarios
Validation
User Stories
Validation
Verification
Step 4: Sprint Backlog Definition
Step 5: Design & Visual Modelling
Step 6: Coding
Step 9: Automated Acceptance Testing
Step 8: Continuous Integration Testing
Step 7: Automated Unit Testing
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
25The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Step 10: System Backlog Definition
Step1: Ideation
Step 2: User Experience
Step 3: System Backlog Definition/Update
Step 10: Regression & Functional Testing
Idea Validatio
n
Scenarios
Validation
User Stories
Validation
Verification
Step 4: Sprint Backlog Definition
Step 5: Design & Visual Modelling
Step 6: Coding
Step 9: Automated Acceptance Testing
Step 8: Continuous Integration Testing
Step 7: Automated Unit Testing
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
Build Verification
Testing Plan
The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
UNSUPERVISED TESTING
SUPERVISED TESTING
ISSUES BACKLOG
BUILD STATUS
TESTING PLAN
UPDATEDISSUES
BACKLOG
DEBUGGING
FUNCTIONAL
SUITABILITY* PERFORMANC
E EFFICIENCYCOMPATIBILI
TYOPERABILI
TY
RELIABILITY SECURITY MAINTENABILIT
Y PORTABILITY
Step 10: Regression & Functional Testing
STEP 9
STEP 3
STEP 11
USE CASES
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
Metrics ISO 25010:2011 Product Quality Model
27The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
*Functional Suitability
Release Number
Use Case ID
Use case Title
Completed Without
Help
Completed with Help
Completed with bugs
Not Completed because of
bug
Not Completed after help
Useful(1-5)
Easy(1-5)
Stakeholder Group Name CODE.# Title Y/N Y/N Y/N Y/N Y/N
CODE.#
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
28The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Step 11: System Backlog Definition
Step1: Ideation
Step 2: User Experience
Step 3: System Backlog Definition/Update
Step 11: User Acceptance Testing (UAT)
Step 10: Regression & Functional Testing
Idea Validatio
n
Scenarios
Validation
User Stories
Validation
Validation
Step 4: Sprint Backlog Definition
Step 5: Design & Visual Modelling
Step 6: Coding
Step 9: Automated Acceptance Testing
Step 8: Continuous Integration Testing
Step 7: Automated Unit Testing
Release Validation
UAT Plan
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
UPDATE METHODOLOGY
TESTING PLAN
UATREPORT
CREATE QUESTIONNAIRE
COLLECT RESPONSES
ANALYZE
PREPARE PUBLIC
LAUNCH
MethodologyISO 25010: Quality in use modelTAM
HMSAM
CloudTeams VnV
UEQ
EffectivenessEfficiencySatisfaction
UsefulnessTrust
PleasureComfort
SafetyEconomic damage risk
Privacy harm riskUsability
LearnabilityFlexibility
AccessibilityContent Conformity
Business Value
ClarityValue
Need LevelUrgency
Need CoverageInnovation/Uniqueness
Virality
Step 11: User Acceptance Testing
STEP 10
STEP 2
STEP 12
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
30The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Step 12: Market Test
Step1: Ideation
Step 2: User Experience
Step 3: System Backlog Definition/Update
Market Test
Step 11: User Acceptance Testing (UAT)
Step 10: Regression & Functional Testing
Idea Validatio
n
Scenarios
Validation
User Stories
Validation
Validation
Step 4: Sprint Backlog Definition
Step 5: Design & Visual Modelling
Step 6: Coding
Step 9: Automated Acceptance Testing
Step 8: Continuous Integration Testing
Step 7: Automated Unit Testing
Product Validation
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
BUSINESS PLAN
DEFINE WORKFLOW
CHOOSE PHASE
CHOOSE KEY METRIC
PERIODIC REPORT
Pivot Improve
IMPROVE MARKETING EFFICIENCY
Step 12: Market Test
Empathy
Stickiness
Virality
Revenue
Scale
E-CommerceSaaS
Free App/Content
Media Content
UGC
Two-sided Market
STEP 11
STEP 2
STEP 1
STEP 1
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
33The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
The CloudTeams Planning…
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
34The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Outcomes (so far)
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
35The CloudTeams project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644617.
Be part of the round-table discussion!
Product Management in Software Engineering: from Theory to Practice,§16/2/2017
http://bit.ly/cloudteams2017