data collection and analysis for better requirements
DESCRIPTION
According to studies, 64 percent of features in systems are rarely—or never—used. How does this happen? Today, the work of eliciting the customers' true needs, which often remains elusive, can be enhanced using data-driven requirements techniques. Brandon Carlson describes why traditional requirements analysis is so difficult and presents a set of seven data collection approaches and analysis techniques you can employ on your projects right away. Learn how to instrument existing applications and develop new requirements based on operational profiles of the current system. Learn to use A/B testing—a technique for trying out and analyzing alternative implementations—on your current system to determine which new features will deliver the most business value. With these tools at hand, you can help users and business stakeholders decide the best approaches and new features to meet their real needs. Now is the time to take the guesswork out of requirements and get the facts.TRANSCRIPT
�
BW6 Concurrent�Session�11/13/2013�2:15�PM�
������
"Data Collection and Analysis for Better Requirements"
���
Presented by:
Brandon Carlson Lean TECHniques, Inc.
��������
Brought�to�you�by:��
��
340�Corporate�Way,�Suite�300,�Orange�Park,�FL�32073�888Ͳ268Ͳ8770�ͼ�904Ͳ278Ͳ0524�ͼ�[email protected]�ͼ�www.sqe.com
Brandon Carlson Lean TECHniques, Inc.
A self-proclaimed nerd, Brandon Carlson works for Lean TECHniques, Inc., an IT consultancy that helps teams deliver high-value, high-quality products to market. Since starting his career in 1995, Brandon has held positions from development and architecture to management—and he’s still learning. Passionate about elevating the performance of IT as a whole, he has helped numerous organizations from startups to Fortune 100 companies improve their product development and delivery systems. Brandon’s current interests include data-driven product definition/development and professionalism in the world of software development. He can be reached on Twitter and pretty much everywhere else on the web as “bcarlso.” Read his blog at bcarlso.net/.
Just The Facts Ma’amData Collection and Analysis for Better
Products
Required Reading
Theory of Constraints
1525 20 2510
Theory of Constraints
1525 20 2510
Theory of Constraints
1525 20 2510
Agile: IT as Constraint
MarketingSales Operations CustomerIT
Lean: Optimize the Whole
MarketingSales Operations CustomerIT
A Turning Point
“Our highest priority is to satisfy the customerthrough early and continuous delivery
of valuable software.”
“Our highest priority is to satisfy the customerthrough early and continuous delivery
of valuable software.”
Information as Constraint
MarketingSales Operations CustomerIT
MarketingSales Operations CustomerITInformation
MarketingSales Operations CustomerIT
Missing Feedback Loops?
What we (don’t) know...
http://ww
w.flickr.com
/photos/flamephoenix1991/8376271918/sizes/m
/
Law Of Small Numbers
http://ww
w.flickr.com
/photos/wfryer/8166990403/
Confirmation Bias
http://ww
w.geograph.org.uk/photo/35330
WYSIATI
http://ww
w.flickr.com
/photos/3059349393/8000156483/
Availability Bias
http://no.wikipedia.org/w
iki/Fil:Rottw
eiler_standing_facing_left.jpghttp://com
mons.w
ikimedia.org/w
iki/File:Germ
an_Shepherd_Dog_w
ith_disc.jpg
Response Bias
http://farm4.staticflickr.com
/3444/3392536961_8b9aae5f6b_o.jpg
Preference Theory
http://ww
w.flickr.com
/photos/sis/200768094/sizes/m/in/photostream
/
Social Norms
http://comm
ons.wikim
edia.org/wiki/File:Facebook_like_thum
b.png
7 SpotlightsSeven factabulous ways to get better
requirements
http://ww
w.flickr.com
/photos/enricomaritano/4210706861
Traffic Analysis�
http://ww
w.flickr.com
/photos/14954127@N00/4546555910
Observe First
�Stalking > Talking
Leverage Development
log(sha1(currentUser, deviceId));
�
Leverage Development
results = performSearch(searchString)
if results.empty?
log(“empty.search”, searchString)
end
�
Enterprise Anthropology�
http://ww
w.flickr.com
/photos/ricardoalvarez/162914130/
A/B TestChoose between
two options
�
http://ww
w.flickr.com
/photos/donkeyhotey/5731191759
Restrict Access�
http://ww
w.flickr.com
/photos/harvypascua/46114061
Play the Nickel Slotsaka Little Bets
�
http://ww
w.flickr.com
/photos/orphanjones/2370564178
7 Spotlights
• Traffic Analysis
• Observe First
• Leverage Development
• Enterprise Anthropology
• A/B Test
• Restrict Access
• Nickel Slots
7 Spotlights• Traffic Analysis
• Observe First
• Leverage Development
• Enterprise Anthropology
• A/B Test
• Restrict Access
• Nickel Slots
Use the 7 Spotlights to get the facts about what
your customers do...
...then combine that with what they say
...to help you eliminate waste and discover the
right product.
The “Right” Product
• Reduced Market Risk
• Increased Customer Understanding
• “Good enough” Features
• Higher ROI
• Tactical Agility
The “Right” Product
• Reduced Market Risk
• Increased Customer Understanding
• “Good Enough” Features
• Higher ROI
• Tactical Agility
@bcarlso