how to find leading measures - ready to use guide

79
LEADING MEASURES SPECIFIC RECOMMENDATIONS TO FIND THEM Based on http://www.bscdesigner.com/find-leading- measures.htm By Aleksey Savkin

Upload: aleksey-savkin

Post on 23-Jan-2015

215 views

Category:

Business


2 download

DESCRIPTION

How do you find "leading" metrics? I think everyone will agree that in the business scorecard there should be a balanced set of lagging and leading metrics. Business experts are exercising in explaining the difference (I'm not an exception, the last attempt is using a golf metaphor). But the main mystery remains unsolved - how do we find those excellent leading metrics? In this article (http://www.bscdesigner.com/find-leading-measures.htm) I shared my thoughts. My method is about a mix of calculations, social research methods, scientific measurement and conducting tests under artificial conditions (a/b tests in simple words). I cannot say that it works for me in 100% of the cases, but at least it is a good starting point for me and my clients. I'm interested in the opinion of the group members about the suggested approach, and I'm interested even more in learning the best practices about finding leading measures that work for you.

TRANSCRIPT

Page 1: How to find leading measures - ready to use guide

LEADING MEASURES SPECIFIC RECOMMENDATIONS TO FIND THEM

Based onhttp://www.bscdesigner.com/find-leading-measures.htm

By Aleksey Savkin

Page 2: How to find leading measures - ready to use guide

LEADING LAGGING

THE DIFFERENCE BETWEEN LAGGING AND LEADING MEASURES

Page 3: How to find leading measures - ready to use guide

BSC DESIGNER

THE DIFFERENCE BETWEEN LAGGING AND LEADING MEASURES

• Knowing the score or the distance between the ball and the cap is easy (lagging measure)

Page 4: How to find leading measures - ready to use guide

BSC DESIGNER

THE DIFFERENCE BETWEEN LAGGING AND LEADING MEASURES

• Knowing the score or the distance between the ball and the cap is easy (lagging measure)

• Knowing and controlling the parameters of golf swing that lead to an excellent score are hard (leading measures)

Page 5: How to find leading measures - ready to use guide

MEASUREMENT TOOLKIT

Page 6: How to find leading measures - ready to use guide

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Before we were talking about such steps as observation and quantification that one needs to follow in order to come up with a metric,

Page 7: How to find leading measures - ready to use guide

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Before we were talking about such steps as observation and quantification that one needs to follow in order to come up with a metric,

• In the business world most of the measures are actually simple calculations.

Page 8: How to find leading measures - ready to use guide

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Before we were talking [1] about such steps as observation and quantification that one needs to follow in order to come up with a metric,

• In the business world most of the measures are actually simple calculations.

• Still in the business we often forget about scientific nature of measurement and replace it with simple calculations.

Page 9: How to find leading measures - ready to use guide

BSC DESIGNER

THE NATURE OF MEASUREMENT

• The measurement is probably as old as science itself

Page 10: How to find leading measures - ready to use guide

BSC DESIGNER

THE NATURE OF MEASUREMENT

• The measurement is probably as old as science itself,

• still in the business we often forget about scientific nature of measurement and replace it with simple calculations.

Page 11: How to find leading measures - ready to use guide

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Scientific research implies a certain level of uncertainty about a subject of the research and the goal of measurement is to reduce the uncertainty.

Page 12: How to find leading measures - ready to use guide

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Scientific research implies a certain level of uncertainty about a subject of the research and the goal of measurement is to reduce the uncertainty.

• If we have a look at business measures from this point of view then we will be really disappointed.

Page 13: How to find leading measures - ready to use guide

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Scientific research implies a certain level of uncertainty about a subject of the research and the goal of measurement is to reduce the uncertainty.

• If we have a look at business measures from this point of view then we will be really disappointed.

• The majority of “measures” are actually calculations [2] or are based on the information obtained directly from the subject of the research.

Page 14: How to find leading measures - ready to use guide

BSC DESIGNER

[2] “How to Measure

Anything: Finding the Value of

Intangibles in Business”

• Douglas W. Hubbard, “How to Measure Anything: Finding the Value of Intangibles in Business”, 2007, Wiley; 1 edition

Page 15: How to find leading measures - ready to use guide

BSC DESIGNER

AN EMPLOYEE TURNOVER EXAMPLE

• An HR manager calculates turnover by dividing the number of employees who left the company over a period by the average number of employees that were in the company during this period.

Page 16: How to find leading measures - ready to use guide

BSC DESIGNER

MEASUREMENT VS. CALCULATION

• All of the variables are available in the company’s ERP system and are simply divided.

Page 17: How to find leading measures - ready to use guide

BSC DESIGNER

MEASUREMENT VS. CALCULATION

• All of the variables are available in the company’s ERP system and are simply divided.

• We could call it Big Data,

Page 18: How to find leading measures - ready to use guide

BSC DESIGNER

MEASUREMENT VS. CALCULATION

• All of the variables are available in the company’s ERP system and are simply divided.

• We could call it Big Data, • But the idea is as simple as running two

database queries to get two variables and divide one by another.

Page 19: How to find leading measures - ready to use guide

BSC DESIGNER

MEASUREMENT VS. CALCULATION

• There is nothing bad about calculating something that might be insightful for HR,

Page 20: How to find leading measures - ready to use guide

BSC DESIGNER

MEASUREMENT VS. CALCULATION

• There is nothing bad about calculating something that might be insightful for HR,

• But let’s not call it measurement, as it is just a calculation.

Page 21: How to find leading measures - ready to use guide

BSC DESIGNER

SOCIAL SCIENCE MEASUREMENTS

• The idea is to ask the persons that are in the focus group (the subject of the research) to share their opinion about something.

Page 22: How to find leading measures - ready to use guide

BSC DESIGNER

SOCIAL SCIENCE MEASUREMENTS

• The idea is to ask the persons that are in the focus group (the subject of the research) to share their opinion about something.

• One supposes that well formulated questions will minimize the risk of receiving wrong information and making wrong conclusions as a result.

Page 23: How to find leading measures - ready to use guide

BSC DESIGNER

SOCIAL SCIENCE MEASUREMENTS

• The idea is to ask the persons that are in the focus group (the subject of the research) to share their opinion about something.

• One supposes that well formulated questions will minimize the risk of receiving wrong information and making wrong conclusions as a result.

• It is not a calculation, but still we are doing only what social scientists can do – ask people directly about their opinion.

Page 24: How to find leading measures - ready to use guide

BSC DESIGNER

TRADITIONAL SCIENTIFIC MEASUREMENT

• Traditional scientific measurement method is about observation.

Page 25: How to find leading measures - ready to use guide

BSC DESIGNER

TRADITIONAL SCIENTIFIC MEASUREMENT

• Traditional scientific measurement method is about observation.

• They observe, they come up with hypothesis, and they test them to see if one worked or not.

Page 26: How to find leading measures - ready to use guide

BSC DESIGNER

TRADITIONAL SCIENTIFIC MEASUREMENT

• Traditional scientific measurement method is about observation.

• They observe, they come up with hypothesis, and they test them to see if one worked or not.

• It is always about the reduction of uncertainty and almost never about precise calculations.

Page 27: How to find leading measures - ready to use guide

DIFFERENT WAYS TO FIND MEASURES

Page 28: How to find leading measures - ready to use guide

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

Source: www.bscdesigner.com

Measure Why use

CalculationsNot a measurement, but still…

We can "calculate." It is not a measurement, but still it gives us a number

1 2

+ /

Page 29: How to find leading measures - ready to use guide

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

Source: www.bscdesigner.com

Measure Why use

CalculationsNot a measurement, but still…

We can "calculate." It is not a measurement, but still it gives us a number

Surveys Social science measurements

We can communicate with the subject of the research (with our customers, prospects or employees), for example via surveys

1 2

+ /

✓ X

Page 30: How to find leading measures - ready to use guide

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

Source: www.bscdesigner.com

Measure Why use

CalculationsNot a measurement, but still…

We can "calculate." It is not a measurement, but still it gives us a number

Surveys Social science measurements

We can communicate with the subject of the research (with our customers, prospects or employees), for example via surveys

Observe and concludeTraditional scientific measurement

We can observe and do conclusions (we are not limited to observing our own business only or the present day only)

1 2

+ /

✓ X

Page 31: How to find leading measures - ready to use guide

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

Source: www.bscdesigner.com

Measure Why use

CalculationsNot a measurement, but still…

We can "calculate." It is not a measurement, but still it gives us a number

Surveys Social science measurements

We can communicate with the subject of the research (with our customers, prospects or employees), for example via surveys

Observe and concludeTraditional scientific measurement

We can observe and do conclusions (we are not limited to observing our own business only or the present day only)

Artificially created conditionsTraditional scientific measurement

We can formulate a hypothesis and test it under artificially created conditions

1 2

+ /

ba

✓ X

Page 32: How to find leading measures - ready to use guide

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

• A practical conclusion from the ideas described above is that we always have several measurement options.

Page 33: How to find leading measures - ready to use guide

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

1. We can “calculate.” It is not a measurement, but still it gives us a number

Page 34: How to find leading measures - ready to use guide

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

1. We can “calculate.” It is not a measurement, but still it gives us a number

2. We can communicate with the subject of the research (with our customers, prospects or employees), for example via surveys

Page 35: How to find leading measures - ready to use guide

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

3. We can observe and do conclusions (we are not limited to observing our own business only or the present day only)

Page 36: How to find leading measures - ready to use guide

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

3. We can observe and do conclusions (we are not limited to observing our own business only or the present day only)

4. We can formulate a hypothesis and test it under artificially created conditions

Page 37: How to find leading measures - ready to use guide

BSC DESIGNER

CALCULATIONS

• We could calculate satisfaction rate by calculating the number of repeat purchases.

Page 38: How to find leading measures - ready to use guide

BSC DESIGNER

CALCULATIONS

• We could calculate satisfaction rate by calculating the number of repeat purchases.

• This is not a measurement, it is a calculation

Page 39: How to find leading measures - ready to use guide

BSC DESIGNER

CALCULATIONS

• We could calculate satisfaction rate by calculating the number of repeat purchases.

• This is not a measurement, it is a calculation • but it still reduces the level of uncertainty

about the subject in the sense that it allows managers to see the problem from a different perspective.

Page 40: How to find leading measures - ready to use guide

BSC DESIGNER

CALCULATIONS

• With calculations we could normally generate excellent lagging measures, but not leading ones

Page 41: How to find leading measures - ready to use guide

BSC DESIGNER

CALCULATIONS

• With calculations we could normally generate excellent lagging measures, but not leading ones

• We suppose that satisfied customers are those who make repeat purchases within 2 months.

Page 42: How to find leading measures - ready to use guide

BSC DESIGNER

CALCULATIONS

• With calculations we could normally generate excellent lagging measures, but not leading ones

• We suppose that satisfied customers are those who make repeat purchases within 2 months.

• But we have no idea about what leads them to a repeat purchase.

Page 43: How to find leading measures - ready to use guide

BSC DESIGNER

SURVEYS

• We could calculate some customer activity by taking some variables

Page 44: How to find leading measures - ready to use guide

BSC DESIGNER

SURVEYS

• We could calculate some customer activity by taking some variables

• But sometimes it is easier to conduct a survey by asking customers about their preferences and decisions.

Page 45: How to find leading measures - ready to use guide

BSC DESIGNER

SURVEYS

• We could calculate some customer activity by taking some variables

• But sometimes it is easier to conduct a survey by asking customers about their preferences and decisions.

• the procedure of measurement is easier itself, but the formulation of survey questions is always a challenging task.

Page 46: How to find leading measures - ready to use guide

BSC DESIGNER

OBSERVE AND CONCLUDE

• We just observe what they do and make appropriate conclusions.

Page 47: How to find leading measures - ready to use guide

BSC DESIGNER

OBSERVE AND CONCLUDE

• We just observe what they do and make appropriate conclusions.

• You might install a special script on the website that will show you the most clickable zones.

Page 48: How to find leading measures - ready to use guide

BSC DESIGNER

OBSERVE AND CONCLUDE

• We just observe what they do and make appropriate conclusions.

• You might install a special script on the website that will show you the most clickable zones.

• You can observe the process of customer choice in the physical shop.

Page 49: How to find leading measures - ready to use guide

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• A measurement by observation as described above might be as difficult as finding black holes in the space by tracking light behavior.

Page 50: How to find leading measures - ready to use guide

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• A measurement by observation as described above might be as difficult as finding black holes in the space by tracking light behavior.

• We are not pretending to do a space science in the business, and we can artificially create some conditions and see what will happen.

Page 51: How to find leading measures - ready to use guide

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• Instead of asking customers for their opinion, or silently observing their behavior,

Page 52: How to find leading measures - ready to use guide

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• Instead of asking customers for their opinion, or silently observing their behavior,

• One could create two options and see which one works better.

Page 53: How to find leading measures - ready to use guide

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• These two measurement methods actually give us more opportunities to find excellent leading measures.

Page 54: How to find leading measures - ready to use guide

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• These two measurement methods actually give us more opportunities to find excellent leading measures.

• Under artificially created conditions you can test business hypotheses and get closer to the drivers of performance excellence.

Page 55: How to find leading measures - ready to use guide

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

Page 56: How to find leading measures - ready to use guide

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Source: www.bscdesigner.com What change will lead to more sales?

Page 57: How to find leading measures - ready to use guide

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Source: www.bscdesigner.com What change will lead to more sales?

Page 58: How to find leading measures - ready to use guide

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Source: www.bscdesigner.com What change will lead to more sales?

Page 59: How to find leading measures - ready to use guide

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Observation 1 Observation was done within a company's own sales history. 20% of customers who buy white balls buy a black one during the next 6 months.

Source: www.bscdesigner.com What change will lead to more sales?

Page 60: How to find leading measures - ready to use guide

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Observation 1 Observation was done within a company's own sales history. 20% of customers who buy white balls buy a black one during the next 6 months.

Observation 2 Observation was done in competitor's business. In ABC company they have balls of 4 colors and they all are equally popular.

Source: www.bscdesigner.com What change will lead to more sales?

Page 61: How to find leading measures - ready to use guide

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Observation 1 Observation was done within a company's own sales history. 20% of customers who buy white balls buy a black one during the next 6 months.

Observation 2 Observation was done in competitor's business. In ABC company they have balls of 4 colors and they all are equally popular.

Artificial Condition 1

Hypothesis of price perception was tested. When black balls are 10% more expensive than white balls, then 60% of customers buy black balls.

Source: www.bscdesigner.com What change will lead to more sales?

Page 62: How to find leading measures - ready to use guide

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Observation 1 Observation was done within a company's own sales history. 20% of customers who buy white balls buy a black one during the next 6 months.

Observation 2 Observation was done in competitor's business. In ABC company they have balls of 4 colors and they all are equally popular.

Artificial Condition 1

Hypothesis of price perception was tested. When black balls are 10% more expensive than white balls, then 60% of customers buy black balls.

Artificial Condition 2

Hypothesis of a bundle was tested. When a white ball is bundled with a white hat 75% of customers buy the bundle.

Source: www.bscdesigner.com What change will lead to more sales?

Page 63: How to find leading measures - ready to use guide

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• It is not a real business case, but I think you do agree that we are faced with situations like this very often:

Page 64: How to find leading measures - ready to use guide

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• Our CRM system gives us a number, but we don’t know how we can change it.

Page 65: How to find leading measures - ready to use guide

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• Our CRM system gives us a number, but we don’t know how we can change it.

• We do some survey and sometimes we get some ideas, but they might not be coherent with real customers’ actions.

Page 66: How to find leading measures - ready to use guide

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• We obverse and do some conclusion about what might work

Page 67: How to find leading measures - ready to use guide

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• We obverse and do some conclusion about what might work

• We try various options and it appeared that something unmentioned works better

Page 68: How to find leading measures - ready to use guide

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• It is obviously that the company needs to do some more tests or conduct more specific surveys to understand the challenge better.

Page 69: How to find leading measures - ready to use guide

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• It is obviously that the company needs to do some more tests or conduct more specific surveys to understand the challenge better.

• Finding leading metrics is actually about finding a solution that works.

Page 70: How to find leading measures - ready to use guide

FINDING EXCELLENT LEADING MEASURES

Page 71: How to find leading measures - ready to use guide

BSC DESIGNER

HOW TO FIND A BETTER LEADING MEASURE

• We need to have a balance between various measurement methods.

Page 72: How to find leading measures - ready to use guide

BSC DESIGNER

HOW TO FIND A BETTER LEADING MEASURE

• We need to have a balance between various measurement methods.

• We need to combine the results of calculations, the survey results, the results of observations and the results of tests under artificial conditions.

Page 73: How to find leading measures - ready to use guide

BSC DESIGNER

SAFETY RULES NEED TO BE FOLLOWED

• Have your business context in mind. We don’t want to measure something just because we can measure it.

Page 74: How to find leading measures - ready to use guide

BSC DESIGNER

SAFETY RULES NEED TO BE FOLLOWED

• Have your business context in mind. We don’t want to measure something just because we can measure it.

• Don’t believe people who tell you that it is impossible to measure, as it is possible to quantify and measure anything [2].

Page 75: How to find leading measures - ready to use guide

BSC DESIGNER

SAFETY RULES NEED TO BE FOLLOWED

• If you cannot quantify something then you need to decompile the subject into measurable pieces

Page 76: How to find leading measures - ready to use guide

BSC DESIGNER

SAFETY RULES NEED TO BE FOLLOWED

• If you cannot quantify something then you need to decompile the subject into measurable pieces

• Combine various measurement and research methods like calculations, surveys, observations and a/b tests.

Page 77: How to find leading measures - ready to use guide

BSC DESIGNER

• [1] Aleksey Savkin, The difference between quantification, measure, metric, and KPI, January 2014, BSCDesigner.com

• [2] Douglas W. Hubbard, “How to Measure Anything: Finding the Value of Intangibles in Business”, 2007, Wiley; 1 edition

RESOURCES

Page 78: How to find leading measures - ready to use guide

BSC DESIGNER

MORE ABOUT THE BALANCED SCORECARD

Find more insightful articles about the Balanced Scorecard in ”Articles” section at www.bscdesigner.com

BSC DESIGNER

Page 79: How to find leading measures - ready to use guide

BSC DESIGNER

THANK YOU!

Feel free to send us your questions using the contact form at www.bscdesigner.com