how to find leading measures - ready to use guide

Post on 23-Jan-2015

215 Views

Category:

Business

2 Downloads

Preview:

Click to see full reader

DESCRIPTION

How do you find "leading" metrics? I think everyone will agree that in the business scorecard there should be a balanced set of lagging and leading metrics. Business experts are exercising in explaining the difference (I'm not an exception, the last attempt is using a golf metaphor). But the main mystery remains unsolved - how do we find those excellent leading metrics? In this article (http://www.bscdesigner.com/find-leading-measures.htm) I shared my thoughts. My method is about a mix of calculations, social research methods, scientific measurement and conducting tests under artificial conditions (a/b tests in simple words). I cannot say that it works for me in 100% of the cases, but at least it is a good starting point for me and my clients. I'm interested in the opinion of the group members about the suggested approach, and I'm interested even more in learning the best practices about finding leading measures that work for you.

TRANSCRIPT

LEADING MEASURES SPECIFIC RECOMMENDATIONS TO FIND THEM

Based onhttp://www.bscdesigner.com/find-leading-measures.htm

By Aleksey Savkin

LEADING LAGGING

THE DIFFERENCE BETWEEN LAGGING AND LEADING MEASURES

BSC DESIGNER

THE DIFFERENCE BETWEEN LAGGING AND LEADING MEASURES

• Knowing the score or the distance between the ball and the cap is easy (lagging measure)

BSC DESIGNER

THE DIFFERENCE BETWEEN LAGGING AND LEADING MEASURES

• Knowing the score or the distance between the ball and the cap is easy (lagging measure)

• Knowing and controlling the parameters of golf swing that lead to an excellent score are hard (leading measures)

MEASUREMENT TOOLKIT

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Before we were talking about such steps as observation and quantification that one needs to follow in order to come up with a metric,

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Before we were talking about such steps as observation and quantification that one needs to follow in order to come up with a metric,

• In the business world most of the measures are actually simple calculations.

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Before we were talking [1] about such steps as observation and quantification that one needs to follow in order to come up with a metric,

• In the business world most of the measures are actually simple calculations.

• Still in the business we often forget about scientific nature of measurement and replace it with simple calculations.

BSC DESIGNER

THE NATURE OF MEASUREMENT

• The measurement is probably as old as science itself

BSC DESIGNER

THE NATURE OF MEASUREMENT

• The measurement is probably as old as science itself,

• still in the business we often forget about scientific nature of measurement and replace it with simple calculations.

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Scientific research implies a certain level of uncertainty about a subject of the research and the goal of measurement is to reduce the uncertainty.

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Scientific research implies a certain level of uncertainty about a subject of the research and the goal of measurement is to reduce the uncertainty.

• If we have a look at business measures from this point of view then we will be really disappointed.

BSC DESIGNER

THE NATURE OF MEASUREMENT

• Scientific research implies a certain level of uncertainty about a subject of the research and the goal of measurement is to reduce the uncertainty.

• If we have a look at business measures from this point of view then we will be really disappointed.

• The majority of “measures” are actually calculations [2] or are based on the information obtained directly from the subject of the research.

BSC DESIGNER

[2] “How to Measure

Anything: Finding the Value of

Intangibles in Business”

• Douglas W. Hubbard, “How to Measure Anything: Finding the Value of Intangibles in Business”, 2007, Wiley; 1 edition

BSC DESIGNER

AN EMPLOYEE TURNOVER EXAMPLE

• An HR manager calculates turnover by dividing the number of employees who left the company over a period by the average number of employees that were in the company during this period.

BSC DESIGNER

MEASUREMENT VS. CALCULATION

• All of the variables are available in the company’s ERP system and are simply divided.

BSC DESIGNER

MEASUREMENT VS. CALCULATION

• All of the variables are available in the company’s ERP system and are simply divided.

• We could call it Big Data,

BSC DESIGNER

MEASUREMENT VS. CALCULATION

• All of the variables are available in the company’s ERP system and are simply divided.

• We could call it Big Data, • But the idea is as simple as running two

database queries to get two variables and divide one by another.

BSC DESIGNER

MEASUREMENT VS. CALCULATION

• There is nothing bad about calculating something that might be insightful for HR,

BSC DESIGNER

MEASUREMENT VS. CALCULATION

• There is nothing bad about calculating something that might be insightful for HR,

• But let’s not call it measurement, as it is just a calculation.

BSC DESIGNER

SOCIAL SCIENCE MEASUREMENTS

• The idea is to ask the persons that are in the focus group (the subject of the research) to share their opinion about something.

BSC DESIGNER

SOCIAL SCIENCE MEASUREMENTS

• The idea is to ask the persons that are in the focus group (the subject of the research) to share their opinion about something.

• One supposes that well formulated questions will minimize the risk of receiving wrong information and making wrong conclusions as a result.

BSC DESIGNER

SOCIAL SCIENCE MEASUREMENTS

• The idea is to ask the persons that are in the focus group (the subject of the research) to share their opinion about something.

• One supposes that well formulated questions will minimize the risk of receiving wrong information and making wrong conclusions as a result.

• It is not a calculation, but still we are doing only what social scientists can do – ask people directly about their opinion.

BSC DESIGNER

TRADITIONAL SCIENTIFIC MEASUREMENT

• Traditional scientific measurement method is about observation.

BSC DESIGNER

TRADITIONAL SCIENTIFIC MEASUREMENT

• Traditional scientific measurement method is about observation.

• They observe, they come up with hypothesis, and they test them to see if one worked or not.

BSC DESIGNER

TRADITIONAL SCIENTIFIC MEASUREMENT

• Traditional scientific measurement method is about observation.

• They observe, they come up with hypothesis, and they test them to see if one worked or not.

• It is always about the reduction of uncertainty and almost never about precise calculations.

DIFFERENT WAYS TO FIND MEASURES

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

Source: www.bscdesigner.com

Measure Why use

CalculationsNot a measurement, but still…

We can "calculate." It is not a measurement, but still it gives us a number

1 2

+ /

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

Source: www.bscdesigner.com

Measure Why use

CalculationsNot a measurement, but still…

We can "calculate." It is not a measurement, but still it gives us a number

Surveys Social science measurements

We can communicate with the subject of the research (with our customers, prospects or employees), for example via surveys

1 2

+ /

✓ X

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

Source: www.bscdesigner.com

Measure Why use

CalculationsNot a measurement, but still…

We can "calculate." It is not a measurement, but still it gives us a number

Surveys Social science measurements

We can communicate with the subject of the research (with our customers, prospects or employees), for example via surveys

Observe and concludeTraditional scientific measurement

We can observe and do conclusions (we are not limited to observing our own business only or the present day only)

1 2

+ /

✓ X

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

Source: www.bscdesigner.com

Measure Why use

CalculationsNot a measurement, but still…

We can "calculate." It is not a measurement, but still it gives us a number

Surveys Social science measurements

We can communicate with the subject of the research (with our customers, prospects or employees), for example via surveys

Observe and concludeTraditional scientific measurement

We can observe and do conclusions (we are not limited to observing our own business only or the present day only)

Artificially created conditionsTraditional scientific measurement

We can formulate a hypothesis and test it under artificially created conditions

1 2

+ /

ba

✓ X

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

• A practical conclusion from the ideas described above is that we always have several measurement options.

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

1. We can “calculate.” It is not a measurement, but still it gives us a number

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

1. We can “calculate.” It is not a measurement, but still it gives us a number

2. We can communicate with the subject of the research (with our customers, prospects or employees), for example via surveys

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

3. We can observe and do conclusions (we are not limited to observing our own business only or the present day only)

BSC DESIGNER

DIFFERENT WAYS TO FIND MEASURES

3. We can observe and do conclusions (we are not limited to observing our own business only or the present day only)

4. We can formulate a hypothesis and test it under artificially created conditions

BSC DESIGNER

CALCULATIONS

• We could calculate satisfaction rate by calculating the number of repeat purchases.

BSC DESIGNER

CALCULATIONS

• We could calculate satisfaction rate by calculating the number of repeat purchases.

• This is not a measurement, it is a calculation

BSC DESIGNER

CALCULATIONS

• We could calculate satisfaction rate by calculating the number of repeat purchases.

• This is not a measurement, it is a calculation • but it still reduces the level of uncertainty

about the subject in the sense that it allows managers to see the problem from a different perspective.

BSC DESIGNER

CALCULATIONS

• With calculations we could normally generate excellent lagging measures, but not leading ones

BSC DESIGNER

CALCULATIONS

• With calculations we could normally generate excellent lagging measures, but not leading ones

• We suppose that satisfied customers are those who make repeat purchases within 2 months.

BSC DESIGNER

CALCULATIONS

• With calculations we could normally generate excellent lagging measures, but not leading ones

• We suppose that satisfied customers are those who make repeat purchases within 2 months.

• But we have no idea about what leads them to a repeat purchase.

BSC DESIGNER

SURVEYS

• We could calculate some customer activity by taking some variables

BSC DESIGNER

SURVEYS

• We could calculate some customer activity by taking some variables

• But sometimes it is easier to conduct a survey by asking customers about their preferences and decisions.

BSC DESIGNER

SURVEYS

• We could calculate some customer activity by taking some variables

• But sometimes it is easier to conduct a survey by asking customers about their preferences and decisions.

• the procedure of measurement is easier itself, but the formulation of survey questions is always a challenging task.

BSC DESIGNER

OBSERVE AND CONCLUDE

• We just observe what they do and make appropriate conclusions.

BSC DESIGNER

OBSERVE AND CONCLUDE

• We just observe what they do and make appropriate conclusions.

• You might install a special script on the website that will show you the most clickable zones.

BSC DESIGNER

OBSERVE AND CONCLUDE

• We just observe what they do and make appropriate conclusions.

• You might install a special script on the website that will show you the most clickable zones.

• You can observe the process of customer choice in the physical shop.

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• A measurement by observation as described above might be as difficult as finding black holes in the space by tracking light behavior.

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• A measurement by observation as described above might be as difficult as finding black holes in the space by tracking light behavior.

• We are not pretending to do a space science in the business, and we can artificially create some conditions and see what will happen.

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• Instead of asking customers for their opinion, or silently observing their behavior,

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• Instead of asking customers for their opinion, or silently observing their behavior,

• One could create two options and see which one works better.

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• These two measurement methods actually give us more opportunities to find excellent leading measures.

BSC DESIGNER

ARTIFICIALLY CREATED CONDITIONS

• These two measurement methods actually give us more opportunities to find excellent leading measures.

• Under artificially created conditions you can test business hypotheses and get closer to the drivers of performance excellence.

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Source: www.bscdesigner.com What change will lead to more sales?

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Source: www.bscdesigner.com What change will lead to more sales?

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Source: www.bscdesigner.com What change will lead to more sales?

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Observation 1 Observation was done within a company's own sales history. 20% of customers who buy white balls buy a black one during the next 6 months.

Source: www.bscdesigner.com What change will lead to more sales?

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Observation 1 Observation was done within a company's own sales history. 20% of customers who buy white balls buy a black one during the next 6 months.

Observation 2 Observation was done in competitor's business. In ABC company they have balls of 4 colors and they all are equally popular.

Source: www.bscdesigner.com What change will lead to more sales?

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Observation 1 Observation was done within a company's own sales history. 20% of customers who buy white balls buy a black one during the next 6 months.

Observation 2 Observation was done in competitor's business. In ABC company they have balls of 4 colors and they all are equally popular.

Artificial Condition 1

Hypothesis of price perception was tested. When black balls are 10% more expensive than white balls, then 60% of customers buy black balls.

Source: www.bscdesigner.com What change will lead to more sales?

BSC DESIGNER

THE DIFFERENCE BETWEEN VARIOUS TYPES OF MEASUREMENT Measurement Results

Calculation Information from CRM system is calculated. 70% of customers buy while balls.

Survey Survey was conducted. Customers prefer white balls because they like the white color 60% more than the black one.

Observation 1 Observation was done within a company's own sales history. 20% of customers who buy white balls buy a black one during the next 6 months.

Observation 2 Observation was done in competitor's business. In ABC company they have balls of 4 colors and they all are equally popular.

Artificial Condition 1

Hypothesis of price perception was tested. When black balls are 10% more expensive than white balls, then 60% of customers buy black balls.

Artificial Condition 2

Hypothesis of a bundle was tested. When a white ball is bundled with a white hat 75% of customers buy the bundle.

Source: www.bscdesigner.com What change will lead to more sales?

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• It is not a real business case, but I think you do agree that we are faced with situations like this very often:

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• Our CRM system gives us a number, but we don’t know how we can change it.

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• Our CRM system gives us a number, but we don’t know how we can change it.

• We do some survey and sometimes we get some ideas, but they might not be coherent with real customers’ actions.

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• We obverse and do some conclusion about what might work

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• We obverse and do some conclusion about what might work

• We try various options and it appeared that something unmentioned works better

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• It is obviously that the company needs to do some more tests or conduct more specific surveys to understand the challenge better.

BSC DESIGNER

ALL THESE APPROACHES MIGHT GIVE CONTRADICTORY RESULTS

• It is obviously that the company needs to do some more tests or conduct more specific surveys to understand the challenge better.

• Finding leading metrics is actually about finding a solution that works.

FINDING EXCELLENT LEADING MEASURES

BSC DESIGNER

HOW TO FIND A BETTER LEADING MEASURE

• We need to have a balance between various measurement methods.

BSC DESIGNER

HOW TO FIND A BETTER LEADING MEASURE

• We need to have a balance between various measurement methods.

• We need to combine the results of calculations, the survey results, the results of observations and the results of tests under artificial conditions.

BSC DESIGNER

SAFETY RULES NEED TO BE FOLLOWED

• Have your business context in mind. We don’t want to measure something just because we can measure it.

BSC DESIGNER

SAFETY RULES NEED TO BE FOLLOWED

• Have your business context in mind. We don’t want to measure something just because we can measure it.

• Don’t believe people who tell you that it is impossible to measure, as it is possible to quantify and measure anything [2].

BSC DESIGNER

SAFETY RULES NEED TO BE FOLLOWED

• If you cannot quantify something then you need to decompile the subject into measurable pieces

BSC DESIGNER

SAFETY RULES NEED TO BE FOLLOWED

• If you cannot quantify something then you need to decompile the subject into measurable pieces

• Combine various measurement and research methods like calculations, surveys, observations and a/b tests.

BSC DESIGNER

• [1] Aleksey Savkin, The difference between quantification, measure, metric, and KPI, January 2014, BSCDesigner.com

• [2] Douglas W. Hubbard, “How to Measure Anything: Finding the Value of Intangibles in Business”, 2007, Wiley; 1 edition

RESOURCES

BSC DESIGNER

MORE ABOUT THE BALANCED SCORECARD

Find more insightful articles about the Balanced Scorecard in ”Articles” section at www.bscdesigner.com

BSC DESIGNER

BSC DESIGNER

THANK YOU!

Feel free to send us your questions using the contact form at www.bscdesigner.com

top related