Which Performance Measure Method Produces the Best KPIs

by Stacey Barr

This research shows with performance measure method produces KPIs that have the best scores based on 13 KPI Excellence Criteria.

Which Performance Measure Method Produces the Best KPIs? Credit: https://www.istockphoto.com/portfolio/Andy_Di

One of my ongoing research projects is to find out how the KPIs in my readers’ organisations score across 13 criteria of KPI excellence. So far, the overall score is 66% on a 100% scale.

But that’s not a number you can do anything useful with. What’s useful is to dive into what produces this number, such as the performance measure methods used. And that’s a good place to start: what are the KPI methods that the researched organisations use?

Which performance measure methods do organisations use?

The most commonly used performance measure methods were PuMP and, if you believe it’s a true performance measurement method, the Balanced Scorecard (but I don’t believe it is). There were very few mentions of Lean and Six Sigma as methods, too.

The most important point, however, is that the vast majority of organisations have no formalised performance measurement method at all.

Graph: Performance Measure Methods Used

This adds a limitation to what we can draw from this research. The vast majority of people who responded work in organisations likely to have low measurement maturity and, therefore, high misunderstanding of what good performance measurement is. This means at least two things:

  1. They will mistakenly think things like spreadsheets, brainstorming, SMART, and working groups are proper KPI methods.
  2. They will overestimate the goodness of their KPIs.

Consequently, we won’t see as much spread in the scores of KPI excellence. In fact, we see hardly any low scores at all. And that’s surprising because it doesn’t match what we see in reality.

Even though we need to take care interpreting this research data, let’s jump to the punchline: which performance measure method produces the best KPIs?

Which performance measure methods lead to the best KPIs?

Even with the very narrow spread of KPI Excellence scores, given the overestimation mentioned above, it appears that PuMP still stands out as the leader:

Graph: KPI Excellence Score by Method Used

It’s got me very curious what the custom approaches are that some organisations are using… But given the top three scoring KPI methods are, indeed, real KPI methods, the results are not surprising: a deliberate approach to performance measurement will produce better KPIs.

What exactly does a deliberate performance measure approach do, to produce better KPIs?

So, how can organisations get better KPIs?

The research was, as mentioned, based on 13 criteria of excellent KPIs. For those organisations that scored the lowest on the KPI Excellence Assessment, these were the five criteria that were their weakest:

  • Criterion 2: Measures are created for results-oriented goals. One of the biggest misunderstandings in measurement is the difference between action and result. Too many KPIs track the activity to achieve a goal, but the good ones track the result implied by the goal.
  • Criterion 3: Measures are direct evidence of the goals. The KPIs used by organisations with lower measurement maturity are often the easy-to-get metrics, and tend not to be very relevant.
  • Criterion 10: Measures drive performance-improving behaviour. One of the big reasons that organisations have low measurement maturity is that measures are still perceived as tools for judgement, not for learning and improving processes.
  • Criterion 11: Measures are connected in linked relationships with each other. Relationship links that align performance measures to each other is an advanced measurement concept, so it’s unlikely to be a strength for most organisations.
  • Criterion 13: The users of the measures value them in decision-making. Naturally, this is weak when several of the other criteria are weak too. Poor KPIs are rarely considered valuable.

Needless to say (or is it?), these criteria were also scored lowest by organisations that had no formal performance measure approach. For me, this was the biggest message from the research: most organisations still don’t have a deliberate KPI approach, and they clearly need one.

 

If you want better KPIs, you have to care about the KPI approach you take. Research is showing that PuMP is the best approach.
[tweet this]

Speak Your Mind

Your email address will not be published.

  1. Rob Leeming says:

    Hi Stacey,

    The maturity of the business is key to the approach when implementing meaningful measures, and a solid maturity assessment will enable the appropriate approach to be targeted to improve the embedding of the PuMP methodology and development Meaningful Measures.
    Reading comments posted by PuMP practitioners, they have had success by implementing aspects of PuMP methodology to show benefit and get traction for their measures transformation, Hard-To Measure Teams illustrates a different initial approach when implementing PuMP.
    I am looking understand how the Performance Measurement Maturity Score discussed in the “Calculate Your Performance Measurement Maturity Score” aligns with “The Stages of Performance Excellence” within the Hard-to-Measure Teams online training and how the Business measures maturity can influence the way you utilise and implement the PuMP methodology.

    • Stacey Barr says:

      Rob, the hard-to-Measure Teams online training is quite old now, and only available to PuMP Community members like yourself. So the stages of performance excellence in that training has been superseded by the more recent evolution in the Performance Measurement Maturity Score we use now in Step 1 of PuMP. There will be some kind of correlation between the old and the new, but all these models are just models, and none of them can be the complete truth. Use what you find useful.

Upcoming KPI Training


Our next PuMP Performance Measure Blueprint Workshops include:

>> North America, Online Interactive, 6-10 Jun 2022

>> Africa, Online Interactive, 20-24 Jun 2022

>> Australia/NZ/Asia Pacific, Online Interactive, 17-18 & 22-24 Aug 2022

>> Africa, Online Interactive, 17-19 & 23-24 Aug 2022

>> Africa, Online Interactive, 26-30 Sep 2022

>> North America, Online Interactive, 27-28 Sep & 4-6 Oct 2022

>> Africa, Online Interactive, 28 Nov - 2 Dec 2022

>> North America, Online Interactive, 28 Nov - 2 Dec 2022

Register for the next PuMP Blueprint Workshop near you

Stacey's Books


Prove It! How to Create a High-Performance Culture and Measurable Success, book by Stacey Barr

Order Prove It! here.

Practical Performance Measurement: Using the PuMP Blueprint For Fast, Easy, And Engaging KPIs, book by Stacey Barr

Order Practical Performance Measurement here.

Reprinting Articles


You are welcome to use articles from the Measure Up blog, with these requirements

Connect with Stacey


Haven’t found what you’re looking for? Want more information? Fill out the form below and I’ll get in touch with you as soon as possible.



    *We respect your email privacy.
    Level 54, 111 Eagle Street
    Brisbane, Qld, 4000
    Australia
    Stacey Barr Pty Ltd
    ACN: 129953635
    Director: Stacey Barr