When You Don’t Have the Right Data, Use a Proxy Measure

by Stacey Barr |

Have you ever designed a new performance measure – a powerful one you felt excited about – and then discovered the data you needed was not in the right format or detail? Of course you have! It’s a common challenge when you decide to measure something more deliberately or more meaningfully than you have in the past. But don’t let the data problems put an end to your powerful new measure!

Proxy measures or proxy KPIs are stand-ins for the ones you can’t get yet

We won’t ever get the data we need, or the measures that matter, if we let our existing data constrain our choice of measures. Sometimes we can immediately repair the data situation, but often we have to wait until the time is right. In the meantime, we can use proxy measures to stand in for our ideal measures.

Illustrating this point, as part of their suite of strategic performance measures, a municipality designed a new measure to support their goal of reducing their environmental impact. The measure they wanted was Electricity Consumption, the total kilowatt hours of electricity they consume through their operations, by month.

But when they attempted to source the data for Electricity Consumption, they could not get any raw data about their actual monthly consumption. The only data they could get (from their electricity provider) was electricity meter readings. And to make it a bigger challenge, these readings were taken at varying locations, at varying points of time throughout each month, and at varying intervals ranging from less than a month through to approximately quarterly. Messy!

They were ready to give up. And the reason they felt like giving up was that they were fixated on the notion that performance measure values have to be accurate. That notion is a fallacy. The power of performance measures is in the patterns of how their values change over time, not in the actual individual values themselves. In PuMP we have a mantra for this: “patterns, not points!”

So the data from the irregular meter readings would be highly correlated over time with electricity consumption. And so it was used to compute a proxy measure of Electricity Meter Readings. And particularly when we use XmR charts to help us focus on the patterns, not the points – or the signals, not the noise – we can still draw conclusions about changes in Electricity Consumption, based on the proxy measure of Electricity Meter Readings. Trends over time are more accurate than the points that make them up.

That’s because the errors in the proxy measure, due to the irregularity of meter readings, are accounted for in the variability measured by the XmR chart. So signals of change in Electricity Meter Readings are indicative of change in Electricity Consumption. Proxy measures can be very powerful, even if they lack accuracy.


Do you use any proxy measures? Do you agree it’s far better to have a proxy than no information at all?


Leave a Reply to Stacey Barr Cancel reply

Your email address will not be published. Required fields are marked *

  1. Re: “The power of performance measures is in the patterns of how their values change over time, not in the actual individual values themselves” – if only we could convince management to think this way instead on focusing on the one game winning/losing streak!

    Thanks Stacey for this quote

    • Stacey Barr says:

      Bill I’d love that quote to be shared far and wide. It’s the most frustrating behaviour I see in leaders, and it must change if we have any hope of organisations ever being managed in a truly evidence-based way.

  2. Love it! Could (should) have been a chapter in Hubbard’s “How to Measure Anything!”


Upcoming KPI Training

Our next PuMP Performance Measure Blueprint Workshops include:

>> Australia/NZ/Asia Pacific, Online Interactive, 6-7, 11-13 Oct 2021 *REGISTRATION CLOSED*

>> Africa, Online Interactive, 11-15 Oct 2021

>> United Kingdom, Online Interactive 5, 12, 19, 26 Nov & 3 Dec 2021

>> Australia/NZ/Asia Pacific, Online Interactive, 10-11, 15-17 Nov 2021

>> North America, Online Interactive, 15-19 Nov 2021

>> Africa, Online Interactive, 14-18 Mar 2022

>> Africa, Online Interactive, 20-24 Jun 2022

>> Africa, Online Interactive, 26-30 Sep 2022

>> Africa, Online Interactive, 28 Nov - 2 Dec 2022

Register for the next PuMP Blueprint Workshop near you

Stacey's Books

Prove It! How to Create a High-Performance Culture and Measurable Success, book by Stacey Barr

Order Prove It! here.

Practical Performance Measurement: Using the PuMP Blueprint For Fast, Easy, And Engaging KPIs, book by Stacey Barr

Order Practical Performance Measurement here.

Reprinting Articles

You are welcome to use articles from the Measure Up blog, with these requirements

Connect with Stacey

Haven’t found what you’re looking for? Want more information? Fill out the form below and I’ll get in touch with you as soon as possible.

    *We respect your email privacy.
    Level 54, 111 Eagle Street
    Brisbane, Qld, 4000
    Stacey Barr Pty Ltd
    ACN: 129953635
    Director: Stacey Barr