I’ve gotten this question a few times recently, basically asking if it’s OK to plot metrics like these on a Process Behavior Chart (PBC):
- Weekly average emergency patient waiting time
- Monthly average lost sick days
- Daily median waiting time for clinic patients
The concern gets expressed in terms of, “I was taught it was dangerous to take an average of averages.” See here for an example of that math dilemma, which is worth paying attention to in other circumstances. We don’t need to worry about it with PBCs.
In a PBC, we are plotting a central line that’s usually the average of the data points that we are analyzing. So, it’s an average of averages, but it’s less problematic in this context.
I asked Donald J. Wheeler, PhD about this and he replied:
“The advantage of the XmR chart is that the variation is characterized after the data have been transformed.Thus, we can transform the data in any way that makes sense in the context, and then place these values on an XmR chart.“
PBC is another name for the XmR chart method.
In his excellent textbook Making Sense of Data, Wheeler plots weekly averages with no warnings about that being problematic, as shown here:
I did an experiment with a made up data set.
The data consist of individual patient waiting times. The only thought I put into it was that waiting times might get longer as the day goes on, so I built in some of that.
When I look at the PBC of individual waiting times, it’s “predictable” (or “in control”) with an average of 31.42. The limits are quite wide, but I don’t see any signals. I had 7 consecutive above the average (dumb luck in how I entered the data). I could see a scenario where, for example, afternoon waiting times are always longer than morning waiting times, so we could see daily “shifts” in the metric perhaps).
I then plotted the average waiting time for each of these 5 days (using a minimal number of data points to test these charts with admittedly minimal effort to start).
The average of the averages is 33.23. Not a huge difference.
The PBC for the daily averages is also predictable, with narrower limits, as I’d expect.
I think it’s fine to plot a series of averages. What matters most is how we interpret the PBCs — to avoid overreacting to every up and down in the data, for example.