Smith MW, Ma J, Stafford RS., J Clin Epidemiol. 63(2):180-4. doi: 10.1016/j.jclinepi.2009.06.001. Epub 2009 Aug 27., 2010 Feb 01
Abstract
OBJECTIVE: A common form of validation study compares alternative methods for collecting data. The Bland-Altman plot pairs observations across methods and plots their mean values vs. their difference. This method provides only limited information, however, when the range of observed values is small relative to the number of observations. This brief report shows how adding a simple bar chart to a Bland-Altman plot adds essential additional information.
STUDY DESIGN AND SETTING: The methodological approach is illustrated using data from a randomized controlled clinical trial of patients in a U.S. county health system.
RESULTS: When the number of unique values is small, a Bland-Altman plot alone may provide inadequate information. Adding a bar chart yields new and essential information about agreement, bias, and heteroscedasticity.
CONCLUSION: Studies validating one data-collection method against another can be performed successfully even when the number of unique values is small.