Physics 1 AP C: Errors and Uncertainties

(with a bit on sigfigs thrown in for good measure)


"...we measure shadows, and we search among ghostly errors of measurement that are scarcely more substantial. The search will continue. Not until the empirical resources are exhausted need we pass on to the dreamy realm of speculation." -- Edwin Hubble, The Realm of the Nebulae (1936)

Uncertainty

To physicists the terms "error" or "uncertainty" do not mean "mistake". Mistakes, such as incorrect calculations due to the improper use of a formula, can be and should be corrected. However, even mistake-free lab measurements have an inherent uncertainty or error.

Consider the dartboards shown below, in which the 'grouping' of thrown darts is a proxy for our laboratory measurements. A 'precise' measurement means the darts are close together. An 'accurate' measurement means the darts hit close to the bullseye. Notice the combinations:
Measurements are precise,
just not very accurate
Measurements are accurate,
but not precise
Measurements neither
precise nor accurate
Measurements both
precise and accurate

There are several different kinds and sources of error:

  1. Actual variations in the quantity being measured, e.g. the diameter of a cylindrically shaped object may actually be different in different places.

    The remedy for this situation is to find the average diameter by taking a number of measurements at a number of different places. Then the scatter within your measurements gives an estimate of the reliability of the average diameter you report. Note that we usually assume that our measured values lie on both sides of the 'true' value, so that averaging our measurements gets us closer to the 'truth'.

    Another approach, especially suited to the measurement of small quantities, is sometimes called 'stacking.' Measure the mass of a feather by massing a lot of feathers and dividing the total mass by their number.

  2. Systematic errors in the measuring device used.

    Suppose your sensor reports values that are consistently shifted from the expected value; averaging a large number of readings is no help for this problem. To eliminate (or at least reduce) such errors, we calibrate the measuring instrument by comparing its measurement against the value of a known standard.

    It is sometimes quite difficult to identify a systematic error. Get in the habit of checking your equipment carefully. Make a preliminary analysis of your data early in the experiment; if you gather all the data without checking for systematic error, you might have to do it all over again!

  3. Random error: 'sometimes stuff just happens'.

    The reading of a vernier caliper may vary within the members of a lab group because each person reads it slightly differently. Or one observer's estimate of the fraction of the smallest caliper division may vary from trial to trial. The mean value computed from multiple trials averages out some of the random error; repeated measurements are required. Some people even say "one measurement is no measurement."

    Another subtlety is the recognition of 'outlying' or 'low probability' data points. If justifiable (and that often takes some thought), excluding 'bad data' will reduce your error.

General Procedure:

  1. Always take your measurements in multiple trials.
  2. Find the mean of your set of measurements.
  3. Find the absolute value of the difference between each measurement and the mean value of the entire set.
  4. Find the average of these absolute value deviations: this number is called the "average deviation from the mean."

Average deviation from the mean is a measure of the precision of the measurement: the smaller, the better.

In general, report a measurement as an average value "plus or minus" the average deviation from the mean. Another totally acceptable format is

   % deviation =  100 * average deviation / mean value.

For example, the chart below shows data from an experiment to measure the life of two popular brands of batteries.
(Data from Kung, Am. J. Phys., Vol. 73, No. 8, p.774).
Trial Duracel (hours) Energizer (hours)
111.4 11.6
212.2 7.0
3 7.8 10.6
4 5.3 11.9
510.3 9.0
Averages Duracell: 9.4 hours Energizer: 10.0 hours

The question here is: which brand of battery lasts longer? How can we tell?

Using the 'general procedure' above, calculate the deviation from the mean of each data point. Then calculate the average deviation. Thus we would report battery life for Duracell as '9.4 +/- 2.3 hours'.

Another important consideration when comparing two sets of data: the spread of the data points, sometimes called the range of the measured values. What does it suggest if the range of measurements for the two brands of batteries has a high degree of overlap?

A quantity sometimes used to describe uncertainty is 'Standard Deviation':

You will sometimes hear this phrase, which is a more sophisticated estimate of the uncertainty in a set of measurements than the average discussed above. In most of our lab measurements, 3-5 trials will suffice, so we will live with average deviation (as above) rather than standard deviation.

But in case you are curious, standard deviation is computed as follows:

If M is the mean of N measurements xi, then the standard deviation is

This algebraic expression gives rise to the term 'root mean square error,' (abbreviated RMSE). A related quantity is the variance, which is just the square of the standard deviation. Note that a low RMSE value does not equate to a 'right' answer!

Absolute, Relative and Percentage Uncertainty:

Suppose we want to measure a known quantity that has the value A, but our experiment gives us the mean value m deviation from the mean r. By the average deviation procedure, we report that the measured value is m +/- r. How do we decide if we can live with the size of r?

Showing uncertainty using Graphical Analysis

Once you have your uncertainty of measurement, you can show this quantity on your graphs. Using Graphical Analysis, right click on the data table and select Column Options. Under the Options tab, check Error Bar Calculations, then enter either a percentage, fixed value or put your error numbers into a column of their own and select Use Column.

Calculating uncertainty for a result involving measurements of several independent quantities

If the actual quantity you want is calculated from your measurements, in some cases the calculation itself causes the uncertainties to increase dramatically. Here are the common situations:


Continue on to Significant Figures (eek!)

July 2004

Shamelessly assimilated (resistance is futile!) from: University of Wisconsin Physics Lab Manual