How do random and systematic errors contribute to overall measurement uncertainty

Short answer: They both contribute to the total combined measurement uncertainty. Each error source is converted to a standard deviation equivalent (i.e. standard uncertainty) and combined in quadrature using the square root of the sum of squares (RSS) method to calculate the combined standard uncertainty. Then, the uncertainty can be expanded to a desired confidence interval by multiplying the combined uncertainty by a coverage factor.

How Random and Systematic Errors Contribute to Measurement Uncertainty - Venn Diagram

 

Replacement of Terms: Random and Systematic Uncertainty

According to the GUM (JCGM 100:2008), Recommendation INC-1 (1980) replaced the terms random and systematic uncertainties with Type A and Type B uncertainty.

Random uncertainties would be best associated with Type A uncertainty, where the magnitude of uncertainty is evaluated by statistical methods (typically ANOVA).

Systematic uncertainty would be best associated with Type B Uncertainty, where the magnitude of uncertainty is evaluated by techniques other than statistical means (but not always). Systematic is defined as “of a system.” Therefore, you would want to evaluate sources of uncertainties that are “of the system” and not associated with random uncertainties.


FAQ

What are the main sources of uncertainty?

The main sources of uncertainty in testing and calibration activities are given in the list below. Each of these represent a main category which all other sources of uncertainty can be grouped under.

  • Method
  • Equipment
  • Personnel
  • Environment
  • Item or Unit Under Test
  • Reference Standard

 

How do you determine which sources of uncertainty to include in an uncertainty budget?

Conduct research to find all potential sources of uncertainty associated with the test or measurement, including the method, personnel, equipment, reference standards, environment, and unit or item under test. Evaluate the potential sources of uncertainty and include all significant contributors in the uncertainty budget per ISO/IEC 17025, section 7.6.1.

According to ISO/IEC 17025:2017 section 7.6.1, “Laboratories shall identify the contributions to measurement uncertainty. When evaluating measurement uncertainty, all contributions that are of significance, including those arising from sampling, shall be taken into account using appropriate methods of analysis.

To simplify the ISO/IEC 17025 requirement,

  1. Identify contributions to measurement uncertainty.
  2. Take into account all significant contributors.
  3. Evaluate measurement uncertainty using appropriate methods of analysis.

 

What is a significant contributor to measurement uncertainty?

According to A2LA R205 section 6, a significant contributor is defined as any source of uncertainty that causes the CMC Uncertainty to increase by five percent (5 %) or more.

This definition is unique to A2LA. Confirm with your accreditation body that 5 % is acceptable. Although not written, some accreditation bodies recommend a 10 % increase makes the uncertainty a significant contributor. Others want all potential sources of uncertainty included no matter the percentage of contribution.

Finally, consider the percentage as relative to the CMC Uncertainty, not as an absolute value.

 

What are the most significant sources of uncertainty in laboratory measurements?

The most significant sources of uncertainty vary with each type of test, measurement, and measurement system. However, some of the most common sources of uncertainty that significantly affect measurement results include:

  • Repeatability,
  • Reproducibility,
  • Resolution,
  • Drift or Stability,
  • Bias,
  • Reference Standard Uncertainty,
  • Environmental Contributors, and
  • Method-specific Contributors.

 

Every test and measurement is different. Likewise, the most significant contributors will not be the same.

Some tests and measurements will be heavily influenced by repeatability and reproducibility. Some will be significantly affected by drift or bias while others are significantly impacted by instrument resolution or environmental factors.

The only way to know which sources are the most significant is to evaluate measurement uncertainty and calculate the percentage of the total variance (i.e. Factor Analysis) each source of uncertainty has on the combined standard measurement uncertainty.

 

How to calculate the most significant sources of uncertainty?

To determine the most significant sources of uncertainty, conduct a Factor Analysis to calculate the proportion or percentage of the total variance. The sources of uncertainty with higher percentages will be the most significant.

Follow the instructions below to calculate the percentage of total variance:

  1. Calculate the variance – square each standard measurement uncertainty.
  2. Calculate total variance – square the combined standard measurement uncertainty.
  3. Divide each variance by the total variance.
  4. Multiply the result by 100 to convert it to a percentage.
  5. Find the uncertainties with the higher percentages.

 

How do random and systematic errors contribute to overall measurement uncertainty?

They both contribute to the total combined measurement uncertainty. Each error source is converted to a standard deviation equivalent (i.e. standard uncertainty) and combined in quadrature using the square root of the sum of squares (RSS) method to calculate the combined standard uncertainty. Then, the uncertainty can be expanded to a desired confidence interval by multiplying the combined uncertainty by a coverage factor.

According to the GUM (JCGM 100:2008), Recommendation INC-1 (1980) replaced the terms random and systematic uncertainties with Type A and Type B uncertainty.

Random uncertainties would be best associated with Type A uncertainty, where the magnitude of uncertainty is evaluated by statistical methods (typically ANOVA).

Systematic Uncertainty would be best associated with Type B Uncertainty, where the magnitude of uncertainty is evaluated by techniques other than statistical means (but not always). Systematic is defined as “of a system.” Therefore, you would want to evaluate sources of uncertainties that are “of the system” and not associated with random uncertainties.


Glossary

Significant Contributor (to Uncertainty)
an uncertainty contributor whose contribution increases the CMC uncertainty by five percent (5%) or greater. (Source: A2LA R205, 6.0)
Combined Standard Measurement Uncertainty
standard measurement uncertainty that is obtained using the individual standard measurement uncertainties associated with the input quantities in a measurement model. (Source: JCGM 200:2012, 2.31)
Measurement Repeatability
measurement precision under a set of repeatability conditions of measurement (Source: JCGM 200:2012, 2.21)
Repeatability Condition of Measurement
condition of measurement, out of a set of conditions that includes the same measurement procedure, same operators, same measuring system, same operating conditions and same location, and replicate measurements on the same or similar objects over a short period of time (Source: JCGM 200:2012, 2.20)
Measurement Reproducibility
measurement precision under reproducibility conditions of measurement (Source: JCGM 200:2012, 2.25)
Reproducibility Condition of Measurement
condition of measurement, out of a set of conditions that includes different locations, operators, measuring systems, and replicate measurements on the same or similar objects (Source: JCGM 200:2012, 2.24)
Instrumental Drift
continuous or incremental change over time in indication, due to changes in metrological properties of a measuring instrument (JCGM 200:2012, 4.21)
Instrumental Bias
average of replicate indications minus a reference quantity value (JCGM 200:2012, 4.20)
Measurement Bias
estimate of a systematic measurement error (JCGM 200:2012, 2.18)
Resolution
smallest change in a quantity being measured that causes a perceptible change in the corresponding indication (JCGM 200:2012, 4.14)
Reference Measurement Standard
measurement standard designated for the calibration of other measurement standards for quantities of a given kind in a given organization or at a given location (JCGM 200:2012, 5.6)
Type A Evaluation of Measurement Uncertainty
evaluation of a component of measurement uncertainty by a statistical analysis of measured quantity values obtained under defined measurement conditions (JCGM 200:2012, 2.28)
Type B Evaluation of Measurement Uncertainty
evaluation of a component of measurement uncertainty determined by means other than a Type A evaluation of measurement uncertainty (JCGM 200:2012, 2.29)