7 Steps to Calculate Measurement Uncertainty

7-steps-to-calculate-measurement-uncertainty-600px

Calculating measurement uncertainty is not easy. In fact, I speak with people every day who are having problems with estimating uncertainty. Therefore, I decided to put together this guide disclosing my exclusive seven step process to calculating measurement uncertainty.

In this guide, you will learn how to calculate measurement uncertainty in seven easy steps. Also, you will learn what information you need to calculate uncertainty, how to identify contributors to uncertainty, and how to evaluate your calculations to prevent overestimating or underestimating uncertainty. Furthermore, I will share with you some of my exclusive tips to help you calculate uncertainty like a pro.

Now, this guide is not a complete “how to” manual. Nor, will it answer all of your questions. Instead, it should be used as a quick reference guide to simplify the uncertainty estimation process into seven steps and learn some of my personnel secrets used when I calculate uncertainty.

So, read this guide and use my advice to help you calculate uncertainty. If you have questions, make sure to contact me or leave a comment. Additionally, feel free to use this guide to help you write an uncertainty procedure for your laboratory.

 
Click here to download the simple uncertainty calculator for free!

 

1. Specify the Process and Equation

Before you dive in and begin calculating uncertainty, it is best to have a plan. The first part of your plan should be to identify the measurement process or system that you wish to evaluate.

To help you out, start by answering the following questions;

-What are you measuring?
-How will you measure it?
-What equipment will you use?
-Who will perform the measurements?
-Where will the measurements be performed?
-What factors may affect the measurement results?

After answering these questions, use your answers to identify what measurement process you are evaluating. Once you have identified what you are evaluating, you move on to the step.

If you are performing indirect measurements that require you to calculate your measurement results, you should specify the equation used. This is because each variable in the equation will have its own uncertainty, which will directly affect the uncertainty associated with the calculated result.

To help you out, think of using dead weight testers or calibrating torque transducers and standard resistors. Each of these measurement processes require you to use an equation to calculate a result for comparison purposes. To estimate uncertainty, you will want to break down the equation and evaluate the uncertainty of each variable.

2. Identify and Characterize the Uncertainty Sources

Now that you know your measurement process, you need to identify the factors that influence uncertainty in measurement results. This process is not always easy and can get frustrating. So, stay calm, be patient, and keep researching. You may be surprised by how many influences can affect your measurement results.

Before you begin, I recommend that you find a book or guide on the measurement process you are evaluating. Physics, Chemistry, and Engineering textbooks can come in handy for understanding background and detailed information about your measurement process. If new textbooks are too expensive, you should be able to buy reasonably priced used books on websites like Ebay, Amazon, Chegg, or Half.com.

Other resources that you may want to consider are ASTM and ISO methods. However, if you like free resources (like I do), you may want to search National Metrology Institute websites, such as NIST, NPL, and BIPM. They may have downloadable guides related to your specific measurement processes.

If you are evaluating an equation, then the process is a little different. You will want to identify each variable in the equation and think about what influences each variable.
For example, if you are evaluating the calibration of a torque transducer, you will first write out the equation.

 

torque-calibration-equation-600px

 

When you evaluate the equation further, you begin to account for other factors that influence the equation. In this example, we begin to consider the radius of the torque arm and cable, the mass of the weights and pan, and the local gravity. If needed, we can evaluate the equation even further to account for more influences and increase the complexity of our uncertainty analysis.

 

torque-calibration-equation-2-600px

 

Now that you have identified the equation and the variables, you can start to research what factors may cause changes or variations to each variable. Using my example, think about how temperature variations can cause thermal linear expansion or contraction of the radius, or how friction or cable strain can vary the magnitude of applied force.

Evaluating equations can sometimes be easy, but it can become quite difficult depending on the complexity of the equation. Knowing the rules for the propagation of uncertainty can come in handy in step 5.

3. Quantify the Magnitude of Uncertainty Components

Before calculating measurement uncertainty, you must first determine the magnitude of each contributing factor. To accomplish this, you may need to perform some data reduction and analysis.

To get started, you may want to gather the following items. They will be helpful when analyzing data.

-Calibration Reports
-Repeatability and Reproducibility (R&R) Studies
-Experiment Results
-Manufacture Manuals and Specifications
-Technical Documents and Guides
-Published papers, studies, journal articles, etc.

Using the items listed above, you should be able determine how much uncertainty is contributed from each source. If you need help, you can contact me for additional guidance or hire me to analyze the data for you.

One trend that I have observed over last five years is accreditation bodies and assessors want to see Type A data in your uncertainty analysis. This is data collected from Repeatability and Reproducibility studies. If you have not included this data, I recommend that you make it a priority. If you need help, you read my article “How to Perform A Repeatability Test.”

Now, I know that you are thinking, “How do I determine the magnitude of these weird influences I found in a textbook, journal article, or that my assessor told me to consider?” Most likely, you are not NIST or a research laboratory capable of testing the physical influences that you have read or been told about. So, in these cases, simulation experiments can come in handy.
Simulation experiments are simply the mathematical estimation of outcomes using equations and varying the input variables to see how it changes the output variable.

While it may sound difficult, simulation can be pretty easy to do yourself using an excel spreadsheet. Using our example in step 2, create a calculator in your excel spreadsheet. Next, simulate an experiment by varying your inputs (preferably one at a time) and monitoring the variation of the output.

From the example in step 2, think about how a change in temperature can influence the linear expansion of the torque arm. If you know approximately how much the temperature in your laboratory varies, you can calculate the approximate linear expansion of your torque arm and determine the magnitude of change in the calculated value of torque.

This is how simulation works, and I recommend that you give a try. If my explanation does not make much sense to you, send me an email telling me you need more explanation. I will be glad to write an article about it.

Once you have analyzed your data and determined the magnitude of each uncertainty source, you will want to use an uncertainty budget help you calculate your total expanded uncertainty. Uncertainty budgets are a great tool for organizing your data and demonstrating how you calculated your estimation of measurement uncertainty. I recommend that you use one.

uncertainty-budget-example-2015-600px

4. Convert Uncertainty Components to Standard Deviation Equivalents

The hardest part of the uncertainty analysis is complete, now you can focus on the easier process of calculating measurement uncertainty. To begin, you need to reduce each uncertainty contributor to a standard deviation equivalent.

This process starts with identifying a probability distribution that characterizes or resembles the dispersion of your data set. You should choose a probability distribution for each uncertainty contributor. If you are not sure which probability distribution best describes your data, most people choose the Rectangular distribution by default.

Some of the most common probability distributions used are;
-Normal or Gaussian
-Rectangular or Uniform
-Triangular
-Log-Normal
-Quadratic
-U-shaped

Use the following chart to help you select the appropriate probability distribution.

probability-distribution-chart-600px

Once you select a probability distribution, you can identify the equation to reduce each uncertainty contributor to a standard deviation. This will reduce each source to a 1-sigma equivalent, so you can properly combine them in the next step. Make sure to perform this task for each uncertainty contributor that you quantified in step 3.

5. Calculate the Combined Standard Uncertainty

After you have reduced your uncertainty sources to standard deviation equivalents, it is time to combine them. To accomplish this, you will use the root sum of squares method or RSS. This will mathematically combine your uncertainty sources in quadrature. So, keep reading to learn how to combine uncertainty.

To begin, simply square the value of each uncertainty source. Next, add them all together to calculate the sum (i.e. the sum of squares). Then, calculate the square-root of the summed value (i.e. the root sum of squares). The result will be your Combined Uncertainty.

If you are a more visual learner, like me, take a look at the process below to see if it makes more sense.

 

 

combined-uncertainty-equation-400px

 

Both equations yield the same result. So, use the equation that is best for you. If you are using an excel spreadsheet calculator, you may find this function beneficial.

=SQRT(SUMSQ(cell1,cell2,…)

When you combine uncertainty sources, you are also combining the probability distributions. According to the Central Limit Theorem, the sum of the set of independent random variables (i.e. uncertainty sources) will approach a normal distribution regardless of the individual variable’s distribution. Simply, the probability distribution associated with your combined uncertainty will now be normal.

If you need visual guidance, use the image below to see if it helps you understand.

combining-uncertainty

 

6. Calculate the Expanded Uncertainty

You are now entering the home stretch, so stay with me. I am going to show you how to calculate expanded uncertainty. In this step, you are going to expand your combined uncertainty to an acceptable level of confidence.

To satisfy ISO/IEC 17025:2005 requirements, you must expand uncertainty to approximately 95%. Most people use an expansion factor (k) of 2 to achieve a confidence interval of 95.45%. However, you can also use an expansion factor of 1.96 for a confidence interval of exactly 95.00%.

The choice is yours. Just make sure to select an expansion factor that you will consistently use in each of your uncertainty analyses. Also, it helps to know why you chose your expansion factor so you can justify it to assessors (if they ask).

Use the image below to see the breakdown of the normal probability distribution when expand your estimate to 2-sigma or 95.45% confidence.

measurement-uncertainty-expansion-factor-600px

To calculate your expanded uncertainty, simply multiply the expansion factor (k) and the combined uncertainty (CU). The result will be your expanded uncertainty (EU).

expanded-uncertainty-equation-250px

That’s it! You have just calculated your expanded uncertainty and completed the estimation of uncertainty in measurement. However, you are not done yet. I recommend that you verify your calculations. In the next section, I will tell you how to evaluate uncertainty calculations for appropriateness.

7. Evaluate Uncertainty for Appropriateness

Once you have calculated the expanded uncertainty, it is best to evaluate your uncertainty estimate for appropriateness. Essentially, you want to make sure that your measurement uncertainty estimate adequately represents your measurement process and is not overestimated or underestimated.

A good place to start your evaluation is to check and verify that your uncertainty estimate is larger than the Reference Standard Uncertainty, or the uncertainty that was reported in your equipment’s calibration certificates.

Next, try looking at other laboratories scopes of accreditation to verify your uncertainty calculations are reasonably comparable. I personally recommend that you review at least 3 to 5 other scopes. Make sure your estimates are relatively similar to other laboratories. If not, you may have overestimated or underestimated uncertainty.

Then, check the BIPM Key Comparison Database to make sure that you are not reporting uncertainty that is less than any national metrology institutes. I know this may sound silly, but I have observed other laboratories making this mistake. So, do yourself a favor and double-check your uncertainty calculations.

Finally, perform a Repeatability and Reproducibility study in your laboratory. Verify that your results are not larger than your uncertainty estimation. If so, you may have understated your uncertainty estimates.

Evaluating your uncertainty estimates are critical. You do not want to go through all the work of calculating measurement uncertainty only find mistakes during an assessment. It is better to perform the hard work upfront than deal with all the paperwork and headaches that result from being cited a deficiency.

download-measurement-uncertainty-guide-isobudgets-600px

Conclusion

In this guide, I have laid out seven steps to help you calculate measurement uncertainty. While this is not a complete how-to guide, I have given you plenty of information to help you perform uncertainty estimation yourself. So, start estimating uncertainty and tell me what works for you and what you struggle with.

If you have additional questions or suggestions that will help improve this guide, leave a comment/contact me. I will glad to hear your feedback.

References

Castrup, H. (2007). Distributions for Uncertainty Analysis. Bakersfield, CA: Integrated Sciences Group.

Miller, V. (2002). NISTIR 6919: Recommended Guide for Determining and Reporting Uncertainties for Balances and Scales. Gaithersburg: National Institute of Standards and Technology.

United Kingdom Accreditation Service. (2012). M3003: The Expression of Uncertainty and Confidence in Measurement. Middlesex: United Kingdom Accreditation Service.

Posted in:
About the Author

Richard Hogan

Richard Hogan is the CEO of ISO Budgets, L.L.C., a U.S.-based consulting and data analysis firm. Services include measurement consulting, data analysis, uncertainty budgets, and control charts. Richard is a systems engineer who has laboratory management and quality control experience in the Metrology industry. He specializes in uncertainty analysis, industrial statistics, and process optimization. Richard holds a Masters degree in Engineering from Old Dominion University in Norfolk, VA. Connect with Richard on Google+ and LinkedIn.

13 Comments

  1. hello
    Our lab we have calculate temperature rising of windings
    as following
    (R2-R1)/R2 )*(234,5+t)= result C
    do you have this kindhf of UM budget
    R2: winding of hot measurement (at the and of tests)
    R1: cold winding
    234,5 is constant for cupper
    t: lab room temperature
    I need your helps thank you

  2. hello Richard,
    thanks for good and useful guides for calculating the uncertainty.
    now I have a question, we do the Photometry test at laboratory. for each test the manual adjusting , temperature , the aging time, sensor and goniometer are effect on the uncertainty value. how can I calculate the amount of uncertainty individual?

  3. Hello Mr Richard
    Thanks for your guidance in uncertainty calculation. But, sir, very surprising to see that uncertainty may be adjusting (maximize or minimize) to make uncertainty budget. Could we move according to our budget. How could I make uncertainty budget. Pl simplify in very simple way. Detail are as follows:

    Equipment used: Balance , stop watch, volome of cell, room temp 28 degree celcius. SRM expanded uncertainty = +/- 7.6. pl explain budget.
    for any query ,may mail us on sahaygstjan2017@gmail.com. Equipment
    are used in determination of Blaine Fineness of Cement, as per Indian
    standard IS 4031 (Part 2), by Blaines Apparatus.

    s n sahay

  4. Hi Richard,

    Thanks for a good and useful guides for calculating the uncertainty.
    please i have a question.
    lately we calibrated our reference instrument in XXX Lab.
    they gave us a cal certificate without uncertainty value, they just gave us the error and percent of tolerance.
    my question how can i get the uncertainty?, or can i take the uncertainty from the tolerance? . if yes please how?

    Many thanks

    • Hi Marwa,

      Was the calibration ISO/IEC 17025 accredited?

      If so, the statement or estimate of uncertainty in measurement should have been included in the report. Either way, I would contact the laboratory and ask them to provide you with the test or calibration uncertainty.

      I hope this helps.

      Best regards,

      Rick

Leave a Reply

Your email address will not be published. Required fields are marked *