Measurement Systems Analysis For Variables Data:

Measurement Precision Calculator

Version 1.0, August 2002

Introduction

Welcome to the Measurement Precision Calculator. This workbook will help

perform the calculations for Measurement Precision Studies as described
in the IPC test method IPC-TM 1.9.

This software is useful in cases where the measurement data is recorded

as variables data and recoreded on a continuous scale.

Please refer to the test method before beginning the measurement precision study.
The test method defines the terms and equations used in detail.
Also refer to the User Guide for detailed instructions..

This workbook includes the following

- A blank spreadsheet to enter measurements
- A spreadsheet with example data
- A form for manual data entry, if desired.
- Further information on the K factors used in the calculations

The title cells on the spread sheet have been color coded to aid understanding.
The following is the color key:

Color Usage
General title
Cells for user to enter data
Title cells for test condition related data
Title cells for data related to repeated readings
Title cells for sample related data
Title cell for calculated data
 Study:___________________

Measurement Precision Study: Information Sheet

Version 1.0, August 2002

Enter data into yellow areas.

Test Method

Parameter Measured

Company

Name of Study Organizer

Study Completion Date

Instrument

Measurement Units

Lower Specification Limit, LSL

Upper Specification Limit, USL

Number of Test Conditions, m K2 3.65

Number of Samples, n K3 3.65

Number of Repeat Readings, k K1 4.57

Entering Raw Data:

Raw measurement data is to be entered on the following area of this worksheet.
The sheet is set up for up to 10 different test conditions, up to 5 repeated measurements on up to 10 samples.
The actual number of conditions, measurements, and samplesshould be determined for each study.
Test conditions could include different operators, test equipment or test locations, etc.
The greater the number of conditions, measurements, and samples, the more meaningful the results.
 Study:___________________

Measurement Precision Study: Data Entry Sheet

Sample Sample Sample Sample Sample Sample Sample Sample Sample Sample
Condition Reading 1 2 3 4 5 6 7 8 9 10
1 1
2
3
4
5
2 1
2
3
4
5
3 1
2
3
4
5
4 1
2
3
4
5
5 1
2
3
4
5
6 1
2
3
4
5
7 1
2
3
4
5
8 1
2
3
4
5
9 1
2
3
4
5
10 1
2
3
4
5
 Study:___________________

Measurement Precision Study: Calculation Sheet

Ranges: Average
Sample 1 2 3 4 5 6 7 8 9 10 Cond
Condition Ranges
1
2
3
4
5
6
7
8
9
10
Average of the range averages

Averages:
Condition 1 2 3 4 5 6 7 8 9 10
Readings
Set 1
Set 2
Set 3
Set 4
Set 5
Op Avg
Absolute difference of condition averages

Sample 1 2 3 4 5 6 7 8 9 10
Avg
Average of sample averages
Range of sample averages
 Study:___________________
`

Measurement Precision Study: Scorecard

Variability Summary Remarks

Repeatability Standard deviation of the within condition variation

Reproducibility Standard deviation of the between condition variation
Measurement R&r Standard deviation of the measurement process
Process std dev Standard deviation of the product variation
Total Variability Standard deviation of the total observed variation

Product Average Average of all product measurements taken during study

Comparison to Specifications
(Only used when both specifications exist)
% Repeatability Percent of specification width used by repeatability error
% Reproducibility Percent of specification width used by reproducibility error
% Measurement R&r Percent of specification width used by measurement error
Compared to the specification limits, the precision of
this measurement:

Comparison to Total Variation

% Repeatability Percent of total variability used by repeatability error

% Reproducibility Percent of total variability used by reproducibilityerror
% Measurement R&r Percent of total variability used by measurement error
Compared to the total variability, the precision of
this measurement:

Measurement Tolerance

Measurement Tolerance Units

+/- 0 On the basis of this study, there is a 99% chance that

this interval around the measured product performance
will contain the actual product performance level.
 Study:___________________

Measurement Precision Study: Information Sheet

Version 1.0, August 2002

Enter data into yellow areas.

Test Method

Parameter Measured Gasket thickness

Company

Name of Study Organizer

Study Completion Date

Instrument

Measurement Units mm

Lower Specification Limit, LSL 0.6

Upper Specification Limit, USL 1

Number of Test Conditions, m 3 K2 2.7

Number of Samples, n 10 K3 1.62

Number of Repeat Readings, k 2 K1 4.57

Entering Raw Data:

Raw measurement data is to be entered on the following area of this worksheet.
The sheet is set up for up to 10 different test conditions, up to 5 repeated measurements on up to 10 samples.
The actual number of conditions, measurements, and samplesshould be determined for each study.
Test conditions could include different operators, test equipment or test locations, etc.
The greater the number of conditions, measurements, and samples, the more meaningful the results.
 Study:___________________

Measurement Precision Study: Data Entry Sheet

Sample Sample Sample Sample Sample Sample Sample Sample Sample Sample
Condition Reading 1 2 3 4 5 6 7 8 9 10
1 1 0.62 0.99 0.82 0.85 0.59 1.02 0.97 0.85 1 0.61
Station 1 2 0.66 1 0.81 0.89 0.48 1.03 0.97 0.82 1 0.7
3
4
5
2 1 0.53 1.05 0.8 0.83 0.39 1.04 0.97 0.73 0.98 0.54
Station 2 2 0.53 0.93 0.77 0.76 0.4 1.08 0.91 0.7 0.95 0.6
3
4
5
3 1 0.51 1.05 0.8 0.79 0.45 1.01 0.96 0.8 1.04 0.84
Station 3 2 0.55 1.02 0.77 0.81 0.49 1.05 0.96 0.81 1.05 0.81
3
4
5
4 1
2
3
4
5
5 1
2
3
4
5
6 1
2
3
4
5
7 1
2
3
4
5
8 1
2
3
4
5
9 1
2
3
4
5
10 1
2
3
4
5
 Study:___________________

Measurement Precision Study: Calculation Sheet

Ranges: Average
Sample 1 2 3 4 5 6 7 8 9 10 Condition
Condition Ranges
1 0.04 0.01 0.01 0.04 0.11 0.01 0 0.03 0 0.09 0.034
2 0 0.12 0.03 0.07 0.01 0.04 0.06 0.03 0.03 0.06 0.045
3 0.04 0.03 0.03 0.02 0.04 0.04 0 0.01 0.01 0.03 0.025
4 0
5 0
6 0
7 0
8 0
9 0
10 0
Average of the range averages 0.03467

Averages:
Condition 1 2 3 4 5 6 7 8 9 10
Readings
Set 1 0.83200 0.786 0.825
Set 2 0.836 0.763 0.832
Set 3
Set 4
Set 5
Op Avg 0.834 0.7745 0.8285
Absolute difference of condition averages 0.0595

Sample 1 2 3 4 5 6 7 8 9 10
Avg 0.56667 1.00667 0.795 0.82167 0.46667 1.03833 0.95667 0.785 1.00333 0.68333
Average of sample averages 0.81233
Range of sample averages 0.57167

`
Measurement Precision Study: Scorecard
Variability Summary
Repeatability
Reproducibility
Measurement R&r
Process std dev
Total Variability
Product Average
Comparison to Specifications
(Only used when both specifications exist)
% Repeatability
% Reproducibility
% Measurement R&r
Comparison to Total Variation
% Repeatability
% Reproducibility
% Measurement R&r
Measurement Tolerance
Measurement Tolerance
+/- 0.1112439379
Study:___________________
Remarks
0.03076 Standard deviation of the within condition variation
0.03038 Standard deviation of the between condition variation
0.04324 Standard deviation of the measurement process
0.17983 Standard deviation of the product variation
0.18495 Standard deviation of the total observed variation
0.81233 Average of all product measurements taken during study
39.6067 Percent of specification width used by repeatability error
39.1143 Percent of specification width used by reproducibility error
55.6652 Percent of specification width used by measurement error
Compared to the specification limits, the precision of
this measurement:
Needs improvement
2.76653 Percent of total variability used by repeatability error
2.69817 Percent of total variability used by reproducibilityerror
5.46469 Percent of total variability used by measurement error
Compared to the total variability, the precision of
this measurement:
Is adequate
Units
mm On the basis of this study, there is a 99% chance that
this interval around the measured product performance
will contain the actual product performance level.
Measurement Precision Study - Information Sheet
Version1.0, August 2002
Test Method
Parameter Measured
Company
Name of Study Organizer
Study Completion Date
Instrument
Measurement Units
Lower Specification Limit, LSL
Upper Specification Limit, USL
Number of Conditions, m
Number of Samples, n
Number of Repeat Readings, k
 Measurement Precision Study - Data Sheet
Condition Sample
A Reading 1 2 3 4 5 6 7 8 9 10 Average
1
2
3
4
5
Average X A=
Range RA=
Condition Sample
B Reading 1 2 3 4 5 6 7 8 9 10 Average
1
2
3
4
5
Average X B=
Range R B=
Condition Sample
C Reading 1 2 3 4 5 6 7 8 9 10 Average
1
2
3
4
5
Average XC=
Range RC =
Condition Sample
D Reading 1 2 3 4 5 6 7 8 9 10 Average
1
2
3
4
5
Average X D=
Range R D=
Condition Sample
E Reading 1 2 3 4 5 6 7 8 9 10 Average
1
2
3
4
5
Average X E=
Range R E=
 Measurement Precision Study - Data Sheet (Cont)
Condition Sample
F Reading 1 2 3 4 5 6 7 8 9 10 Average
1
2
3
4
5
Average X F=
Range R F=
Condition Sample
G Reading 1 2 3 4 5 6 7 8 9 10 Average
1
2
3
4
5
Average XG=
Range RG=
Condition Sample
H Reading 1 2 3 4 5 6 7 8 9 10 Average
1
2
3
4
5
Average X H=
Range RH=
Condition Sample
I Reading 1 2 3 4 5 6 7 8 9 10 Average
1
2
3
4
5
Average X I=
Range RI=
Condition Sample
J Reading 1 2 3 4 5 6 7 8 9 10 Average
1
2
3
4
5
Average X J=
Range RJ =
 Measurement Precision Study - Calculation Sheet
Sample Data

Average part
Sample 1 2 3 4 5 6 7 8 9 10 average

Part
average X=
Max Part Avg X Max =
Min Part Avg X Min=
Range of part
averages R P=
Condition Data
Condition A B C D E F G H I J Average Condition
Range
Average
Average R=
Range
Max Condition
Avg X Max =

Min Condition X Min=

Avg
Range of RX =
Condition Avgs
Variability Calculations
Topic Equation Calculation Answer

S r =R∗K 1 /5.15 Sr=

Repeatability

Reproducibility S R=
√ ( 28 .1*S2r
( R X∗K 2 )2 − n*k
5. 15
) S R=

Total R&r S R&r =√ S 2r +S2R S R&r =

Poduct Variation
S P=R P∗K 3 /5 .15 S P=

Total Variation S T = √ S2r +S 2R+S 2P ST=

Readings K1 Operators K2 Parts K3
K Factors 2 4.565603 2 3.652482 2 3.652482
3 3.041937 3 2.696335 3 2.696335
4 2.501214 4 2.299107 4 2.299107
5 2.214101 5 2.076613 5 2.076613
6 2.03236 6 1.928839 6 1.928839
7 1.904586 7 1.819788 7 1.819788
8 1.808922 8 1.739865 8 1.739865
9 1.734007 9 1.672078 9 1.672078
10 1.673164 10 1.619497 10 1.619497
 Measurement Precision Study - Scoreard Calculations

Comparisons to specifications (Used when both specifications exist)

Topic Equation Calculation Answer
5 .15*Sr
% Repeatability ∗100
USL-LSL
5. 15*S R
% Reproducibility ∗100
USL-LSL
% Measurement 5 . 15*SR&r
∗100
R&r USL-LSL

Comparisons to total variation

Topic Equation Calculation Answer

2
Sr
% Repeatability ∗100
S 2T
S 2R
% Reproducibility ∗100
S 2T
% Measurement S 2R&r
∗100
R&r S 2T

Measurement Tolerance

Topic Equation Calculation Answer

Measurement +
2 . 57*SR&r
tolerance −
K Factors for the GRR Worksheet

(Taken fron the AIAG MSA book, 2nd Edition, Feb 95, page 29)

K1 = 5.15 / d2*
K2 = 5.15 / d2*
K3 = 5.15 / d2*

The sigma spread used in the AIAG book is 5.15 units, because that
forms a 99% confidence interval. The K factors are
calculated from d2*.

d2* is adjusted for G (number of parts*appraisers). The equation below

uses the AIAG assumptions for G.

Std Dev Spread 5.15 sigma

d2*
G (parts*appraisers) K Factors
Trials 1 >15 Readings K1 Operators K2 Parts K3
2 1.41 1.128 2 4.57 2 3.65 2 3.65
3 1.91 1.693 3 3.04 3 2.70 3 2.70
4 2.24 2.059 4 2.50 4 2.30 4 2.30
5 2.48 2.326 5 2.21 5 2.08 5 2.08
6 2.67 2.534 6 2.03 6 1.93 6 1.93
7 2.83 2.704 7 1.90 7 1.82 7 1.82
8 2.96 2.847 8 1.81 8 1.74 8 1.74
9 3.08 2.97 9 1.73 9 1.67 9 1.67
10 3.18 3.078 10 1.67 10 1.62 10 1.62