representative sampling · representative sampling – 30 min crash course outline: •what is...

28
Representative Sampling 30 min crash course Peter Paasch Mortensen (MSc. Chem. Eng, Ph.D.) Senior Project Manager Global Categories & Operation – Supply Chain Development

Upload: others

Post on 09-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Arla Design Guide is found in the PowerPoint top menu. Click and find information on basic functions and usability. *Only Windows versions

Insert image as background - click the icon and choose image.

Representative Sampling 30 min crash course

Peter Paasch Mortensen (MSc. Chem. Eng, Ph.D.) Senior Project Manager

Global Categories & Operation – Supply Chain Development

Page 2: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

21 October 2015 2

Why do we sample?

• Proces control,

• Quality,

• Legal,

• Economics,

• Mass Balances

• ......

Who is sampling?

Machines

Operators

What characteristics do we want the sample to have?

• Easy to extract,

• Composite sample,

• Representative,

• ......

Which characteristics are most important?

Initial questions one could ask

Page 3: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Representative Sampling ”Take home messages”

In general:

• Focus on representative sampling first and worry about the rest (e.g. sample size) afterwards.

But ask yourself:

Why do you want a sample?

• Proces control/adjustment, Quality, Legal, ..... (different effort might be needed)

How to sample?

• At what frequency?

• Random, Systematic , Stratified?

• Instrumentation: In/On/At/Off-line evaluation?

Is the sample representative?

• This can (and should) be evaluated

Page 4: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Representative sampling – 30 min crash course

Outline:

• What is representative sampling

• Correct sampling

• 0-D and 1-D lots

• Sampling errors

• Correct sampling errors

• Incorrect sampling errors

• How to evaluate a sampling procedure

Page 5: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Representative sampling

• The overall driver for sampling:

• Analysis is only performed on a fraction of the complex material (the lot).

• But:

• If the sample does not truly represent the lot, erroneous deductions and conclusions will invariably follow – no matter how precise the actual analysis

• So:

• There has to be a balance between the sampling accuracy & precision and the assaying technique imposed on the sample.

Page 6: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

When is a sample correctly extracted? Basic requirements

1. ALL elements in a batch must have equal probability of being selected by the sampling tool.

2. All elements NOT part of the sample/increment defined by the sampling tool must have zero probability of ending up in the sample (e.g. no leftovers in sampling tool).

3. And that the sample is not altered after extraction.

Page 7: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Correct sampling

Basic rule: All elements in the lot must have equal probability of being selected.

Page 8: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Why are ”samples” not always representative ? Sample tools are not designed properly

Page 9: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

The effect of incorrect sample delimination

Minkkinen 2006

Incorrect sample profile

Page 10: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

The effect of correct sample delimination

Minkkinen 2006

Correct sample profiles

Page 11: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Why are ”samples” not always representative ? Sample tools are not designed properly continued

Page 12: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Incorrect sampling errors (ICS)

IDE

IEE

IPE

IWE

FSE

GSE

Correct sampling errors (CSE) Process sampling errors (PSE)

TFE

CFE

Total sampling error prior to Laboratory Total Analytical Error

IDE: Incorrect Delimination Error is related to the shape of the sampling tool

IEE: Incorrect Extraction Error is related to the material extracted by the sampling tool

IPE: Incorrect Preparation Error relates to all alterations of the sample after the sample has been taken

IWE: Relatates to weighing errors

FSE: Fundamental Sampling Error originates from differences between fragments – crush material to minimize.

GSE: Grouping and Segregation Error originates from particles tendency to segregate within the lot – blend material to minimize.

TFE: Time Fluctuation Error originates from long term trends. Do varigraphic analysis to determine sampling frequency.

CFE: Cyclic Fluctuation Error originates from periodic changes over time. Do varigraphic analysis to determine sampling frequency.

Theory of Sampling (TOS)

The global estimation error is made up of the total sampling error and the total analystical error

Page 13: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Why should I care about sampling errors?

Because - There is no point in being precisely wrong!

Page 14: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

How do we measure representativeness?

Representativeness re2 is a composite property of

the relative error

• Only a correct sampling procedure secures that samples are both accurate and reproducible

• The random component of re2 tend to reduce when

averaging over a large number of sample.

• This is not the case with the systematic part and this is why a sampling bias is problematic.

First let us define the relative sampling error from the analytical grade a in the lot L and the sample s:

• A sampling process is said to be accurate when the average error me is practically zero

• A sampling process is said to be reproducible if the variance of the relative error se

2 is small.

𝑒 =𝑎𝑠 −𝑎𝐿

𝑎𝐿

𝑟𝑒2 = 𝑚𝑒

2+𝑠𝑒2

Page 15: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Sampling Unit Operations

1. Always perform a heterogeneity characterization of new materials

2. Mix (homogenize) well before all further sampling steps.

3. Use composite sampling.

4. Only use representative mass reduction.

5. Comminute (chrush) whenever neccesary.

6. Perform a varigraphic characterization of 1-D heterogeneity

7. Whenever possible turn 0-D, 2-D and 3-D lots into 1-D equivalents

Page 16: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

LDT: Lot Dimensionality Transformation

Page 17: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

How to take a representative sample of the curd in a cheese VAT?

21 October 2015 17

By transforming 0-dimensional lot to a 1-dimensional lot

Page 18: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

How to evaluate a sampling process?

21 October 2015 18

The Replication Experiment (0-D case)

Primary sampling

Secondary sampling / Mass Reduction

Tertiary sampling / Sub-sampling

Analysis s.s.

Page 19: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

..…

Repeat e.g. 10 times

- perform analysis

The Replication Experiment (0-D case) Primary Sampling Error (PSE)

- extract a primary sample (e.g. 20 kg)

- extract a secondary sample, e.g. 1 kg (mass reduction)

- extract a tertiary sample, e.g. 2 g (mass reduction)

𝑚𝑃𝑆𝐸2

𝑠𝑃𝑆𝐸2

Page 20: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

..… Repeat sub-sampling (mass reduction) from the same

primary sample 10 times

Now: select a single of the primary samples

Secondary Sampling Error (SSE) The Replication Experiment (0-D case)

𝑚𝑆𝑆𝐸2

𝑠𝑆𝑆𝐸2

Page 21: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

..…

Perform tertiary sampling 10 times from the

same secondary sample

Now select a single of the secondary samples

Tertiary Sampling Error (TSE) The Replication Experiment (0-D case)

𝑚𝑇𝑆𝐸2

𝑠𝑇𝑆𝐸2

Page 22: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

..…

Repeat only the analysis 10 times

“Press the button” 10 times! (if analysis is non-destructive)

At the bottom line:

Total Analytical Error (TAE) The Replication Experiment (0-D case)

𝑚𝑇𝐴𝐸2

𝑠𝑇𝐴𝐸2

Page 23: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Typical relative magnitude of sampling

variances:

var(PSE),var(SSE),var(TSE),var (TAE)

Something is clearly WRONG regarding

the third sampling level - we may want to

have a closer look at the third stage in our

sub-sampling procedure …

PSE

PSE

SSE

SSE

TSE

TSE

TAE

TAE

The Replication Experiment (0-D case) Comparison of sampling stages

Page 24: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

The Replication Experiment (0-D case)

Now was the sampling procedure correct ? The averages will tell

𝑚𝑇𝐴𝐸 ≈ 𝑚𝑇𝑆𝐸 ≈ 𝑚𝑆𝑆𝐸 ≈ 𝑚𝑃𝑆𝐸

Page 25: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

0 20 40 60 80 100 120

0.3

0.4

0.5

0.6

On-line estimation (A)

# measurements

Act

ivity

0 50 100 150 200 250 300 350

0.3

0.4

0.5

0.6

On-line estimation (B)

# measurements

Act

ivity

0 10 20 30 40 50 60 700

0.5

1

1.5

2x 10

-3 Variogram and auxilary functions (A)

Lag (j)

v(j)

0 20 40 60 80 100 120 140 160 1800

0.5

1

1.5

2x 10

-3 Variogram and auxilary functions (B)

Lag(j)

v(j)

0 10 20 30 40 500

0.005

0.01

0.015

0.02Total sampling error (A)

# increments

Act

ivity

0 10 20 30 40 500

0.005

0.01

0.015

0.02Total sampling error (B)

# increments

Act

ivity

Stratif ied selection mode

Systematic selection mode

Random selection mode

Stratif ied selection mode

Systematic selection mode

Random selection mode

Variogram

Wstratif ied

Wsystematic

Wrandom

Variogram

Wstratif ied

Wsystematic

Wrandom

1-D sampling

Q

q

qjq

L

Q

q

qjq aaajQ

hhjQ

jv1

2

21

2 )()(2

1)(

)(2

1)(

Systematic selection Random selection

Stratified random selection

Minimal Practical Error (0-D case)

Page 26: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Variography 0 20 40 60 80 100 120

0.3

0.4

0.5

0.6

On-line estimation (A)

# measurements

Act

ivity

0 50 100 150 200 250 300 350

0.3

0.4

0.5

0.6

On-line estimation (B)

# measurements

Act

ivity

0 10 20 30 40 50 60 700

0.5

1

1.5

2x 10

-3 Variogram and auxilary functions (A)

Lag (j)

v(j)

0 20 40 60 80 100 120 140 160 1800

0.5

1

1.5

2x 10

-3 Variogram and auxilary functions (B)

Lag(j)

v(j)

0 10 20 30 40 500

0.005

0.01

0.015

0.02Total sampling error (A)

# increments

Act

ivity

0 10 20 30 40 500

0.005

0.01

0.015

0.02Total sampling error (B)

# increments

Act

ivity

Stratif ied selection mode

Systematic selection mode

Random selection mode

Stratif ied selection mode

Systematic selection mode

Random selection mode

Variogram

Wstratif ied

Wsystematic

Wrandom

Variogram

Wstratif ied

Wsystematic

Wrandom

0 20 40 60 80 100 120

0.3

0.4

0.5

0.6

On-line estimation (A)

# measurements

Act

ivity

0 50 100 150 200 250 300 350

0.3

0.4

0.5

0.6

On-line estimation (B)

# measurements

Act

ivity

0 10 20 30 40 50 60 700

0.5

1

1.5

2x 10

-3 Variogram and auxilary functions (A)

Lag (j)

v(j)

0 20 40 60 80 100 120 140 160 1800

0.5

1

1.5

2x 10

-3 Variogram and auxilary functions (B)

Lag(j)

v(j)

0 10 20 30 40 500

0.005

0.01

0.015

0.02Total sampling error (A)

# increments

Act

ivity

0 10 20 30 40 500

0.005

0.01

0.015

0.02Total sampling error (B)

# increments

Act

ivity

Stratif ied selection mode

Systematic selection mode

Random selection mode

Stratif ied selection mode

Systematic selection mode

Random selection mode

Variogram

Wstratif ied

Wsystematic

Wrandom

Variogram

Wstratif ied

Wsystematic

Wrandom

Page 27: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

In conclusion

• Representative sampling is crucial for data reliability and the conclusions that follows.

• Theory of samling offers guidance on how to characterize materials and sampling procedures.

• By simple tests you can get an idea of how representative your sampling procedure is – its not rocket science.

• 21. oktober 2015 Slide No. 27

Page 28: Representative Sampling · Representative sampling – 30 min crash course Outline: •What is representative sampling •Correct sampling •0-D and 1-D lots •Sampling errors •Correct

Contact information: [email protected]

21 October 2015 28

Thank you for your attention