statistical process control in an e3 test laboratory
TRANSCRIPT
![Page 1: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/1.jpg)
1
STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY Kimball W illiams Eaton Innovation Center EMC ‘98 Roma - 9/17/98
THE INSTITUTE OF ELECTRICAL AND ELECTRONIC ENGINEERS
![Page 2: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/2.jpg)
2
STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY Kimball W illiams Underw riters laboratories, Inc Novi, M ichigan USA Chennai, India December 9,2003
THE INSTITUTE OF ELECTRICAL AND ELECTRONIC ENGINEERS
![Page 3: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/3.jpg)
3
STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY Kimball W illiams N. C. E. Denso – EMC Laboratory: Southfield, MI A2LA Assessors Conclave: March 24, 2007
THE INSTITUTE OF ELECTRICAL AND ELECTRONIC ENGINEERS
![Page 4: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/4.jpg)
4
STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY Kimball W illiams N. C. E. IEEE Southeastern M ichigan Section: (SEM) Information Management Coordinator SEM EMC Chapter: January 19, 2017
THE INSTITUTE OF ELECTRICAL AND ELECTRONIC ENGINEERS
![Page 5: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/5.jpg)
5
Introduction: Measurement system variability in a test
laboratory can be a source of discomfort for the test engineer.
Your development engineers, your product managers, and anyone doing repeat testing want to be sure your test system is “The Same” as the last time they tested.
![Page 6: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/6.jpg)
6
Introduction (Cont.): Simply connecting up the same
equipment does not provide any ‘measurable assurance’ of repeatability.
The use of Statistical Process Control (SPC) methods to gage, and track the variability of system measurements can provide confidence in the repeatability of the test system setup, and in the data it produces.
![Page 7: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/7.jpg)
Dayton T. Brown Inc.
7
![Page 8: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/8.jpg)
Navy Missile: Duplicate Test
• Testing suggested a ‘new’ problem.
• Customer believed test missile to be unchanged in any way.
• Same physical equipment was verified.
• However, a photo of the original e-prom date code showed new software!
8
![Page 9: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/9.jpg)
9
The Problem:
• New setup for each test, ...each time. – Lack of equipment. – Lack of space.
![Page 10: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/10.jpg)
10
![Page 11: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/11.jpg)
11
The Problem: • New setup for each test, ...each time.
– Lack of equipment. – Lack of space.
• No one has the room to have all tests set up, all the time.
• How to verify test setup repeatability?
• How to verify system integrity?
![Page 12: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/12.jpg)
12
![Page 13: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/13.jpg)
Meet Walter Shewhart
• Physicist / Engineer
• 1924 Challenge
• Statistics & Products
• Statistics & Processes
• SPC!
• …..Edward Deming. 13
![Page 14: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/14.jpg)
14
Monitor System Performance:
• Method to verify system performance.
• Independent of normal controls. – Ex: Comb generator in TEM for RE. – EX: Field Meter to check RI levels.
![Page 15: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/15.jpg)
15
PC
SpectrumAnalyzer
LoadTem Cell
HPIB
CombGenerator
![Page 16: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/16.jpg)
16
![Page 17: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/17.jpg)
17
![Page 18: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/18.jpg)
18
![Page 19: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/19.jpg)
19
PC
Digital Volt Meter
RF PWR AMP
Signal Generator
Load
Rev
DirCoupl
Fwd
PowerMeter
Tem Cell
RF Field Sensor
![Page 20: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/20.jpg)
20
![Page 21: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/21.jpg)
21
Approach
• Measurement that has no effect on normal test system behavior.
• Gather data representative of normal performance.
• Plot data on SPC historical charts.
• Track long term system behavior.
![Page 22: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/22.jpg)
22
Verify Test System Integrity
• Verify physical test setup.
• Verify test system function.
• Document system repeatability.
• Capture as historical charts.
![Page 23: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/23.jpg)
23
Statistical Process Control (SPC) Charts (Range):
• Walter Shewart’s Control Chart - Range Equations.
• MR = XN - XN-1 (Delta Change)
• MRBar = (∑ MRN)/N
• UCLR = MRBar * D4
• LCLR = MRBar * D3 => 0
![Page 24: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/24.jpg)
24
Statistical Process Control (SPC) Charts: (Data)
• Walter Shewart’s Control Chart - Data Equations.
• Let XN = N data pts.
• XBar = (∑ XN)/N
• UCLX = XBar + A * MRBar
• LCLX = XBar - A * MRBar
![Page 25: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/25.jpg)
25
![Page 26: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/26.jpg)
Patience!
• The method is ‘statistical’ in nature.
• The first few data points will NOT make sense.
• Results will begin to be reasonable after about 5 data points are in use.
26
![Page 27: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/27.jpg)
27
Caution:
• To avoid ‘Data Overload’ in the frequency domain, average multiple frequency readings together, and
• Limit the number of frequencies to a representative few.
• This avoids multiple XBar-R Charts for a single antenna.
![Page 28: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/28.jpg)
28
Example:
• For TEM or G-TEM use 15 frequencies to cover the cell’s range.
• Normally this would result in 15 Charts!
• By averaging all frequencies together, we arrive at single representative reading that describes the cell’s behavior.
![Page 29: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/29.jpg)
5 Point Spread
29
![Page 30: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/30.jpg)
Ex: LP or BiCon Antenna
• 20 – 200 MHz
• 180 MHz Span
• 10 MHz/Point
• 18 Charts!
30
![Page 31: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/31.jpg)
Points of ‘interest’.
31
![Page 32: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/32.jpg)
32
Example (Cont):
Experimentation has verified that the ‘averaged’ value still retains enough sensitivity to small changes in one measurement value to be a reliable indicator of potential problems.
![Page 33: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/33.jpg)
33
Caution:
• When using measurements in Decibels (dB), convert the measured value to its representative Voltage, Current or Power, perform the appropriate mathematical operations, then convert back to dB for final display within the XBar & Range Charts.
![Page 34: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/34.jpg)
34
Data Sets:
• Normal Data
![Page 35: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/35.jpg)
35
Date 4/5/1999 4/12/1999 4/15/1999 6/9/1999 6/15/1999 6/24/1999 7/16/1999 7/30/1999 8/9/1999 8/17/1999 8/30/1999 9/9/1999 9/17/1999 10/9/1999 2/10Current 0.974 0.968 0.974 0.969 0.967 0.974 0.97 0.973 0.968 0.971 0.965 0.969 0.973 0.969 0
Range Chart
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.1
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Data Points
Norm
alize
d Ran
ge (V
olts)
Range R-Ave
X Bar Chart
0.93000
0.94000
0.95000
0.96000
0.97000
0.98000
0.99000
1.00000
1.01000
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Data Points
Norm
alize
d Xba
r (Volt
s)
XBar UCL
![Page 36: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/36.jpg)
36
Data Sets:
• Normal Data
• Too Good to be True
![Page 37: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/37.jpg)
37
1 2 3 4 5 6 7 8 9 16Date 4/5/1999 4/12/1999 4/15/1999 6/9/1999 6/15/1999 6/24/1999 7/16/1999 7/30/1999 8/9/1999 2/24/2000
Current 0.974 0.974 0.974 0.974 0.974 0.974 0.974 0.974 0.974 0.974
X Bar Chart
0.96000
0.96500
0.97000
0.97500
0.98000
1 2 3 4 5 6 7 8 9 10
Data Points
Nor
mal
ized
Xba
r (Vo
lts)
XBar UCL LCL
![Page 38: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/38.jpg)
38
Data Sets:
• Normal Data
• Too Good to be True
• Jump Data
![Page 39: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/39.jpg)
39
1 2 3 4 5 6 7 8 9 16Date 4/5/1999 4/12/1999 4/15/1999 6/9/1999 6/15/1999 6/24/1999 7/16/1999 7/30/1999 8/9/1999 2/24/2000
Current 0.974 0.975 0.974 0.973 0.974 0.975 0.9754 0.975 0.9735 0.98
X Bar Chart
0.96000
0.96500
0.97000
0.97500
0.98000
1 2 3 4 5 6 7 8 9 10
Data Points
Nor
mal
ized
Xba
r (Vo
lts)
XBar UCL LCL
![Page 40: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/40.jpg)
40
Data Sets:
• Normal Data
• Too Good to be True
• Jump Data
• Periodic Data
![Page 41: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/41.jpg)
41
1 2 3 4 5 6 7 8 9 16Date 4/5/1999 4/12/1999 4/15/1999 6/9/1999 6/15/1999 6/24/1999 7/16/1999 7/30/1999 8/9/1999 2/24/2000
Current 0.974 0.9735 0.975 0.9741 0.976 0.974 0.9756 0.974 0.97567 0.974
X Bar Chart
0.96000
0.96500
0.97000
0.97500
0.98000
1 2 3 4 5 6 7 8 9 10
Data Points
Nor
mal
ized
Xba
r (Vo
lts)
XBar UCL LCL
![Page 42: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/42.jpg)
42
Data Sets:
• Normal Data
• Too Good to be True
• Jump Data
• Periodic Data
• Ramp Data
![Page 43: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/43.jpg)
43
1 2 3 4 5 6 7 8 9 16Date 4/5/1999 4/12/1999 4/15/1999 6/9/1999 6/15/1999 6/24/1999 7/16/1999 7/30/1999 8/9/1999 2/24/2000
Current 0.974 0.9735 0.975 0.9741 0.976 0.974 0.9756 0.977 0.978 0.9794
X Bar Chart
0.96000
0.96500
0.97000
0.97500
0.98000
1 2 3 4 5 6 7 8 9 10
Data Points
Nor
mal
ized
Xba
r (Vo
lts)
XBar UCL LCL
![Page 44: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/44.jpg)
44
Other Test Methods
TestMethod
Example SPCMethod
RE Standard EmissionGenerator (Comb)
RI Field Monitor
CE Broad Band Noise Source
![Page 45: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/45.jpg)
45
Other Test Methods - Cont.
Test Method
Example SPC Method
BCI
‘Loaded’ Cal Fixture
CI Coax Resistive Load +
DVM Trans I Attenuator/Load+Scope
Meas: Tr, Vpk, Area
Trans E Same as above.
![Page 46: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/46.jpg)
46
Test Setup Documentation: • Create initial SPC for each system.
• Gather relevant data for each system component – separately.
• Later, if anything changes at the system level, you have all the individual component baseline data as reference.
![Page 47: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/47.jpg)
47
Review:
• Problem - New setup for each test and the doubts about measurement data that results.
• Method to verify system performance. – test setup repeatability? – system data integrity?
![Page 48: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/48.jpg)
48
Solution:
• Monitor system performance.
• Display information as SPC historical data charts.
• Retain SPC charts for system analysis and documentation.
• Adds very little time to test setup but, saves lots of discussions with customers.
![Page 49: STATISTICAL PROCESS CONTROL IN AN E3 TEST LABORATORY](https://reader031.vdocument.in/reader031/viewer/2022012507/6183f5be7ad8d431457328e5/html5/thumbnails/49.jpg)
Questions?
• Thank you for your attention.
49