i. motivation ii. image quality analysis€¦ · quality analysis 2. establish relationship between...

Image Based Quality Assurance of Inkjet Printed Electronics and Coated Screen Printed ElectronicsYang Yan, Qingyu Yang, Kerry Maize, Professor Jan P. Allebach, Professor George Chiu, Professor Ali Shakouri

School of Electrical and Computer Engineering, School of Mechanical Engineering Purdue University, West Lafayette IN

I. MotivationEstablish relationship between image quality (as measured in captured image) and functional properties of sensor.

II. Image Quality Analysis

Figure1.2 Nitrate sensor components

Bare electrode

Silicone passivation

Ion selective membrane

Active Region

Figure1.1 Screen printed electrodes on PET substrate

Silicon Wafer

Light Source

Image Data

Figure1.3 Current imaging system Figure1.4 Examples of captured image for active region

1. Image processing for quality analysis

2. Establish relationship between image quality and sensor performance

Overview of image quality analysis

Active region detection

Input image

Texturing level measurement

Figure2.2 Binary image segment active region and background

Figure2.1 Captured image

Detection of active region: • Use image processing including Sobel filter,

Otsu’s method and morphological transformation to identify the active region in captured image.

• Show the segmentation result in binary image as figure2.2.

Measurement of texturing level:• Set up a model and get numerical

representations for different texturing. • Three methods are developed to describe the

texturing levels.

Three methods to represent texturing level (TL) of active region in sensor images

Method1: Gaussian Pyramid (GP) Method2: Laplacian of Gaussian (LoG) Method3:Local Binary Pattern (LBP)

Original Image [I]

Graylevel Image [I0]

Gaussian Filtered Image

Down-Sampled Image [I1]

Mask with the active Region [I3_mask]

[I2], [I3]

……

Get Texturing level:Texturing level

= Std(Standard Deviation of I3_mask)

Laplacian filter: find rapid change in images, but it is sensitive to noise.Gaussian filter: low pass filter to decrease noise. LoG: applying Gaussian filter, then applying Laplacian filter.

Original Image [I]

Graylevel Image [Ig, Ig0]

Gaussian Filtered Image

Reference Image [I0]

Compare the histogram plots (H1, H2):

Compare the similarity of H1 and H2Texturing level: Bhattacharyya distance between

reference image and measuring image (x100)

Bhattacharyya distance

Get LBP images and its histogram (H1, H2)

1280 x 1024

640 x 512

320 x 256

160 x 128

[I1_mask]

[I2_mask]

[I]

[I3_mask]

Texturing level = Std of active region of I3_mask = 30.822

Ig: graylevel Image of active regionI: original Image

ILoG: image after applying LoG Iout: edge => black; background => white

Result: Texturing level = 8.704 (%)

Original Image [I]

Graylevel Image [Ig]

Applying LoG filter (σ = 2) to the active region of image [ILoG]

Compute binary image Iout

edges => black; backgrounds => white

Detect edges (rapid change) in each 5x5 sliding window .

Get texturing level:Texturing level = # of edge pixels / # of total pixels

ImageDimension

TL= 11

TL= 1.51

Reference image [I0]

Original Image [I]

Original Image [I]

Comparison of results with three methods

Method3: LBP

Method2: LoG

Method1:GP

1

1

1

2

2

2 3

3

3

4

4

4

5

5

5

Figure2.1 Arrange results of texturing levels after applying three different method as decreasing order.

Left-bottom label (1 - 5) is the order number of texturing level from less to more. Larger index level means more texturing in visual perception.

Measured texturing levels decreasingMethod1 GP (Gaussian pyramid with normalization): It uses multi-scale representation of texturing level. The texturing level in active region can be shown in different scale space. Sometimes the variant illuminance effects our result.

Method2 LoG (Laplacian of Gaussian): Applying Laplacian of gaussian filter is a way to find rapid change in an image. Variant illuminance does not effect result. It describes the edges in active region.

Method3 LBP (Local binary pattern): LBP algorithm is always used to describe the texturing in an image. The results are robust with variant illuminance and rotation. It describes local texturing in active region.

IV. Cross Validation

Performance Prediction

1.Training (Model Fitting)

2. TestingMicroscope imaging Data

Microscope imaging of printed device•Morphology

Performance of printed device•Conductivity

Training Set

Test Set

Model

Performance Data

Model

Model Accuracy

Same Model

Microscope Imaging

?

Performance

Gray Scale Image [1]

Sobel Edge Detection

Otsu’s Method [2]

Background Mask (Cropped Area Near Sides

of Image)[3]

Otsu’s Method(With Background Mask)

[4]

K-Means Clustering (With Background Mask and Inversed [4])

[5]

Final Segmentation [6]

[1]

[2]

Single Layer

Double Layer

No Ink

[5]

[6]

123456

BottomEdge

TopEdge

EdgePosition

Top Edge Bottom Edge

Edge Roughness(μm)

Edge Roughness(μm)

1 15.63 4.46

2 17.16 3.90

3 20.79 3.83

4 27.12 4.16

5 27.01 4.59

6 27.02 5.93

Average 22.46 4.50

𝐸𝑑𝑔𝑒 𝑅𝑜𝑢𝑔ℎ𝑛𝑒𝑠𝑠 =

1

𝑚×𝑛σ𝑖=1𝑚 σ𝑗=1

𝑛 [𝐹𝑖𝑡𝑡𝑒𝑑 𝑙𝑖𝑛𝑒(𝑖, 𝑗) − 𝐷𝑎𝑡𝑎 (𝑖, 𝑗)]2 ,

where 𝑚 = 𝑖𝑚𝑎𝑔𝑒 𝑤𝑖𝑑𝑡ℎ , 𝑛 = 𝑖𝑚𝑎𝑔𝑒 𝑙𝑒𝑛𝑔𝑡ℎ , 𝑖, 𝑗 = 𝑃𝑖𝑥𝑒𝑙 𝑃𝑜𝑠𝑖𝑡𝑖𝑜𝑛

Image Segmentation

EdgeRaggedness

III. Morphological AnalysisInkJet Printed Electrodes

Screen Printed Electrodes

[3]

[4]

From [3]

To [4]

Original Image

Various printing variables including cartridge drop size, printing resolution, viscosity of silver ink.

1016 dpi, 10pl, w/ 3% Ammonium Carbamate