collaboration with ltsi testing · 2020. 3. 21. · ltsi workshop / embedded linux conference 2014...

Copyright 2014, Toshiba Corporation.

Collaboration with LTSI Testing

Yoshitake Kobayashi

Corporate Software Engineering CenterToshiba Corporation

2LTSI Workshop / Embedded Linux Conference 2014


Patches available

on upstream

Patches available

on Xilinx’s repository

LTSI-3.10

backport

backport


Target filesWriter processes (N procs)

Target Host

write() system call

Log Host

Logger

Each writer process

• writes to text files (ex. 100 files)

• sends progress log to logger

This test case available at the following URL:

https://github.com/ystk/fs-test

Reset at

random timing

https://github.com/ystk/fs-test


Checker

Target

file

LOG

file

AAAAABBBBBCCCCCDDDDDEEEEE

OK

FFFFF

AAAAABBBBBCCCCCDDDDDEEEEE

OKAAAAABBBBBCCCCCDDDDDAAAAA

NGAAAAABBBBBCCCCCDDDDD

NG

?

size mismatchdata mismatch

Verify the following metrics

• file size

• file contents Estimated file

contents

Estimated file size


0.00

0.50

1.00

1.50

2.00

EXT3-

ORDERED

EXT3-

JOURNAL

* * * JFS XFS

Err

or

rate

[%]

45.9%

Err

or

rate

[%]

0.00

0.50

1.00

1.50

2.00

EXT3-ORDERED

EXT3-JOURNAL

EXT4-JOURNAL

EXT4-ORDERED

EXT4-WRITEBACK

* XFS BTRFS

82.4%84.7%43.4% 41.4%

43.2%

Err

or

rate

[%]

0.00

0.50

1.00

1.50

2.00

EXT3-

ORDERED

EXT3-

JOURNAL

EXT4-

JOURNAL

EXT4-

ORDERED

* JFS XFS

13.3%

kernel

2.6.18

kernel

2.6.31

kernel

2.6.33

File size mismatchData mismatch


0.00

0.50

1.00

1.50

2.00

EXT3-

ORDERED

EXT3-

JOURNAL

* * * JFS XFS

Err

or

rate

[%]

45.9%

Err

or

rate

[%]

0.00

0.50

1.00

1.50

2.00

EXT3-ORDERED

EXT3-JOURNAL

EXT4-JOURNAL

EXT4-ORDERED

EXT4-WRITEBACK

* XFS BTRFS

82.4%84.7%43.4% 41.4%

43.2%

Err

or

rate

[%]

0.00

0.50

1.00

1.50

2.00

EXT3-

ORDERED

EXT3-

JOURNAL

EXT4-

JOURNAL

EXT4-

ORDERED

* JFS XFS

13.3%

kernel

2.6.18

kernel

2.6.31

kernel

2.6.33


Point 1：A file system has

different characteristicsof data reliability


0.00

0.50

1.00

1.50

2.00

EXT3-

ORDERED

EXT3-

JOURNAL

* * * JFS XFS

Err

or

rate

[%]

45.9%

Err

or

rate

[%]

0.00

0.50

1.00

1.50

2.00

EXT3-ORDERED

EXT3-JOURNAL

EXT4-JOURNAL

EXT4-ORDERED

EXT4-WRITEBACK

* XFS BTRFS

82.4%84.7%43.4% 41.4%

43.2%

Err

or

rate

[%]

0.00

0.50

1.00

1.50

2.00

EXT3-

ORDERED

EXT3-

JOURNAL

EXT4-

JOURNAL

EXT4-

ORDERED

* JFS XFS

13.3%

kernel

2.6.18

kernel

2.6.31

kernel

2.6.33




Point 2:Some Results depends

on kernel version


0.00

0.50

1.00

1.50

2.00

EXT3-

ORDERED

EXT3-

JOURNAL

* * * JFS XFS

Err

or

rate

[%]

45.9%

Err

or

rate

[%]

0.00

0.50

1.00

1.50

2.00

EXT3-ORDERED

EXT3-JOURNAL

EXT4-JOURNAL

EXT4-ORDERED

EXT4-WRITEBACK

* XFS BTRFS

82.4%84.7%43.4% 41.4%

43.2%

Err

or

rate

[%]

0.00

0.50

1.00

1.50

2.00

EXT3-

ORDERED

EXT3-

JOURNAL

EXT4-

JOURNAL

EXT4-

ORDERED

* JFS XFS

13.3%

kernel

2.6.18

kernel

2.6.31

kernel

2.6.33




Point 2:Some Results depends

on kernel version

Point 3:EXT4-Journal and BTRFS

has a nice result


START GOAL

Accelerate

Things that cannot be accelerated

• CPU clock

• I/O access speed (ex. SSD)

• Network bandwidth

• etc.Try to detect errors that caused

by clock

Focus to accelerate clock

Issues

• Long-term testing takes really long time→ We want results as fast as possible


Xdaliclock works as a stopwatch

Returned an incorrect value

after about 450 days.

(It takes about 6 hours in 1000

times acceleration)


https://github.com/ystk/linux-ltsi/tree/ltsi-3.0.y-rt



collaboration with ltsi testing · 2020. 3. 21. · ltsi workshop / embedded linux conference 2014...

Documents