online failure detection and identification for ifcs through statistical learning
DESCRIPTION
Online Failure Detection and Identification for IFCS through Statistical Learning. Yan Liu, Srikanth Gururajan, Bojan Cukic NASA OSMA SAS '04 July 2004. Outline. Introduction A Validation Framework Failure Detection SVDD A Fast Learning Algorithm - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/1.jpg)
04/22/23 1
Online Failure Detection and Online Failure Detection and Identification for IFCS through Identification for IFCS through
Statistical LearningStatistical Learning
Yan Liu, Srikanth Gururajan, Bojan Cukic
NASA OSMA SAS '04July 2004
![Page 2: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/2.jpg)
04/22/23 2
Outline Introduction A Validation Framework Failure Detection
SVDD A Fast Learning Algorithm Online detection for different flight sections
Failure Identification Summary and Future Work
![Page 3: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/3.jpg)
04/22/23 3
R e a l-T im e P ID
e s tim a te dd e r iv a tiv e s
d e r iv a tiv ee rro rs
C o n tro lle rp ilo tin p u ts
S e n s o rs
c o n tro lc o m m a n d s
b a s e lin ed e r iv a tiv e s
B a s e lin eN e u ra l N e tw o rk
O n lin eN e u ra lN e tw o rk
d e r iv a tiv ec o rre c t io n s
a n a lo g
NASA IFCS Architecture
New V&V Techniques
Failure Detection and Identification
![Page 4: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/4.jpg)
04/22/23 4
A Schematic of an Aircraft
Elevators
Ailerons
Rudder
Primary control surfaces on F-15 Aircraft
![Page 5: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/5.jpg)
04/22/23 5
Actuator Failures•Primary Control Surfaces
•Elevators, Ailerons, Rudders
•Two kinds of actuator failures•Locked surface
•Control surface locked at current or predefined deflection
•Results in coupling of lateral and longitudinal dynamics
•Loss of surface
•Part of control surface is lost
•Results in loss of efficiency on the surface
![Page 6: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/6.jpg)
04/22/23 6
A Validation Framework
Feedback ControlAdaptive NN
LearningRule
Desired Response
Physical Process
Reference Model
Command
Error
ActualResponse
+-
Failure Detection and Failure Identification
Monitor Stabilityof Learning
Estimate Trustworthiness of Outputs
1.
2.
3.
![Page 7: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/7.jpg)
04/22/23 7
Flight Section Division for Failure Detection and Identification
4 8 12 16
3 7 11 15
2 6 10 14
1 5 9 13
Mach (0.2 – 1.6)
Altit
ude
(0 ft
–70,
000
ft )
![Page 8: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/8.jpg)
04/22/23 8
Failure Detection Using Support Vector Data Description (SVDD)
![Page 9: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/9.jpg)
04/22/23 9
The TOOL - Support Vector Data Description
• Based on SVM, Developed by Tax et. al.,
• Finds a sphere with the minimal volume that contains all data points.
• Basically a one class classifier.
![Page 10: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/10.jpg)
04/22/23 10
HighlightsHighlights Misclassification error and the function
complexity bound generalization error. Maximizing “volume” minimizes complexity
– typical quadratic programming. “Eliminates” over-fitting. Solution depends only on Support Vectors, not
the number of attributes. Evaluation and implementation are fast and
simple.
![Page 11: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/11.jpg)
04/22/23 11
Previously… We demonstrate that
SVDD can be used as an effective tool for novelty detection.
SVDD can provide novelty measures for online monitoring.
![Page 12: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/12.jpg)
04/22/23 12
Limitations of SVDDLimitations of SVDD Time is of essence in real-time (flight) control! Optimization takes time! - O(n3).
space complexity is high due to matrix operation. Running on 1.6Ghz, 256M RAM, How much time does it
take?
Data size Time (sec)100 2200 240400 1257
![Page 13: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/13.jpg)
04/22/23 13
A simple sampling lemmaTwo Lemmas - 1
Let S be a set of size n and a function that maps any subset of S, denoted by R to some value f(R). The violators of R is defined as V(R):={ s in S\R| (R U {s}) (R) }. The extreme elements in R is defined as X(R):={ s in R | ( R\{s}) (R)}.For a random sample R of size r, the expected number of violators and extremes of R,denoted by vr and xr respectively, has the following relationship: vr / (n-r) = xr+1 / (r+1).
![Page 14: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/14.jpg)
04/22/23 14
Support Vectors = Extreme Points
Outliers = Violators
Data Description - (S)
Based on the sampling lemma, it has been proven that for an LP-type problem, SVM in particular, a fast random sampling working set selection algorithm can achieve running time complexity O(m logn).
![Page 15: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/15.jpg)
04/22/23 15
A U B
A
Violators of ASVs of A
Data of A
B
Violators of BSVs of B
Data of B
![Page 16: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/16.jpg)
04/22/23 16
A lemma of combining For two sets A and B, where both A and B are
subset of S, let C = A U B. Let X(R) and V(R) denote the extremes and violators of a set R respectively. (a)X(C) is a subset of X(A U B), where
X(A U B) = (X(A)^X(B)) U (X(A)^V(B)) U (V(A)^X(B));
and(b)V(C) is a subset of V(A U B), where
V(AUB) = V(A)^V(B) .
Two Lemmas - 2
![Page 17: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/17.jpg)
04/22/23 17
Only SV’s are relevant for the final form of the classifier. ( by Vapnik)
- This means if we were given only the SV’s, we would obtain EXACTLY the identical classifier as if we dispose all other data points.
One Important Observation
![Page 18: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/18.jpg)
04/22/23 18
1. Decompose:Sequentially decompose the training set (flight data) into small working sets of fixed size. Apply SVDD for the subsets.
2. Combine: Combine the SVDDs of current and
previously learned data subsets to obtain the global solution.
A Fast Algorithm – Decompose and Combine
![Page 19: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/19.jpg)
04/22/23 19
A decomposing example A decomposing example
![Page 20: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/20.jpg)
04/22/23 20
Time Advantage Time Advantage (n=100)(n=100)
O(n log n ) << O(n3)
![Page 21: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/21.jpg)
04/22/23 22
Fast SVDDFast SVDD - - on nominal flight condition simulationson nominal flight condition simulations
![Page 22: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/22.jpg)
04/22/23 23
Compare results with/without Compare results with/without decompositiondecomposition
Normalized data of parameters (alpha , Cz_alpha), nominal flight condition, 20hz, running for 40 secs, n=800.
SVDD for whole dataset SVDD using decomposition
![Page 23: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/23.jpg)
04/22/23 25
Failure Detection TestsFailure Detection Tests Normalized data of parameters
(alpha , Cz_alpha). Control failure flight condition, 20hz,
running for 40 secs, 800 data frames collected.
Failure occurs at 600th data frame. Examine data every second = 20 data
frames. (Online Detection)
![Page 24: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/24.jpg)
04/22/23 26
![Page 25: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/25.jpg)
04/22/23 27
Failure Identification by Cross-Correlation
Analysis
![Page 26: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/26.jpg)
04/22/23 28
Nominal vs. Off-nominal• Under nominal flight conditions -
No significant interaction between longitudinal and lateral dynamics.
• Under off-nominal flight conditions -Failure results in loss of symmetry and thus significant couplings between longitudinal and lateral dynamics becomes highly probable.
![Page 27: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/27.jpg)
04/22/23 30
Failure Identification by Correlation Analysis
Research results suggest that failures can be identified by studying the correlation between certain longitudinal and lateral dynamics parameters.
p (RollRate) vs. q (PitchRate) DeltaE vs. p p (RollRate) vs. q (PitchRate) DeltaA vs. q
Longitudinal Failure
Lateral Failure
![Page 28: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/28.jpg)
04/22/23 31
Experimental Results – Failure identification
![Page 29: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/29.jpg)
04/22/23 33
Summary With the fast SVDD algorithm, possible
failures can be detected efficiently and effectively.
The correlation analysis provides us with accurate results and thus can be implemented as an online failure identification tool.
![Page 30: Online Failure Detection and Identification for IFCS through Statistical Learning](https://reader035.vdocument.in/reader035/viewer/2022062810/56815b99550346895dc99e91/html5/thumbnails/30.jpg)
04/22/23 34
Explore flight sections and build a SVDD database of vectors for online failure detection.
Embed the SVDD tools and cross-correlation analysis into the IFCS simulation environment for future testing.
Continue building tools. Inclusion into VV of NN guidebook.
Future Work