support vector machine
TRANSCRIPT
![Page 1: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/1.jpg)
Support Vector Machine
Putri W Novianti
Victor L Jong
Biostatistics & Research Support
Julius Center for Health Sciences and Primary Care
University Medical Center Utrecht
![Page 2: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/2.jpg)
• Binary classification method
• The method finds the best decision hyperplane that separate sample from
two classes with maximum margin
2 Support Vector Machine
![Page 3: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/3.jpg)
3 Support Vector Machine
[1]
![Page 4: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/4.jpg)
4 Support Vector Machine
[1]
![Page 5: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/5.jpg)
5 Support Vector Machine
[1]
![Page 6: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/6.jpg)
6 Support Vector Machine
[1]
![Page 7: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/7.jpg)
7 Support Vector Machine
[1]
![Page 8: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/8.jpg)
8 Support Vector Machine
[1]
![Page 9: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/9.jpg)
9 Support Vector Machine
[1]
![Page 10: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/10.jpg)
10 Support Vector Machine
[1]
![Page 11: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/11.jpg)
11
What if the problem is not linearly separable?
Support Vector Machine
[2]
![Page 12: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/12.jpg)
12 Support Vector Machine
![Page 13: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/13.jpg)
13 Support Vector Machine
[1]
![Page 14: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/14.jpg)
14 Support Vector Machine
[1]
![Page 15: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/15.jpg)
15 Support Vector Machine
[1]
![Page 16: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/16.jpg)
16 Support Vector Machine
[1]
![Page 17: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/17.jpg)
17 Support Vector Machine
[4]
![Page 18: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/18.jpg)
18 Support Vector Machine
[3]
![Page 19: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/19.jpg)
- SVM only handle binary classification
- Although binary classification is the most common classification in microarray, multiclass outcome could be occur in practice
- Modification is needed to handle multiclass outcome
- one-versus-rest (OVR)
- one-versus-one (OVO)
19
Multiclass outcome
Support Vector Machine
[2]
![Page 20: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/20.jpg)
Multiclass outcome
20 Support Vector Machine
[2]
![Page 21: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/21.jpg)
OVR-SVM
21 Support Vector Machine
[2]
![Page 22: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/22.jpg)
22
OVO-SVM
Support Vector Machine
[2]
![Page 23: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/23.jpg)
23 Support Vector Machine
[5]
![Page 24: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/24.jpg)
Example 1. Classification in Iris Data
24 Support Vector Machine
[5]
![Page 25: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/25.jpg)
25 Support Vector Machine
Example 1. Classification in Iris Data
[5]
![Page 26: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/26.jpg)
SVM for Regression
26 Support Vector Machine
![Page 27: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/27.jpg)
SVM for Regression
27 Support Vector Machine
![Page 28: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/28.jpg)
28 Support Vector Machine
![Page 29: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/29.jpg)
29 Support Vector Machine
![Page 30: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/30.jpg)
30 Support Vector Machine
![Page 31: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/31.jpg)
31
![Page 32: Support Vector Machine](https://reader033.vdocument.in/reader033/viewer/2022051212/557cbeb3d8b42a59078b4962/html5/thumbnails/32.jpg)
References
[1] Zhang, X. Support Vector Machine. Lecture slides on Data Mining course. Fall 2010, KSA: KAUST
[2] Statnikov, A. et al. 2005. A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis. Bioinformatics, 21:5, 631-643
[3] Hastie, T., Tibshirani, R., Friedman, J. The elements of statistical learning, second edition. 2009. New York: Springer
[4] Guyon, I et al. 2002. Gene selection for cancer classification using support vector machines. Machine Learning, 49, 389-422
[5] Meyer, D. et al. 2012. R package: e1071.
32 Support Vector Machine