1 statistical learning theory project statistical learning theory svm not toy it’s now 3d!!!...

10

1 Statistical Learning Theory Project Statistical Learning Statistical Learning Theory Theory SVM not TOY It’s now 3D!!! Members: R93922108 R93546015 R93922140 P92922007 D93922011

Upload: britney-strickland

Post on 17-Jan-2016

220 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: 1 Statistical Learning Theory Project Statistical Learning Theory SVM not TOY It’s now 3D!!! Members: R93922108 R93546015 R93922140 P92922007 D93922011

1Statistical Learning Theory Project

Statistical Learning Statistical Learning TheoryTheory

Statistical Learning Statistical Learning TheoryTheory

SVM not TOY

It’s now 3D!!!

Members: R93922108 R93546015

R93922140 P92922007 D93922011

Page 2: 1 Statistical Learning Theory Project Statistical Learning Theory SVM not TOY It’s now 3D!!! Members: R93922108 R93546015 R93922140 P92922007 D93922011

2Statistical Learning Theory Project

IntroductionIntroductionIntroductionIntroduction

The work has done by another group last yearhttp://arbor.ee.ntu.edu.tw/~kidd/svm_project/3D_SVM/svm.htm

Page 3: 1 Statistical Learning Theory Project Statistical Learning Theory SVM not TOY It’s now 3D!!! Members: R93922108 R93546015 R93922140 P92922007 D93922011

3Statistical Learning Theory Project

Last YearLast YearLast YearLast Year

Page 4: 1 Statistical Learning Theory Project Statistical Learning Theory SVM not TOY It’s now 3D!!! Members: R93922108 R93546015 R93922140 P92922007 D93922011

4Statistical Learning Theory Project

Project GoalProject GoalProject GoalProject Goal

1. Recover to code.

2. Make it more user friendly.

3. Release to community.

Page 5: 1 Statistical Learning Theory Project Statistical Learning Theory SVM not TOY It’s now 3D!!! Members: R93922108 R93546015 R93922140 P92922007 D93922011

5Statistical Learning Theory Project

JAVA 3D PlatformJAVA 3D PlatformJAVA 3D PlatformJAVA 3D Platform

1. Choose the Java3D platform as the engine of 3D SVMTOY.

2. The same reasons mentioned in previous work.

Easy to combine the LIBSVM java code. Using Java 3D is easier than OpenGL and

DirectX.

Page 6: 1 Statistical Learning Theory Project Statistical Learning Theory SVM not TOY It’s now 3D!!! Members: R93922108 R93546015 R93922140 P92922007 D93922011

6Statistical Learning Theory Project

Functions of 3D SVMTOYFunctions of 3D SVMTOYFunctions of 3D SVMTOYFunctions of 3D SVMTOY

1. Input ( by mouse or keyboard)

2. Change

3. Run

4. Clear

5. View

6. Parameter

Page 7: 1 Statistical Learning Theory Project Statistical Learning Theory SVM not TOY It’s now 3D!!! Members: R93922108 R93546015 R93922140 P92922007 D93922011

7Statistical Learning Theory Project

MethodMethodMethodMethod

We use a brute-force way to testing all points in a 3-D space, and get the approximated bounded hyperplane.

Each dimension has 100 points, we only draw about 20,000 points, much less than 1,000,000 points last year.If the predicted label of the point is different from that of the neighbor points ((i-1,j,k),(i,j-1,k),(i,j,k-1)), then the point will be drawn in the display plane as a point of the bounded hyperplane.

Page 8: 1 Statistical Learning Theory Project Statistical Learning Theory SVM not TOY It’s now 3D!!! Members: R93922108 R93546015 R93922140 P92922007 D93922011

8Statistical Learning Theory Project

DemoDemoDemoDemo

http://www.csie.ntu.edu.tw/~r93546015/blogtoy/blosxom.cgi

Page 9: 1 Statistical Learning Theory Project Statistical Learning Theory SVM not TOY It’s now 3D!!! Members: R93922108 R93546015 R93922140 P92922007 D93922011

9Statistical Learning Theory Project

Running TimeRunning TimeRunning TimeRunning Time

We have tried 30 points on the notebook (Pentium 1.5 G) . 30 points takes 5 seconds.(25 secs last year)100 points takes 12 seconds.(1.5 mins last year)

100 points is probably the maximum number of points that a user would click.The running time is ideal.

Page 10: 1 Statistical Learning Theory Project Statistical Learning Theory SVM not TOY It’s now 3D!!! Members: R93922108 R93546015 R93922140 P92922007 D93922011

10Statistical Learning Theory Project

ConclusionConclusionConclusionConclusion

In the foundation of preliminary work, we have successfully implemented 3D SVMToy

With a friendly input interface.

Show clearly bounded hyperplane of the model.

Runs much faster and more smoothly than last year’s work.

Estes’ Statistical Learning Theory: Past, Present, …suppes-corpus.stanford.edu/articles/psych/311.pdfEstes’ Statistical Learning Theory: Past, Present, and Future ... arise out

CS229T/STAT231: Statistical Learning Theory (Winter 2013)

A Geometric Approach to Statistical Learning Theory Shahar - NIPS

Statistical Learning Theory and Support Vector Machinesisn.ucsd.edu/classes/776/slides/kernel-learning.pdf · G. Cauwenberghs 520.776 Learning on Silicon Statistical Learning Theory

Application of Statistical Learning Theory to Plankton

FDA and Statistical learning theory

Statistical Learning Theory and Applications · PDF file · 2017-12-299.520 Statistical Learning Theory and Applications ... Conditions for generalizationin learning theory have deep,

Learning to Reconstruct: Statistical Learning Theory and ... · Learning to Reconstruct: Statistical Learning Theory and Encrypted Database Attacks Paul Grubbs1 Marie-Sarah Lacharit

Statistical Learning Theory - Statistics Departmentstat.wharton.upenn.edu/~rakhlin/papers/ml_summer_school.pdfIntroduction Statistical Learning Theory The Setting of SLT Consistency,

Application of Statistical Learning Theory tocbcl.mit.edu/publications/theses/thesis-mukherjee.pdf · Application of Statistical Learning Theory to DNA Microarra y Analysis b y Sa

Machine Learning Statistical Learning Theory...2019/06/02 · Machine Learning Statistical Learning Theory Gerard Pons-Moll 06.02.2019 Pons-Moll (06.02.2019) Machine Learning 1

Statistical Learning Theory of Variational ... - Watanabe Lab

Statistical Machine Learning: Introductionsejdinov/talks/pdf/2015-06-22_NoviSad.pdf · Supervised Learning Statistical Learning Theory Generative Learning We work with a joint distribution

Introduction to Statistical Learning Theory

MIT 9.520/6.860, Fall 2018 Statistical Learning Theory and ...web.mit.edu/9.520/www/fall18/slides/class02_SLT.pdf · MIT 9.520/6.860, Fall 2018 Statistical Learning Theory and Applications

Statistical Learning: Algorithms and Theory

Introduction to Statistical Learning Theory -

Statistical Learning Theory

نظریه یادگیری Instructor : Saeed Shiry. Course Overview Statistical learning theory Statistical Learning Theory The Nature of Statistical Learning

MIT 9.520/6.860, Fall 2018 Statistical Learning Theory and ...web.mit.edu/9.520/www/fall18/slides/Class06_SGD.pdf · MIT 9.520/6.860, Fall 2018 Statistical Learning Theory and Applications

Advanced Statistical Learning Theory

PhD thesis presentation Statistical Learning Theory: A PAC

Introduction to Statistical Learning Theory · Introduction to Statistical Learning Theory Julia Kempe & David S. Rosenberg NYU CDS January 29, 2019 Julia Kempe & David S. Rosenberg

An introduction to statistical learning theory · 2020. 10. 23. · An introduction to statistical learning theory Fabrice Rossi TELECOM ParisTech November 2008. About this lecture

Statistical Learning Theory · “statistical learning theory” What is the measure of simplicity? For example, number of features = the number of non-zero elements in

PhD thesis presentation Statistical Learning Theory: A PAC ...certis.enpc.fr/~audibert/Mes articles/audibert_PhD_defense.pdf · PhD thesis presentation Statistical Learning Theory:

RegML 2018 Class 1 Statistical Learning Theory - lcsl.mit.edulcsl.mit.edu/courses/regml/regml2018/slides/lect1.pdf · RegML 2018 Class 1 Statistical Learning Theory Lorenzo Rosasco

Motion estimation using statistical learning theory ...fli/papers/STL_Motion.pdf · learning, statistical learning theory, tracking, visual motion. 1INTRODUCTION L EARNING plays a

detecting fake websites: the contribution of statistical learning theory

An Introduction to Statistical Theory of Learningcseweb.ucsd.edu/~naverma/talks/intro_learning_theory_verma.pdf · An Introduction to. Statistical Theory of Learning. ... Fat margin

Geometrical Aspects of Statistical Learning Theory · Geometrical Aspects of Statistical Learning Theory Vom Fachbereich Informatik der Technischen Universit¨at Darmstadt genehmigte

Statistical Learning Theory · 2021. 1. 17. · Statistical learning theory: Theoretical guarantee for learning from limited data REFERENCE: Bousquet, Boucheron, and Lugosi. "Introduction

Economic Theory and Statistical Learning

Combining game theory and statistical learning for

An_Elementary Intro to Statistical Learning Theory