![Page 1: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/1.jpg)
1
White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorial
Part II
![Page 2: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/2.jpg)
2
![Page 3: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/3.jpg)
3
![Page 4: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/4.jpg)
4
= Ct,h
Example: for (ht + htthh), we get p(d|m) = 3!2!/6!
![Page 5: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/5.jpg)
5
![Page 6: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/6.jpg)
6
Numerical example for the network X1 X2
Imaginary sample sizes denoted N’ijk
Data: (true, true) and (true, false)
![Page 7: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/7.jpg)
7
![Page 8: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/8.jpg)
8
Used so far
Desired
![Page 9: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/9.jpg)
9
How do we assign structure and parameter priors ?
Structure priors: Uniform, partial order (allowed/prohibited edges), proportional to similarity to some a priori network.
![Page 10: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/10.jpg)
10
BDeK2
![Page 11: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/11.jpg)
11
![Page 12: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/12.jpg)
12
![Page 13: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/13.jpg)
13
![Page 14: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/14.jpg)
14
)|()1(
)1()|( h
yxyxxx
yyhxyxy mpmp
![Page 15: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/15.jpg)
15
![Page 16: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/16.jpg)
16
![Page 17: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/17.jpg)
17
![Page 18: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/18.jpg)
18
Example: Suppose the hyper distribution for (X1,X2) is Dir( a00, a01 ,a10, a11).
So how to generate parameter priors?
![Page 19: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/19.jpg)
19
Example: Suppose the hyper distribution for (X1,X2) is Dir( a00, a01 ,a10, a11)This determines a Dirichlet distribution for the parameters of both directed models.
![Page 20: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/20.jpg)
20
![Page 21: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/21.jpg)
21
Summary: Suppose the parameters for (X1,X2) are distributed Dir( a00, a01 ,a10, a11).Then, parameters for X1 are distributed Dir(a00+a01 ,a10+a11).Similarly, parameters for X2 are distributed Dir(a00+a10 ,a01+a11).
![Page 22: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/22.jpg)
22
BDe score:
![Page 23: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/23.jpg)
23
![Page 24: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/24.jpg)
24
![Page 25: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/25.jpg)
25
![Page 26: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/26.jpg)
26
Example: f(x+y) = f(x) f(y)Example: f(x+y) = f(x) f(y)Solution: (ln f )`(x+y) = (ln f )`(x) Solution: (ln f )`(x+y) = (ln f )`(x) and so: (ln f )`(x) = constantand so: (ln f )`(x) = constantHence: (ln f )(x) = linear functionHence: (ln f )(x) = linear functionhence: f(x) = c ehence: f(x) = c eaxax Assumptions: Positive everywhere, DifferentiableAssumptions: Positive everywhere, Differentiable
Functional Equations Example
![Page 27: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/27.jpg)
27
The bivariate discrete case
![Page 28: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/28.jpg)
28
The bivariate discrete case
![Page 29: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/29.jpg)
29
The bivariate discrete case
![Page 30: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/30.jpg)
30
The bivariate discrete case
![Page 31: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/31.jpg)
31
![Page 32: 1 White Parts from: Technical overview for machine-learning researcher – slides from UAI 1999 tutorialTechnical overview for machine-learning researcher](https://reader030.vdocument.in/reader030/viewer/2022032704/56649d555503460f94a32514/html5/thumbnails/32.jpg)
32