chapter 7 conditional probability models - korea...

44
Chapter 7 Conditional Probability Models Chang-Su Kim Korea University These notes are modified from the files, provided by R. D. Yates and D. J. Goodman who are the authors of the textbook “Probability and Stochastic Processes,” and can be used only for the class KECE209(03) in Korea University.

Upload: lytruc

Post on 05-Mar-2018

223 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim

Chapter 7Conditional Probability Models

Chang-Su KimKorea University

These notes are modified from the files, provided by R. D. Yates and D. J. Goodman who are the authors of the textbook “Probability and Stochastic Processes,” and can be used only for the class KECE209(03) in Korea University.

Page 2: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim

Terminology Using a Dice Example

Sample space: 𝑆𝑆𝑋𝑋 = 1, 2, 3, 4, 5, 6Event: 𝐵𝐵 = 2, 4, 6 ⊂ 𝑆𝑆𝑋𝑋Conditional Probability: 𝑃𝑃𝑋𝑋|𝐵𝐵 4 = P[𝑋𝑋 = 4|𝐵𝐵]

= probability that outcome 4 occurs given that B happens

Page 3: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 4: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 5: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 6: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 7: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 8: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 9: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim

Caution: In this example, 𝐻𝐻 and 𝑁𝑁 are not subsets of 𝑆𝑆𝑋𝑋

Page 10: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim

Caution: In this example, 𝐵𝐵0 and 𝐵𝐵1 are not subsets of 𝑆𝑆𝑋𝑋

Page 11: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 12: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 13: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 14: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 15: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 16: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 17: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim

𝑃𝑃𝑋𝑋,𝑌𝑌|𝐵𝐵 𝑥𝑥,𝑦𝑦 : conditional PMF𝑓𝑓𝑋𝑋,𝑌𝑌|𝐵𝐵 𝑥𝑥,𝑦𝑦 : conditional PDF𝐸𝐸[𝑔𝑔(𝑋𝑋,𝑌𝑌)|𝐵𝐵]: conditional expectation

Page 18: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 19: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 20: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 21: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 22: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 23: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 24: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 25: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 26: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 27: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 28: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 29: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 30: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 31: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 32: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 33: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 34: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim

𝐸𝐸 𝐸𝐸 𝑋𝑋 𝑌𝑌 = 𝐸𝐸 𝑔𝑔 𝑌𝑌 = �𝑦𝑦

𝑔𝑔 𝑦𝑦 𝑃𝑃𝑌𝑌(𝑦𝑦)

Page 35: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 36: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 37: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim

Optional

Page 38: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 39: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 40: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 41: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 42: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim

About correlation coefficient 𝝆𝝆𝑿𝑿,𝒀𝒀

Page 43: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim
Page 44: Chapter 7 Conditional Probability Models - Korea Universitymcl.korea.ac.kr/wp-content/uploads/2016/05/Chap-7-Conditional... · Chapter 7 Conditional Probability Models Chang-Su Kim