conceptual thinking about the unknown uncertainty: expected value, sensitivity analysis, and the...
Post on 20-Dec-2015
218 views
TRANSCRIPT
![Page 1: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/1.jpg)
Conceptual thinking about the unknown
Uncertainty: expected value, sensitivity analysis, and the value of information
![Page 2: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/2.jpg)
Review 1Review 1
• Your problem is not as unique as you think it is
• You have more data than you think you have
• You need less data than you think you need
• There is a useful measure that is much simpler than you think it is
• Your problem is not as unique as you think it is
• You have more data than you think you have
• You need less data than you think you need
• There is a useful measure that is much simpler than you think it is
![Page 3: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/3.jpg)
Review 2Review 2
• If it matters, it is detectable/observable
• If it can be detected, it can be detected as an amount (or range of possible amounts)
• If it can be detected as a range of possible amounts, it can be measured
• If it matters, it is detectable/observable
• If it can be detected, it can be detected as an amount (or range of possible amounts)
• If it can be detected as a range of possible amounts, it can be measured
![Page 4: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/4.jpg)
Review 3Review 3
• Write down a number
• Break it down into pieces (decomposition)
• Try different decompositions
• Average
• Write down a number
• Break it down into pieces (decomposition)
• Try different decompositions
• Average
![Page 5: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/5.jpg)
Clarifying the measurement problemClarifying the measurement problem
• What is the decision this is supposed to support?
• What really is the thing being measured?
• Why does this thing matter to the decision?
• What do you know about it now?• What is the value of knowing more?
• What is the decision this is supposed to support?
• What really is the thing being measured?
• Why does this thing matter to the decision?
• What do you know about it now?• What is the value of knowing more?
![Page 6: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/6.jpg)
CalibrationCalibration
There are two extremes of subjective confidence:
Over confidence
Under confidence
There are two extremes of subjective confidence:
Over confidence
Under confidence
![Page 7: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/7.jpg)
Uncertainty and RiskUncertainty and Risk
• Uncertainty = The lack of complete certainty. That is, more than one outcome is possible, so that the true outcome/SON/result/value is not known
• Risk = uncertainty involving hazard. That is, some outcomes are bad, involve a loss, or where they are all bad, some are catastrophic
• Uncertainty = The lack of complete certainty. That is, more than one outcome is possible, so that the true outcome/SON/result/value is not known
• Risk = uncertainty involving hazard. That is, some outcomes are bad, involve a loss, or where they are all bad, some are catastrophic
![Page 8: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/8.jpg)
EXPECTED VALUE ANALYSISEXPECTED VALUE ANALYSIS
• Consists of modeling uncertainty as a set of contingencies that are exhaustive and mutually exclusive with specific probabilities of occurrence.
• In practice, this means the analyst identifies representative contingencies and assigns probabilities to each of them so that they sum to one.
• The probabilities can be based on historically observed frequencies, subjective assessments, or experts (based on information, theory, or both).
• Consists of modeling uncertainty as a set of contingencies that are exhaustive and mutually exclusive with specific probabilities of occurrence.
• In practice, this means the analyst identifies representative contingencies and assigns probabilities to each of them so that they sum to one.
• The probabilities can be based on historically observed frequencies, subjective assessments, or experts (based on information, theory, or both).
![Page 9: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/9.jpg)
Calculating the expected value of net benefitsCalculating the expected value of net benefits
• Calculate the net benefits of each contingency
• Multiply by that contingency's probability of occurrence.
• Sum the weighted benefits
E(NB) = Pi (Bi - Ci)
• Calculate the net benefits of each contingency
• Multiply by that contingency's probability of occurrence.
• Sum the weighted benefits
E(NB) = Pi (Bi - Ci)
![Page 10: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/10.jpg)
Representativeness of contingenciesRepresentativeness of contingencies
![Page 11: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/11.jpg)
Specification of contingenciesSpecification of contingencies
Annualized Annualized Annualized Annualizedcrop value with
irrigationcrop value
without irrigation
cost of dam &
distribution system
net benefit EX(P) V|P EX(P) V|P
$4,500,000 $0 $200,000 $4,300,000 0.10 $430,000 0.05 2150004,500,000 2,800,000 200,000 $1,500,000 0.12 $180,0004,500,000 3,700,000 200,000 $600,000 0.80 $480,000 0.66 $396,0004,000,000 3,600,000 200,000 $200,000 0.12 $24,0003,000,000 2,800,000 200,000 $0 0.10 $0 0.05 $0
$910,000 1.00 $815,000
![Page 12: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/12.jpg)
Decision trees and expected NBDecision trees and expected NB
Decision analysis has two stages. - First, one specifies the logical structure of the
decision problem in terms of sequences of decisions and realizations of contingencies using a diagram (called a decision tree) that links an initial decision to final outcomes.
- Second, one works backwards from final outcomes to the initial decision, calculating expected values of net benefits across contingencies and pruning dominated branches (ones with lower expected values of net benefits).
Decision analysis has two stages. - First, one specifies the logical structure of the
decision problem in terms of sequences of decisions and realizations of contingencies using a diagram (called a decision tree) that links an initial decision to final outcomes.
- Second, one works backwards from final outcomes to the initial decision, calculating expected values of net benefits across contingencies and pruning dominated branches (ones with lower expected values of net benefits).
![Page 13: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/13.jpg)
Vaccine exampleVaccine example
• Present value of expected net benefits of the vaccination program is simply E(CNV) - E(CV) (i.e., the expected value of the costs when not implementing the program minus the expected costs when implementing the program).
• Present value of expected net benefits of the vaccination program is simply E(CNV) - E(CV) (i.e., the expected value of the costs when not implementing the program minus the expected costs when implementing the program).
![Page 14: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/14.jpg)
Decision tree for vaccination program analysisDecision tree for vaccination program analysis
![Page 15: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/15.jpg)
What’s up for grabs?What’s up for grabs?
• Population at risk- Total Population (round to
10K)
- Fraction High Risk ?
• Infection Rate ?• Mortality Rate ?
- Value of Life ?
• Time lost to Flu ?- Opportunity Cost of Time ?
• Chance of Epidemic- First Year ?
- Second Year ?
• Population at risk- Total Population (round to
10K)
- Fraction High Risk ?
• Infection Rate ?• Mortality Rate ?
- Value of Life ?
• Time lost to Flu ?- Opportunity Cost of Time ?
• Chance of Epidemic- First Year ?
- Second Year ?
• Total number of people vaccinated
• Vaccination Rate • Administrative Costs
- Overheads (Fixed)- Dose Price (Variable)
• Adverse Reaction Rate ?• Herd Immunity Rate ?• Vaccine Effectiveness
Rate?• Discount Rate ?
• Total number of people vaccinated
• Vaccination Rate • Administrative Costs
- Overheads (Fixed)- Dose Price (Variable)
• Adverse Reaction Rate ?• Herd Immunity Rate ?• Vaccine Effectiveness
Rate?• Discount Rate ?
![Page 16: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/16.jpg)
Expected net benefits of vaccinationsExpected net benefits of vaccinations
![Page 17: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/17.jpg)
Expected net benefits of vaccinationsExpected net benefits of vaccinations
![Page 18: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/18.jpg)
Worst; best case analysisWorst; best case analysis
• What are our maximum downside risks if we take no action?
• What if we do?
• What are our maximum downside risks if we take no action?
• What if we do?
![Page 19: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/19.jpg)
Histogram of realized net benefitsHistogram of realized net benefits
![Page 20: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/20.jpg)
The cost and value of informationThe cost and value of information
• Perfect information?• Imperfect information?• Quasi-option value
• Perfect information?• Imperfect information?• Quasi-option value
![Page 21: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/21.jpg)
Exogenous learningExogenous learning
![Page 22: Conceptual thinking about the unknown Uncertainty: expected value, sensitivity analysis, and the value of information](https://reader036.vdocument.in/reader036/viewer/2022062714/56649d455503460f94a224f3/html5/thumbnails/22.jpg)
Endogenous learningEndogenous learning