Transcript
Page 1: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Logistic Regression III: Advanced Logistic Regression III: Advanced topics topics

Page 2: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Conditional Logistic Regression for Conditional Logistic Regression for Matched DataMatched Data

Page 3: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Recall: MatchingRecall: MatchingMatching can control for extraneous

sources of variability and increase the power of a statistical test.

Match M controls to each case based on potential confounders, such as age and gender.

If the data are matched, you must account for the matching in the statistical analysis!!

Page 4: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Recall: Recall: Agresti Agresti example, example, diabetes and MIdiabetes and MI

Match each MI case to an MI control based on age and gender.

Ask about history of diabetes to find out if diabetes increases your risk for MI.

Page 5: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Diabetes

No diabetes

25 119

Diabetes No Diabetes

9 37

16 82

46

98

144

MI cases

MI controls

odds(“favors” case/discordant pair) =

16

37

c

bOR

Page 6: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Conditional Logistic RegressionConditional Logistic Regression

Page 7: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

The Conditional Likelihood: The Conditional Likelihood: each each discordant discordant stratumstratum (rather than individual) (rather than individual) gets 1 term in the likelihoodgets 1 term in the likelihood

xDPDPDPDP

DPDP

i

)exposurescontrol/(*)exposurescase/(~)exposurescontrol/(~*)exposurescase/(

)exposurescontrol/(~*)exposurescase/(strata all

1

Note: the marginal probability of disease may differ in each age-gender stratum, but we assume that the (multiplicative) increase in disease risk due to exposure is constant across strata.

For each stratum, we add to the likelihood: the CONDITIONAL probability that the case got disease and the control did not, given that we have a case-control pair.

The numerator is the probability (as a function of exposures) that the case gets disease and the control does not.

The denominator is the probability that the case gets disease and the control does not OR that the control (with all her exposures) gets disease and the case doesn’t (with all her exposure).

Page 8: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Recall probability terms:Recall probability terms:

e

eEDP

1)/(

e

eEDP

1)~/(

eEDP

1

1)/(~

eEDP

1

1)~/(~

α)0(α))~/(1

)~/(ln(

)1(α))/(1

)/(ln(

EDP

EDP

EDP

EDP

Page 9: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Diabetes

No diabetes

Case (MI) Control

1 1

0 0

Diabetes

No diabetes

Case (MI) Control

1 0

0 1

Diabetes

No diabetes

Case (MI) Control

0 1

1 0

Diabetes

No diabetes

Case (MI) Control

0 0

1 1

iiii

i

ii

i

ee

e

ee

eee

e

L

1

1*

11

1*

1

1

1*

1),(

ii

i

ii

i

ii

i

ee

e

ee

eee

e

L

1

1*

11

1*

1

1

1*

1),(

1

1*

11

11

*1

11

*1),(

i

i

iii

i

ii

i

ee

eeee

eee

L

1

1*

1

1

1

1*

1

1

1*

1),(

i

i

iii

i

ii

i

e

e

eee

eee

e

L

Page 10: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

The conditional likelihood=The conditional likelihood=

case favor thethat strata discordant

1i

control favor the that strata discordant

1

1*

1

1

1

1*

1

1

1*

1

1

1*

11*

1

11

*1

1

n

m

j

i

i

iii

i

ii

i

jj

j

j

j

j

j

j

j

e

e

eee

eee

e

x

ee

e

e

e

e

e

e

e

Each age-gender stratum has the same baseline odds of disease; but these

baseline odds may differ across strata

Page 11: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Conditional Logistic RegressionConditional Logistic Regression

case favor thethat

strata discordant

1

control favor thethat strata discordant

1j

n

i

m

ii

i

jj

j

ee

ex

ee

e

nmn

i

m

j e

e

ee

ex

e

e i

)1

()1

1(

1

1

1

parameter) nuisance of rid (gets !cancel! s' The***

11

Page 12: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Example: MI and diabetesExample: MI and diabetes

3716 )1

()1

1()L(

e

e

e

Page 13: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Conditional Logistic RegressionConditional Logistic Regression

16

37

1637

53)137(

01

53-37

dlog(L)

)1log(*5337)log(

e

e

ee

e

e

d

eL

Page 14: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

In SAS…In SAS…

proc logistic data = YourData;model MI (event = "Yes") = diabetes;strata PairID;run;

Page 15: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Could there be an association between exposure to ultrasound in utero and an increased risk of childhood malignancies?

Previous studies have found no association, but they have had poor statistical power to detect an association.

Swedish researchers performed a nationwide population based case-control study using prospectively assembled data on prenatal exposure to ultrasound.

Example:Example:Prenatal ultrasound examinations and risk Prenatal ultrasound examinations and risk of childhood leukemia: case-control study of childhood leukemia: case-control study

BMJBMJ 2000;320:282-283 2000;320:282-283

Page 16: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Example:Example:Prenatal ultrasound examinations and risk Prenatal ultrasound examinations and risk of childhood leukemia: case-control study of childhood leukemia: case-control study

BMJBMJ 2000;320:282-283 2000;320:282-283

535 cases: all children born and diagnosed as having myeloid leukemia between 1973 and 1989 in Swedish registers of birth, cancer, and causes of death.

535 matched controls: 1 control was randomly selected for each case from the Swedish Birth Registry, matched by sex and year and month of birth.

Page 17: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Ultrasound

No ultrasound

215 320

Ultrasound No Ultrasound

200

335

535

Leukemia cases

Myeloid leukemia controls

235100

115 85

85.100

85

c

bOR

But this type of analysis is limited to single dichotomous exposure…

Page 18: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Used conditional logistic regression to look at dose-response with number of ultrasounds:

Results: Reference OR = 1.0; no ultrasounds OR =.91 for 1-2 ultrasounds OR=.64 for >=3 ultrasounds

Conclusion: no evidence of a positive association between prenatal ultrasound and childhood leukemia; even evidence of inverse association (which could be explained by reasons for frequent ultrasound)

Page 19: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Each term in the likelihood represents a stratum of 1+M individuals

More complicated likelihood expression! Just as easy to implement in SAS as we’ll

see Wednesday…

Extension: 1:M matchingExtension: 1:M matching

Page 20: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Ordinal Logistic Regression Ordinal Logistic Regression

Page 21: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Ordinal Logistic RegressionOrdinal Logistic Regression

What if your outcome variable has more than two levels?

For ordinal outcomes, use ordinal logistic regression:

*Relies on the cumulative logit*Models the predicted probability of multiple

outcomes*Also known as the “proportional odds model”

Page 22: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Ordinal Variable Example: Likert Ordinal Variable Example: Likert ScaleScale

1 = strongly disagree2 = disagree3 = neutral 4 = agree5 = strongly agree

Cumulative outcomes:

*strongly agree vs. the rest

*agree or strongly agree vs. neutral or negative

*agree or neutral vs. negative

*the rest vs. strongly negative

Ordinal logistic regression gives you a way to model these cumulative outcomes all at once!

Page 23: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Ordinal Variable Example: Continuous Ordinal Variable Example: Continuous variable measured crudelyvariable measured crudely

1 = breastfed >=6 months

2 = breastfed 4-5 months

3 = breastfed 2-3 months

4 = breastfed <2 months

The outcome variable, breastfeeding, was only measured at limited time

points. So, may not be best modeled as continuous variable in linear regression. Use ordinal logistic!

Page 24: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

More inclusive

definition of a “positive”

outcome

Another example, 3 levels:Another example, 3 levels:

1 = eumenorrhea (normal menses) (66.6%)

2 = oligomenorrhea (mild irregularity) (24.6%)

3 = amenorrhea (severe irregularity) (8.6%)

From my data on runners:

Most “severe” outcome

Page 25: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Cumulative logit, 3 groupsCumulative logit, 3 groups(2 potential “positive” outcomes)(2 potential “positive” outcomes)

normal

rheaoligomenoror amenorrhea

normalor reaoligomenor

amenorrhea

logty irregulariany for logit cumulative

log amenorrheafor logit cumulative

p

p

p

p

In words:

The log odds of having amenorrhea (versus everything else).

And the log odds of having any irregularity (versus normal).

Page 26: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Corresponding logistic model (no Corresponding logistic model (no predictors)predictors)

The intercept-only model, no predictors (two intercepts!):

Log odds (amenorrhea)= amen

Log odds (any irregularity)= amen or oligo

Page 27: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Fitted model:Fitted model:Logit of amenorreha=

8.6% of my sample has amenorrhea

Odds = 8.6/91.4=.094

Ln (.094) = -2.3623

Logit of any irregularity=

33.3% has any irregularity (24.6% + 8.6%)

Odds=(1/3)/(2/3) = 1/2

Ln(1/2) = -.70

Fitted models are: Log odds (amenorrhea)= -2.36 Log odds (any irregularity)= -0.70

Page 28: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Logistic model with predictors:Logistic model with predictors:

Log odds (amenorrhea)= amen + β1*X1 + β2*X2

Log odds (any irregularity)= amen or oligo + β1*X1 + β2*X2

Note, different intercepts but shared betas (shared slopes)!

Page 29: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Odds ratio interpretation (a):Odds ratio interpretation (a):

unexposed for the amenorrhea of odds

exposed for the amenorrhea of oddsOR

)1()0(

)1()1(

exp

exp

confounderosureamen

confounderosureamen

e

e

)1()1(

exp

exp

1osure

osure

ee

)1()0(

)1()1(

exp

exp

confounderosureamen

confounderosureamen

e

e

Page 30: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Odds ratio interpretation (b):Odds ratio interpretation (b):

unexposed for thety irregulari menstrualany of odds

exposed for thety irregulari menstrualany of oddsOR

)1()0(

)1()1(

exp

exp

confounderosureoamenorolig

confounderosureoamenorolig

e

e

)1()1(

exp

exp

1osure

osure

ee

)1()0(

)1()1(

exp

exp

confounderosureoamenorolig

confounderosureoamenorolig

e

e

Page 31: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Odds ratio interpretation:Odds ratio interpretation:

Interpretation of the betas:

eβ = adjusted odds ratio

For every 1-unit increase in X, it’s the increase in the odds of any menstrual irregularity compared with none and it’s also the increase in the odds of amenorrhea compared with the other two categories (adjusted for any other predictors in the model).

Note: proportional odds assumption! The odds ratios are the same across different levels of the outcome.

Page 32: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Example predictor, EDI-A:Example predictor, EDI-A:

Score on the anorexia subscale of the eating disorder inventory (EDI-A)

Page 33: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Cumulative logit plot (4 bins)Cumulative logit plot (4 bins)

The intercept for any irregularity (the log odds of any irregularity where EDI-A=0)

The intercept for amenorrhea (the

log odds of amenorrhea where

EDI-A=0)

These lines should be linear and parallel (equal slopes, one beta!)

The slopes represent the increase in the log odds of either outcome for every 1-unit increase in EDI-A score.

Page 34: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Fitted model with EDI-A:Fitted model with EDI-A:

Analysis of Maximum Likelihood Estimates

Standard WaldParameter DF Estimate Error Chi-Square Pr > ChiSq

Intercept 1 1 -3.2630 0.3823 72.8648 <.0001Intercept 2 1 -1.3888 0.2478 31.4220 <.0001EDIA 1 0.1211 0.0265 20.9065 <.0001

Log odds (amen)= -3.2630 + 0.1211*EDI-A

Log odds (any irregularity)= -1.3888 + 0.1211*EDI-A

Page 35: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Fitted Model: Predicted logit at Fitted Model: Predicted logit at every level of EDI-Aevery level of EDI-A

Page 36: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Compare actual data and fitted Compare actual data and fitted model:model:

Page 37: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Fitted model with EDI-A:Fitted model with EDI-A:

Odds Ratio Estimates

Point 95% WaldEffect Estimate Confidence Limits

EDIA 1.129 1.072 1.189

For every 1-unit increase in EDI-A score, there’s a 13% increase in the odds of being amenorrheic versus the other two categories and a 13% increase in the odds of being amenorrheic or oligomenorrheic versus normal.

Page 38: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Predictions:Predictions:

Log odds (outcome)= -3.2630 + -1.3888 + 0.1211*EDIA-1

The model predicts that a woman with an EDI-A score of 15 would have:

%5.6011

1)tyirregulariP(any

%1911

1)P(amen

4281.

4281.

)15(1211.3888.1

)15(1211.3888.1

4461.1

4461.1

)15(1211.2630.3

)15(1211.2630.3

e

e

e

e

e

e

e

e

Page 39: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Predictions:Predictions:

Predicted logit=-1.446

Predicted probability = 19%

Predicted logit=.4281

Predicted probability = 60.5%50%

probability line

Page 40: Logistic Regression III: Advanced topics Conditional Logistic Regression for Matched Data Conditional Logistic Regression for Matched Data

Advantages & disadvantagesAdvantages & disadvantages

Ordinal logistic is better than running separate logistic models for different outcomes (e.g., one model for amenorrhea, one model for any irregularity) because of the improvement in statistical power!

Ordinal logistic prevents you from having to arbitrarily turn an ordinal variable into a binary variable!

But does require that you meet the proportional odds assumption…


Top Related