5 manova presentation stats

32
Hypothesis testing in MANOVA Steven A. Juliano & Joseph E. Fader School of Biological Sciences

Upload: vaibhav-baluni

Post on 21-Apr-2015

117 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 5 MANOVA Presentation Stats

Hypothesis testing in MANOVA

Steven A. Juliano & Joseph E. Fader

School of Biological Sciences

Page 2: 5 MANOVA Presentation Stats

MANOVAWhat is it?

• Multivariate (>1 dependent variable) tests for differences among groups

• ANOVA is a special case of MANOVA

• A very useful reference : – Scheiner, SM 2001. MANOVA: multiple response

variables and multispecies interactions. Design and Analysis of Ecological Experiments 2nd ed. (edsScheiner & Gurevitch) Oxford Univ. Press, Oxford.

• NOTE: my examples use SAS 9.2

Page 3: 5 MANOVA Presentation Stats

Do (medical) entomologists use MANOVA?

• Last 2 issues of 2009• Journal of Medical Entomology (75 papers)• Comparison: Ecology (54 papers)

0

5

10

15

20

25

30

Univariate Multivariate

Freq

uen

cy o

f p

aper

s

Approach

JME (N=31)

Ecology (N=34)

0

1

2

3

4

5

6

7

MANOVA Repeated measures Other multivariate

Freq

uen

cy o

f p

aper

s

Multivariate Approach

JME (N=9)

Ecology (N=10)

Page 4: 5 MANOVA Presentation Stats

Why you need MANOVA

• Measure >1 dependent variable

– multiple correlated responses

• Probability of any type I errors increases with number of variables

• MANOVA provides a joint test for anysignificant effects among a set of variables at 1 legitimate α

Page 5: 5 MANOVA Presentation Stats

Why you need MANOVA

• MANOVA tests for patterns

• ANOVA tests for effects on individual variables

Page 6: 5 MANOVA Presentation Stats

Why you need MANOVA

• MANOVA often more powerful than ANOVA

– greater chance to detect effects

• However MANOVA …

– Power can be reduced by irrelevant variables

– tests linear combinations of variables

• biology may dictate other combinations of variables

Page 7: 5 MANOVA Presentation Stats

Basis of MANOVA(skipping lots of detail)

• MANOVA

– COVARIANCETOTAL = total covariation among Y s

= WITHIN COVARIANCE MATRIX +

BETWEEN COVARIANCE MATRIX

– Partitioning covariance matrix

– Tests constructed as ratios of between / within covariance matrix estimates

Page 8: 5 MANOVA Presentation Stats

Basis of MANOVA(skipping lots of detail)

• MANOVA– Eigen vectors: linear combinations of

the original variables

– Ei = a + bY1 + cY2 + dY3 + …

– 1st Eigen Vector maximizes variance between groups for the resulting value

– Eigen value: amount of total variation accounted for by Eigen vector

– Subsequent Eigen vectors orthogonal (i.e., perpendicular) to all previous

Page 9: 5 MANOVA Presentation Stats

MANOVA test statisitcs

• Two common multivariate tests

– Wilk’s Λ [most commonly used]

– Pillai’s Trace [robust to violations of assumptions]

• usually give same result (identical for 2 groups)

Page 10: 5 MANOVA Presentation Stats

MANOVA

• Data requirements

– Multivariate normality

– Homogeneous covariance matrix

– cases with missing values of Yj deleted

– inference depends on relatively large sample size

• 20 / group

• 20 * number of variables

Page 11: 5 MANOVA Presentation Stats

Significant MANOVAnow what?

• Which groups differ?

– multivariate question

– homologous to ANOVA follow-up

• Which variables contribute most to any difference?

– new kind of question

Page 12: 5 MANOVA Presentation Stats

Significant MANOVA

• Multivariate contrasts – CONTRAST statement comes before MANOVA

statement

– Also for pairwise comparisons

– correction for multiple tests (e.g., Bonferroni)

• MANOVA Statement

– Use “… H=_ALL_ …” option

Page 13: 5 MANOVA Presentation Stats

Significant MANOVA

• Which variables contribute to the difference?

• Two approaches

– Univariate: follow MANOVA with univariateANOVAs on each variable

– Multivariate

Page 14: 5 MANOVA Presentation Stats

Significant MANOVA

• Multivariate: follow MANOVA with Canonical Variate Analysis

• Canonical variates

– Eigen vectors scaled to unit variance

– Standardized canonical coefficients describe contribution of each dependent variable to a function describing differences among groups.

Page 15: 5 MANOVA Presentation Stats

Canonical coefficients

• Potential problems– Depend on which Y variables are included

• different results & interpretation if different variables are omitted

– Fewer readers immediately know what you are doing• cite Scheiner

– “greater contribution” is subjective

Page 16: 5 MANOVA Presentation Stats

Example: Effect of aggregation on competition

• Aedes albopictus(dominant competitor)

• Aedes aegypti(poorer competitor)

Aedes aegypti\

Aedes albopictus

Aedes aegypti

Aedes albopictus

Page 17: 5 MANOVA Presentation Stats

Effect of aggregation on competition

• Theory: As dominant competitor becomes more aggregated in space, effect of competition on poorer competitor declines

• Ideal: measure effect of aggregation on dN/Ndt

• Practical: MANOVA on life history correlates of dN/Ndt– Survivorship

– Adult female size

– Development time

Page 18: 5 MANOVA Presentation Stats

Effect of aggregation on competition

• Replicate = 8 containers

• Cohort = 80 Larvae

• Standard food, temperature

• Determine response of Aedesaegypti

10 aeg+ 10 alb

x8

No Aggregation

10 aeg

x6

10 aeg+ 40 alb x2

Medium Aggregation

10 aeg

x7

10 aeg+ 80 alb

x1

High Aggregation

10 aeg

x8

Control

10 aeg+ 20 albx4

10 aeg

x4

Low Aggregation

Page 19: 5 MANOVA Presentation Stats

MANOVApart 1. Basic MANOVA Table

Source Df, Df Pillai’sTrace

P Eigen value

% Variance

Block 3, 28 0.855 <0.0001

Treatment 12, 90 1.317 <0.0001 1st 9.30 94%

2nd 0.44 4%

3rd 0.12 1%

Interaction 12,90 0.207 0.8721

Page 20: 5 MANOVA Presentation Stats

MANOVApart 2. Which variables contribute to effects?

Standardized Canonical Coefficients

Source Eigen value

% Var.

Prop. Surviving

Wing length

Devel. time

Treatment 1st 9.30 94% -0.21 -2.92 0.76

2nd 0.44 4% 1.12 -0.24 -0.09

Page 21: 5 MANOVA Presentation Stats

MANOVApart 3. comparing groups

7.20

7.40

7.60

7.80

8.00

8.20

8.40

8.60

8.80

2.25 2.50 2.75

Fem

ale

me

dia

n t

ime

to

ad

ult

(d

)

Female mean wing Length (mm)

Medium aggregation

No Aggregation

High aggregation

Low aggregation

Control

A

B

B

CC

Page 22: 5 MANOVA Presentation Stats

MANOVApart 3. comparing groups

0.82

0.84

0.86

0.88

0.90

0.92

0.94

0.96

2.25 2.50 2.75

Pro

po

rtio

n s

urv

ivo

rsh

ip

Female mean wing Length (mm)

Medium aggregation

No Aggregation

High aggregation

Low aggregation

Control

B

B

A

C

C

Page 23: 5 MANOVA Presentation Stats

Is MANOVA best?

• MANOVA combines variables in linear combinations

• Biological hypotheses may predict effects on nonlinear, non-additive combinations

• Biological meaning should take precedence over statistical convenience

Page 24: 5 MANOVA Presentation Stats

Effect of aggregation on competition

• Theory: predicts effect of aggregation on dN/Ndt

• Estimate from demographic measurements

• Do MANOVA and estimated dN/Ndt yield same conclusions?

Page 25: 5 MANOVA Presentation Stats

Estimating rate of increase from demography

N = number of females

lx = probability that female survives to day x

mx = number of female offspring per female on day x

R0 = basic reproductive rate

= expected number of surviving offspring per female

TC = cohort generation time

= mean time between birth of mother and birth of young

ln ∑ lx mx

x=1 ln(R0 )

dN/Ndt = —————————— = ————

[∑ x lx mx /∑ lx mx ] Tc

x=1 x=1

Page 26: 5 MANOVA Presentation Stats

Index of performance (est. rate of increase)Livdahl & Sugihara 1984 J. Anim. Ecol.

ln [ (1/N0) ∑ Ax f(wx) ]x=1

r´ = ——————————————

D + [ x ∑ Ax f(wx) /∑ Ax f(wx) ]x=1 x=1

N0 = initial number of females (assumed ½ cohort)

Ax = number females eclosing on day x

x = days since hatching of cohort

wx = mean size of females eclosing on day x

f(wx) = function predicting female eggs based on size wx

D = days from eclosion to oviposition

Page 27: 5 MANOVA Presentation Stats

r’ from the aggregation experiment

Source Df F P

Block 1 36.48 0.0001

Treatment 4 16.46 0.0001

Block * Treatment 4 0.26 0.9027

Error 30

Page 28: 5 MANOVA Presentation Stats

ANOVAon r’ index of population performance

0.11

0.12

0.13

0.14

0.15

Control High Medium Low No

ind

ex

of

pe

rfo

rman

ce r

'

Treatment

A

A

B

BC

C

Page 29: 5 MANOVA Presentation Stats

Conclusions

• Analysis of biologically-derived index vs. MANOVA yield similar, not identical conclusions

– MANOVA: linear combinations, based on statistics

– Index: nonlinear combinations, based on biology

– When possible, using biologically-derived synthesis of multiple variables is desirable

– In the absence of a priori synthesis of variables, MANOVA desirable

Page 30: 5 MANOVA Presentation Stats

Acknowledgements

L. Philip Lounibos

George F. O’Meara

Cynthia Lord

Joe Fader Paul O’Neal Ebony Murrell Colleen Stephens Jen Breaux Scott Chism Stefani Brandt

R01-AI44793

Page 31: 5 MANOVA Presentation Stats

SAS GLM code

TITLE 'MULTIVARIATE ANALYSIS OF PERFORMANCE VARIABLES';proc glm data=fader1 /* GLM for unbalance designs */ ;

class block treat /* treat = treatments */;model psurv meaned meanwl = block treat block*treat / ss3

/* type III sums of squares for unbalanced designs */ ;lsmeans treat block*treat / stderr pdiff;contrast 'con vs uniform' treat 1 -1 0 0 0

/* contrast statements test pairwise differences */;contrast 'con vs half' treat 1 0 -1 0 0;contrast 'con vs quart' treat 1 0 0 -1 0;contrast 'con vs one' treat 1 0 0 0 -1;contrast 'unif vs half' treat 0 1 -1 0 0 ;contrast 'unif vs quart' treat 0 1 0 -1 0 ;contrast 'unif vs one' treat 0 1 0 0 -1 ;contrast 'half vs quart' treat 0 0 1 -1 0 ;contrast 'half vs one' treat 0 0 1 0 -1 ;contrast 'quart vs one' treat 0 0 0 1 -1;manova h=_ALL_ / canonical/* yields multivariate analysis & canonical coefficients */;

run;

Page 32: 5 MANOVA Presentation Stats

References for MANOVA Scheiner, SM 2001. MANOVA: multiple response variables and multispecies interactions. Design and Analysis of Ecological Experiments 2nd ed. (eds Scheiner & Gurevitch) Oxford Univ. Press, Oxford. Livdahl, T. P., and G. Sugihara. 1984. Non-linear interactions of populations and the importance of estimating per capita rates of change. Journal of Animal Ecology 53:573–580. SAS Institute. 2003. SAS user’s guide. Statistics. Version 9.1. SAS Institute, Cary, North Carolina, USA.