![Page 1: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/1.jpg)
The Need For Resampling In Multiple testing
![Page 2: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/2.jpg)
Correlation Structures
Tukey’s T Method exploit the correlation structure between the test statistics, and have somewhat smaller critical value than the Bonferroni-style critical values.
It is easier to obtain a statistically significant result when correlation structures are incorporated.
![Page 3: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/3.jpg)
Correlation Structures
The incorporation of correlation structure results in a smaller adjusted p-value than Bonferroni-style adjustment, again resulting in more powerful tests.
The incorporation of correlation structures can be very important when the correlations are extremely large.
![Page 4: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/4.jpg)
Correlation Structures
Often, certain variables are recognized as duplicating information and are dropped, or perhaps the variables are combined into a single measure.
In the case, the correlations among the resulting variables is less extreme.
![Page 5: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/5.jpg)
Correlation Structures
In cases of moderate correlation structures, the distribution between the Bonferroni adjustment and the exact adjustment can be very slight.
Bonferroni inequality:
Pr{∩1r Ai} 1-Σ≧ 1
r Pr{Aic}
A small value of ‘’Pr{Aic}’’corresponds to a sm
all per-comparison error rate.
![Page 6: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/6.jpg)
Correlation Structures
The incorporating dependence structure becomes less important for smaller significant levels.
If a Bonferroni-style correction is reasonable, then why bother with resampling?
![Page 7: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/7.jpg)
Distributional Characteristics
Other distributional characteristics, such as discreteness and skewness, can have dramatic effect, even for small p-value.
The nonnormality is of equal or greater concern than correlation structure in multiple testing application.
![Page 8: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/8.jpg)
The Need For Resampling In Multiple testing
Distribution Of Extremal Statistics Under Nonnor
mality
![Page 9: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/9.jpg)
Noreen’s analysis of tests for a single lognormal mean
Yij are observations. i=1,..,10, j=1,..,n All observations are independent and identic
ally distributed as ez, where Z denotes a standard normal random variable.
The hypotheses tested are Hi: E(Yij)=√e, with upper or lower-tailed alternatives.
t=(y-√e)/(s/√n)
_
![Page 10: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/10.jpg)
Distributions of t-statistics
For each graph there were 40000 t-statistics, all simulated using lognormal yij.
The solid lines (actual) show the distribution of t when sampling from lognormal population, and the dotted lines (nominal) show the distribution of t when sampling from normal population.
![Page 11: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/11.jpg)
Distributions of t-statistics
![Page 12: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/12.jpg)
Distributions of t-statistics
The lower tail area of the actual distribution of t-statistic is larger than the corresponding tail of the approximating Student’s t-distribution, the lower-tailed test rejects H more often than it should.
The upper tail area of the actual distribution is smaller than that of the approximating t-distribution, yielding fewer rejections than expected.
![Page 13: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/13.jpg)
Distributions of t-statistics
As can be expected with larger sample sizes, the approximations become better, and the actual proportion of rejections more closely approximates the nominal proportion.
![Page 14: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/14.jpg)
Distributions of minimum and maximal t-statistics
When one considers maximal and minimal t-statistics, the effect of the skewness is greatly amplified.
![Page 15: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/15.jpg)
Distributions of minimum t-statistics
![Page 16: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/16.jpg)
Distributions of minimum t-statistics (lower-tail)
Because values in the extreme lower tails of the actual distributions are much more likely than under the corresponding t-distribution, the possibility of observing a significant result can be much larger than expected under the assumption of normal data.
This cause false significances.
![Page 17: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/17.jpg)
Distributions of minimum t-statistics (upper-tail)
It is quit difficult to achieve a significant upper-tailed test, since the true distributions are so sharply curtailed in the upper tails.
It has very lower power, and will likely fail to detect alternative hypotheses.
![Page 18: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/18.jpg)
Distributions of maximum t-statistics
![Page 19: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/19.jpg)
Distributions of minimum and maximal t-statistics
We can expect that these results will become worse as the number of tests (k) increases.
![Page 20: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/20.jpg)
The normal-based tests are much robust when testing contrasts involving two or more groups.
T=(Y1-Y2)/s√(1/n1+1/n2)_
Two-sample Tests
_
![Page 21: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/21.jpg)
Two-sample Tests
There is an approximate cancellation skewness terms for the distribution of T, leaving the distribution roughly symmetric.
We expected the normal-based procedures to perform better than in the one-sample case.
![Page 22: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/22.jpg)
Two-sample Tests
According to the rejection proportions, both procedures perform fairly well.
Still, the bootstrap performs better than the normal approximation.
![Page 23: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/23.jpg)
The Need For Resampling In Multiple testing
The performance of Bootstrap Adjustments
![Page 24: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/24.jpg)
Bootstrap Adjustments
Use the adjusted p-values for the lower-tailed tests
The pivotal statistics used to test the ten hypotheses are
![Page 25: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/25.jpg)
Bootstrap Adjustments For Ten Independent Samples
![Page 26: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/26.jpg)
Bootstrap Adjustments
The adjustment algorithm in Algorithm 2.7 was placed within an ‘outer loop’, in which the data yij were repeatedly generated iid from the standard lognormal distribution.
![Page 27: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/27.jpg)
Bootstrap Adjustments
We generate NSIM=4000 data sets, all under the complete null hypothesis.
For each data set, we computed the bootstrap adjusted p-value using NBOOT 1000 bootstrap samples.
The proportion of the NSIM samples having an adjusted p-value below α estimates the true FEW level of the method.
![Page 28: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/28.jpg)
Rejection Proportions
![Page 29: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/29.jpg)
The bootstrap adjustments
The bootstrap adjustments are much better approximation.
The bootstrap adjustments may have fewer excess Type I errors than the parametric Sidak adjustments. (lower-tail)
The bootstrap adjustments may be more powerful than the parametric Sidak adjustments. (upper-tail)
![Page 30: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/30.jpg)
Step-down Methods For Free Combination
![Page 31: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/31.jpg)
Step-down methods
Rather than adjust all p-values according to the min Pj distribution, only adjust the minimum p-value using this distribution.
Then adjust the remaining p-values according to smaller and smaller sets of p-value.
It makes the adjusted p-value smaller, thereby improving the power of the single-step adjustment method.
![Page 32: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/32.jpg)
Free combinations
If, for every subcollection of j hypotheses {H i
1,..,Hij}, the simultaneous truth of {Hi1,..,Hij} and falsehood of the remaining hypotheses is plausible event, then the hypotheses satisfy the free combinations condition.
In other words, each of the 2k outcomes of the k-hypothesis problem is possible.
![Page 33: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/33.jpg)
Holm’s method (Step-down methods)
![Page 34: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/34.jpg)
Boferroni Step-down Adjusted p-values
An consequence of the max adjustment is that the adjusted p-values have the same monotonicity as the original p-values.
![Page 35: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/35.jpg)
Example
Consider a multiple testing situation with k=5 where the ordered p-values p(i) are 0.009,0.0
11,0.012,0.134, and 0.512. Let H(1) be the hypothesis corresponding to th
e p-value 0.0009, H(2) be the hypothesis corresponding to 0.011, and so on.
α=0.05
![Page 36: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/36.jpg)
Example
![Page 37: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/37.jpg)
Monotonicity enforcement
In stages 2 and 3, the adjusted p-values were set equal to the first adjusted p-value,0.045.
Without such monotonicity enforcement, the adjusted p-values p2 and p3 would be smaller than p1.
One might accept H(1) yet reject H(2) and H(3). It would run contrary to Holm’s algorithm.
![Page 38: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/38.jpg)
Bonferroni Step-down Method
Using the single-step method, the adjusted p-values are obtained by multiplying every raw p-value by five.
Only H(1) test would be declared significant at the FEW=0.05.
The step-down Bonferroni method is clearly superior to the single-step Bonferroni method.
Slightly less conservative adjustments are possible by using the Sidak inequality, taking the adjustments to be 1-(1-p(j))(k-j+1) at step j.
![Page 39: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/39.jpg)
The free step-down adjusted p-values(Resampling)
The adjustments may be made less conservative by incorporating the precise dependence characteristics.
Let the ordered p-values have indexes r1,r2,…,so that p(1) =pr1,p(2) =pr2,…,p(k) =prk
![Page 40: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/40.jpg)
The free step-down adjusted p-values (Resampling)
![Page 41: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/41.jpg)
The free step-down adjusted p-values (Resampling)
The adjustments are uniformly smaller than the single-step adjusted p-values, since the minima are taken over successively smaller sets.
![Page 42: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/42.jpg)
Free Step-down Resampling Method
![Page 43: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/43.jpg)
Free Step-down Resampling Method
![Page 44: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/44.jpg)
Example
K=5 P-values are 0.009, 0.011, 0.012, 0.134, and
0.512. Suppose these correspond to the original
hypotheses H2,H4,H1,H3, and H5.
![Page 45: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/45.jpg)
A Specific Step-down Illustration
![Page 46: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/46.jpg)
A Specific Step-down Illustration
![Page 47: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/47.jpg)
Step-Down Methods For Restricted Combinations
![Page 48: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/48.jpg)
Step-Down Methods For Restricted Combinations
When the hypotheses are restricted, then certain combinations of true hypotheses necessarily imply truth or falsehood of other hypotheses.
In these cases, the adjustments may be made smaller than the free step-down adjusted p-values.
![Page 49: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/49.jpg)
Step-Down Methods For Restricted Combinations
The restricted step-down method starts with the ordered p-values,p(1) … p≦ ≦ (k),p(j) =prj.
If H(j) is rejected, then H(1) ,…,H(j-1) must have been previously rejected.
The multiplicity adjustment for the restricted step-down method at stage j considers only those hypotheses that possibly can be true, given that the previous j-1 hypotheses are all false.
![Page 50: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/50.jpg)
Step-Down Methods For Restricted Combinations
Define sets sj of hypotheses which include
H(j) that can be true at stage j, given that all previous hypotheses are false.
S={r1,…,rk}={1,…,k}, define
_ _
![Page 51: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/51.jpg)
The Bonferroni adjustments
Define
|K|= the number of elements in the set K.
![Page 52: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/52.jpg)
Step-Down Methods For Restricted Combinations(Bonferroni)
The adjusted p-values can be no larger than the free Bonferroni adjustments, since Mj k-j+1.≦
In the case of free combinations, the truth of a collection of null hypotheses indexed by {rj,…,rk} cannot contradict the falsehood of all nulls indexed by {r1,..,rj-1}.
In this case, Sj={{rj,…,rk}}, thus Mj=k-j+1,and the restricted method reduces to the free method as a special case.
![Page 53: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/53.jpg)
Step-Down Methods For Restricted Combinations(resampling)
![Page 54: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/54.jpg)
Step-Down Methods For Restricted Combinations(resampling)
At each step of (2.13),the probabilities are computed over subsets of the sets in (2.10).
Thus, the restricted adjustments (2.13) can be no larger than the free adjustments.
![Page 55: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/55.jpg)
Error Rate ControlFor Step-Down Method
Error Rate Control Under Ho
k
![Page 56: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/56.jpg)
Error Rate Control Under Hok
The probability of rejecting at least one H0i is no larger than α, no matter what subset of the K of hypotheses happens to be true.
Ko={i1,…,ij} denote the collection of hypotheses H0i which are true.
Let xkα denote theα quantile of min Pt | Ho
c
![Page 57: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/57.jpg)
Error Rate Control Under Hok
Define
![Page 58: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/58.jpg)
Critical Value-Based Sequentially Rejective Algorithm
![Page 59: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/59.jpg)
Error Rate Control Under Hok
We have the following relationships:
Where j k-|K≦ 0|+1 is defined by min Pt=P(j) =Prj
![Page 60: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/60.jpg)
Error Rate Control Under Hok
![Page 61: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/61.jpg)
Error Rate Control Under Hok
which demonstrates that the restricted step-down adjustments strongly control the FEW.
![Page 62: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/62.jpg)
Error Rate Control Under Hk
Suppose that Hk is true, then the distribution of Y is G.
Suppose also that there exist random variables Pi0, defined on the same probability space as the Pi, for which Pi P≧ i0 for all i.
![Page 63: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/63.jpg)
Error Rate Control Under Hk
The error rate is controlled:
![Page 64: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/64.jpg)
Error Rate Control Under Hk
Such Pi0 frequently exist in parametric analyses; for example, the two-sample t-statistic for testing H0:μ1 μ≦ 2 may be written:
![Page 65: The Need For Resampling In Multiple testing. Correlation Structures Tukey’s T Method exploit the correlation structure between the test statistics, and](https://reader036.vdocument.in/reader036/viewer/2022062421/56649d615503460f94a4359a/html5/thumbnails/65.jpg)
Error Rate Control Under Hk
The p-value for this test is p=Pr(T2(n-1) ≧t).
Letting the p0 be defined by p0=Pr(T2(n-1) t≧ 0), p0 < p whenever μ1 < μ2.