minimization, permuted blocks and simple randomization · in randomized clinical trials, the ......

25
Setting Trends in Clinical Research Minimization, permuted blocks and simple randomization Marc Buyse, ScD IDDI, Louvain-la-Neuve, Belgium 7 December 2006

Upload: others

Post on 28-Sep-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

Setting Trends in Clinical Research

Minimization, permuted blocksand simple randomization

Marc Buyse, ScDIDDI, Louvain-la-Neuve, Belgium

7 December 2006

Page 2: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

In randomized clinical trials, thetreatment allocation method should…

– minimize the type I error– minimize the type II error– balance all known and unknown prognostic

factors among treatment groups (avoidaccidental bias)

– minimize the predictability of treatmentassignments (avoid selection bias)

– be simple and foolproof (avoid other biases)

Page 3: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations in advanced ovariancancer

Su

rviv

alp

roba

bilit

y

CP

CAP

Time (years)0 .5 1 1.5 2 2.5 3 3.5 4 4.5 5

0.00

0.25

0.50

0.75

1.00

Page 4: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations – data generation

• Patients: sampled at random (N=400), withreplacement, from meta-analysis dataset

• Center: sampled at random from skewed distribution

• Time of entry: sampled at random from uniformdistribution over accrual period

• Treatment: allocated using various methods (nextslide)

• Survival time: unchanged under control, prolongedunder treatment, with HR = T/C = 0.8

Page 5: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations - allocation techniques

• Simple randomization• Permuted blocks within strata defined by center

– only– and prognostic class– and 1 factor (residual disease)– and 3 factors (same + performance status + age)– and 5 factors (same + histologic grade + FIGO stage)

• Minimization– (as permuted blocks)

Page 6: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Balance

Page 7: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations –mean overall imbalances

0

5

10

15

20

25

Simple

PBCen

ter

PBCla

ssPB

1PB

3PB

5

Min

Cente

r

Min

Class

Min

1

Min

3

Min

5

Page 8: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations –mean imbalances in factor levels

0

5

10

15

20

25

Simple

PBCen

ter

PBCla

ssPB

1PB

3PB

5

Min

Cente

r

Min

Class

Min

1

Min

3

Min

5

Page 9: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations –mean imbalances in strata

0

5

10

15

20

25

Simple

PBCen

ter

PBCla

ssPB

1PB

3PB

5

Min

Cente

r

Min

Class

Min

1

Min

3

Min

5

Page 10: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Size and power

Page 11: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations – size of logrank test(dashed = stratified for 5 factors)

0123456789

10

Sim

ple

PBCen

ter

PBCla

ssPB

1PB

3PB

5

Min

Cente

r

Min

Class

Min

1

Min

3

Min

5

%

Page 12: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations – power of logrank test(dashed = stratified for 1 factor)

0102030405060708090

100

Sim

ple

PBCen

ter

PBCla

ssPB

1PB

3PB

5

Min

Cente

r

Min

Class

Min

1M

in3

Min

5

%

Page 13: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations – power of logrank test(dashed = stratified for 5 factors)

0102030405060708090

100

Simpl

e

PBCen

ter

PBCla

ssPB

1PB

3PB

5

Min

Cente

r

Min

Class

Min

1M

in3

Min

5

%

Page 14: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations – power of logrank test(dashed = stratified for center and all factors)

0102030405060708090

100

Sim

ple

PBCen

ter

PBCla

ssPB

1PB

3PB

5

Min

Cente

r

Min

Class

Min

1M

in3

Min

5

%

Page 15: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Sham

Macugen 0.3 mg

Macugen 1 mg

Macugen 3 mg

Simulations in age-related maculardegeneration (AMD)

R

Minimization for

• Type of lesion

• Prior PDT

• Center

Other importantbaseline factors

• Size of lesion

• Vision

• Gender

Page 16: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations - allocation techniques

• Simple randomization• Permuted blocks within strata defined by

– Type of lesion– Prior PDT

• Minimization on– Type of lesion– Prior PDT– Center

Page 17: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Predictability

Page 18: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations – correctly guessedtreatment allocations

0

5

10

15

20

25

30

35

40

45

50

Simple

globa

l

Simple

local

PBglo

bal

PBlo

cal

Min

global

Minlo

cal

%

Page 19: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Accidental bias

Page 20: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Simulations – imbalances in baselineprognostic factors

0

2

4

6

8

10

Simple

size

Simple

visi

on

Simple

gender

PBsiz

e

PBvi

sion

PBgende

r

Min

size

Min

visio

n

Min

gende

r

%

Page 21: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Use Clinical-Pathological Risk

Use 70-gene Signature Risk

Simulations in Micro-array In Nodenegative Disease may AvoidChemoTherapy (MINDACT)

R

Minimization for

• CG Risk

• HR Status

• Age

• Her2

• Axillary Method

• Surgery

• Center

Page 22: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

0%

5%

10%

15%

20%

25%

30%

35%

40%

45%

50%

CG HR Age HER2 AxillaryMethod Surgery

Simple Randomization

Permuted Block

Minimization

Simulations – worst case scenario forbaseline covariate imbalances

Page 23: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Conclusions – desirable characteristics

• Balance: minimization best, especially for largenumbers of factors

• Size: slight gains with PB or minimization(or with stratified analyses)

• Power: negligible gains(more gain with stratified analyses)

• Predictability: quite limited if guesses based onlocal knowledge

• Accidental bias: slight gains with PB orminimization

• Simplicity: simple randomization best

Page 24: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Conclusions – minimization can berecommended…

• to ensure balance over a large number of factors• regardless of the distribution of patients in the

factor levels• in trials of large or small size• with center as a minimization factor in double-

blind trials• without center as a minimization factor in open-

label trials

Page 25: Minimization, permuted blocks and simple randomization · In randomized clinical trials, the ... accidental bias) – minimize the predictability of treatment assignments (avoid selection

www.iddi.com

Acknowledgment

Thanks are due to Dr Suresh Ankolekar(Cytel, Inc.) for the simulations inAMD and MINDACT clinical trials.