mathematics behind induced drug resistance in cancer ...pogudin/ksda/kolchin_greene.pdfmathematics...

49
Mathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics, Rutgers University, New Brunswick Center for Quantitative Biology, Rutgers University, New Brunswick Kolchin Seminar in Differential Algebra November 30, 2018 Joint work with Eduardo Sontag (NEU), Jana Gevertz (TCNJ), and Cynthia Sanchez-Tapia (RU) Jim Greene (RU,CQB) Kolchin November 30, 2018 1 / 49

Upload: others

Post on 29-Jan-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Mathematics Behind Induced Drug Resistance in CancerChemotherapy

Jim Greene

Department of Mathematics, Rutgers University, New BrunswickCenter for Quantitative Biology, Rutgers University, New Brunswick

Kolchin Seminar in Differential Algebra

November 30, 2018

Joint work with Eduardo Sontag (NEU), Jana Gevertz (TCNJ), and Cynthia

Sanchez-Tapia (RU)

Jim Greene (RU,CQB) Kolchin November 30, 2018 1 / 49

Page 2: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Outline

1 Drug Resistance: Mechanisms and Origins

2 Mathematical Model

3 Effect of Phenotype Switching on Therapy Outcome

4 IdentifiabilityStructural IdentifiabilityIn vitro Identifiability

5 Optimal ControlFormulationTechnical DetailsBasic PropertiesGeometric Properties and Singular ArcsNon-Induced Optimal Control StructureInduced Optimal Control Structure

6 Conclusions and Future Work

Jim Greene (RU,CQB) Kolchin November 30, 2018 2 / 49

Page 3: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Resistance Origins

Drug resistance is a complicated phenomena, with many nonlinearinteracting factors

Simplistic model to study basic properties at a very high-level

Indeed, won’t even consider a specific resistance mechanism

Concerned instead with the origin of drug resistance

Spontaneous (drug independent) vs. drug-induced (drug dependent)

General competitive effects between sensitive and resistant phenotypesGillet and Gottesman. Mechanisms of multidrug resistance in cancer, Methods Mol. Biol., 596: 47-76, 2010Housman et al. Drug resistance in cancer, and overview, Cancers (Basel), 6(3): 1769-1792, 2014

Jim Greene (RU,CQB) Kolchin November 30, 2018 3 / 49

Page 4: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Paradigms of Origins of Resistance

Classical: Mechanisms conferring resistance may arise via stochasticgenetic alterations (point mutations, gene amplification, chromosomaltranslocations)

Rare events

Resistant cells are then selected during chemotherapy via standardDarwinian evolution

Saunders et al. Role of intratumoral heterogeneity in cancer drug resistance: molecular and clinical perspectives, E.M.B.O.Mol. Med., 4(8): 675-684, 2012

Marusyk and Polyak. Tumor heterogeneity: Causes and consequences, Biochim Biophys Acta., 1805(1): 105-117, 2010

Jim Greene (RU,CQB) Kolchin November 30, 2018 4 / 49

Page 5: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Paradigms (continued)

More recent: Non-genetic cell-state dynamics via spontaneous switchingwithin a clonal population (phenotype plasticity)

Not necessarily rare

Often reversible

Importantly: still operates via Darwinian selection

Most recent: Phenotype plasticity induced by the chemotherapeuticagent

Saunders et al. Role of intratumoral heterogeneity in cancer drug resistance: molecular and clinical perspectives, E.M.B.O.Mol. Med., 4(8): 675-684, 2012

Marusyk and Polyak. Tumor heterogeneity: Causes and consequences, Biochim Biophys Acta., 1805(1): 105-117, 2010

Jim Greene (RU,CQB) Kolchin November 30, 2018 5 / 49

Page 6: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Drug-induced resistance

Cytotoxic cancer chemotherapies may cause genomic mutations

Nitrogen mustards: induce base substitutions and chromosomalrearrangements

Topoisomerase II inhibitors: induce chromosomal translocations

Antimetabolites: induce double stranded breaks and chromosomalaberrations

Furthermore, resistance may be induced at the epigenetic level via DNAmethylation and histone modification

Recent studies have revealed that phenotypic state transitions could bea consequence of external cues, including radiation and chemotherapy

Usually rapid

Dose dependence

Reversible (although we don’t study this yet)

Jim Greene (RU,CQB) Kolchin November 30, 2018 6 / 49

Page 7: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Experimental Evidence of Drug-Induced PhenotypeSwitching and Drug Resistance

NSCLC cell line (PC9) treated with erlotinib (2010)

Persisters (DTPs) and DTEPs arise

Reversal to drug sensitivity upon drug removal (days)

Jim Greene (RU,CQB) Kolchin November 30, 2018 7 / 49

Page 8: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Experimental Evidence of Drug-Induced PhenotypeSwitching and Drug Resistance

Leukemic cells (HL60) treated with the chemotherapeutic agent vincristine(2013)

1-2 days of treatment: induction dominated expression of MDR1

NOT by selection of MDR1-expressing cells

Validated induction on individual cellsJim Greene (RU,CQB) Kolchin November 30, 2018 8 / 49

Page 9: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Experimental Evidence of Drug-Induced PhenotypeSwitching and Drug Resistance

Explants derived from tumor biopsies (breast cancer) treated with taxanes(docetaxel)

Transition towards a CD44HiCD24Hi expression status indose-dependent manner

Alleviated by immediate treatment with SFK inhibitors (dasatinib)

Jim Greene (RU,CQB) Kolchin November 30, 2018 9 / 49

Page 10: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Experimental Evidence of Drug-Induced PhenotypeSwitching and Drug Resistance

Jim Greene (RU,CQB) Kolchin November 30, 2018 10 / 49

Page 11: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Differentiating Selection vs. Induction

Although there is experimental evidence to suggest induction plays a role indrug resistance, it is still difficult to experimentally differentiate selection vs.induction

in vitro: hard

in vivo: impossible?

Mathematical modeling can assist by precisely defining and characterizingthe separate phenomena

Discover qualitative differences between origins of resistance

Possibly even suggest experiments to determine rate

Clinically: suggest treatment protocols based on discovered rate

Jim Greene (RU,CQB) Kolchin November 30, 2018 11 / 49

Page 12: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Mathematical Model

Assume both spontaneous and induced resistance are generated

dS

dt= r

(1− V

K

)S −

(ε+ αu(t)

)S − du(t)S + γR,

dR

dt= rR

(1− V

K

)R +

(ε+ αu(t)

)S − dRu(t)R − γR.

where

S = Sensitive (wild-type) cells

R = Resistant cells

V = S + R

Basic assumptions underlying model:

u(t) = treatment (control) - bounded, measurableRandom phenotype switching (εS and γR)Rate of induction is proportional to dosage (αu(t)S)Competitive inhibition equal among all compartments

dR < d .Jim Greene (RU,CQB) Kolchin November 30, 2018 12 / 49

Page 13: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

(Reduced) Model

Interested in role of induced phenotypic alterations in treatment dynamicscompared to classical drug-independent (genetic or phenotypic) changes

Role of αu(t)S term in dynamics and control

Dynamics (e.g. control structures) change as a function of α

Consider a simplified (and rescaled) system

dS

dt= (1− (S + R))S − (ε+ αu(t) )S − du(t)S ,

dR

dt= pr (1− (S + R))R + (ε+ αu(t) )S .

No back “mutations” (γ = 0)

Complete resistance (dR = 0)

Note: interesting only when pr < 1.

Jim Greene (RU,CQB) Kolchin November 30, 2018 13 / 49

Page 14: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Asymptotic Dynamics

dS

dt= (1− (S + R))S − (ε+ αu(t))S − du(t)S ,

dR

dt= pr (1− (S + R))R + (ε+ αu(t))S .

For all feasible controls, the long-time dynamics are invariant:

Theorem

For any bounded measurable control u : [0,∞)→ [0,M], with M <∞, andinitial conditions (S0,R0) ∈ Ω, solutions of the above system will approachthe steady state (S ,R) = (0, 1):

(S(t),R(t))t→∞−−−→ (0, 1).

Jim Greene (RU,CQB) Kolchin November 30, 2018 14 / 49

Page 15: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Treatment Evaluation

Even though asymptotically, all trajectories approach (S ,R) = (0, 1),transient dynamics may be very different for different controls

Utilize competition to prolong patient life

Control is still possible

Note: therapy has contradictory effects

Metric to rank therapies: tc defined by V (tc) := S(tc) + R(tc) = Vc

dS

dt= (1− (S + R)) S − (ε + αu(t))S − du(t)S,

dR

dt= pr (1− (S + R)) R + (ε + αu(t))S.

Jim Greene (RU,CQB) Kolchin November 30, 2018 15 / 49

Page 16: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Effect of Phenotype Switching on Therapy Outcome

Fundamental question: does induction (α) have an impact on efficacy?

Compare outcomes of two standard treatment protocols:

for the two different scenarios:

αs = 0, αi = 10−2.

Fundamental question restated: Is there a difference on which is optimal,based solely on α?

Jim Greene (RU,CQB) Kolchin November 30, 2018 16 / 49

Page 17: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Constant vs. Pulsed Comparison

Answer: Yes! αs = 0

0 10 20 30 40 50 60 70 80

time

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

u

Treatment strategies, = 0

ConstantPulsed

0 10 20 30 40 50 60 70 80

time

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

tum

or v

olum

e S+

R

Tumor dynamics, = 0

ConstantPulsed

αi = 10−2

0 10 20 30 40 50 60

time

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

u

Treatment strategies, = 10-2

ConstantPulsed

0 10 20 30 40 50 60

time

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

tum

or v

olum

e S+

R

Tumor dynamics, = 10-2

ConstantPulsed

Constant is more successful for αs = 0 : tc,c − tc,p ≈ 88

Pulsed is more successful for αi = 10−2 : tc,p − tc,c ≈ 19

Jim Greene (RU,CQB) Kolchin November 30, 2018 17 / 49

Page 18: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Identifiability

Demonstrated that α parameter may have large impact on treatmentoutcome

Thus, a fundamental clinical goal is to identify it (i.e. reverse engineer) αvalue from various inputs u(t)

Is this even possible?

If not, not really worth studying

What are our observables?

Time t and total tumor volume V (t) = S(t) + R(t) (and derivatives,but see later)

Don’t assume we can measure sensitive and resistant subpopulations(clinical)

Jim Greene (RU,CQB) Kolchin November 30, 2018 18 / 49

Page 19: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Lie Derivatives

We can identify all parameters (including α) using the following techniquefrom control theory:

x :=

(SR

), f :=

((1− (x1 + x2))x1 − εx1

pr (1− (x1 + x2))x2 + εx1

), g :=

(−αx1 − dx1

αx1

)

x = f (x) + u(t)g(x),

y = x1 + x2.

Idea: measure derivatives of output y at t = 0 for different inputs u(t)

Specifically, measure y(0), y ′(0), y ′′(0), y ′′′(0) for u(t) ≡ 0, 1, 2, t

Call them Y0,Y1,Y2, etc.

All Lie derivatives Lf y(0), Lgy(0), L2f y(0), Lf Lgy(0), etc. can be

written in terms of the Yi (linear)

Jim Greene (RU,CQB) Kolchin November 30, 2018 19 / 49

Page 20: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Lie Derivatives and Elementary Observables

x = f (x) + u(t)g(x) y := h(x) = x1 + x2

Unique structural identifiability is equivalent to injectivity of the map

p 7→ (u(t), y(t, p))

Two sets of observables are associated to the control system:

F1 = spanR

Y (x0,U) |U ∈ Rk , k ≥ 0

F2 = spanR

Li1 . . . Likh(x0) | (i1, . . . ik) ∈ g , f k , k ≥ 0

where

Y (x0,U) =dk

dtk

∣∣∣∣t=0

h(x(t))

Wang and Sontag proved that F1 = F2, so that structural identifiability isequivalent to injectivity of the map

p 7→(Li1 . . . Likh(x0) | (i1, . . . ik) ∈ g , f k , k ≥ 0

)Wang and Sontag, On two definitions of observation spaces, Systems & Control Letters, 13(4): 279-289, 1989Jim Greene (RU,CQB) Kolchin November 30, 2018 20 / 49

Page 21: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Lie Derivatives continued

It is thus sufficient to show that the parameters may be obtained by iteratedLie derivatives (F2):

S0 = h(x0),

d = −Lgh(x0)

S0,

α=L2gh(x0)

dS0− d ,

ε =Lf Lgh(x0)

dS0+ 1− S0,

pr =S0

1− S0+

LgLf h(x0)

αS0(1− S0)−(

1 +d

α

)(1− S0

1− S0

).

Alternatively, we may obtain via a relatively simple set of controls:

u(t) = 0, 1, 2, t

Jim Greene (RU,CQB) Kolchin November 30, 2018 21 / 49

Page 22: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Other Methods of Identifiability

Previous: demonstrated that all parameters can be experimentallydetermined via relatively simple set of controls

u(t) ≡ 0, 1, 2, t

However, it is important to note that this involved measure derivatives attime t = 0

y(0), y ′(0), y ′′(0), y ′′′(0), where y = V

This may be unrealistic, especially if data is noisy

Is there another way to determine parameter α?

Equivalently, what are the qualitative differences between α = 0 andα > 0?

Is there a way to distinguish utilizing only constant therapies?

Jim Greene (RU,CQB) Kolchin November 30, 2018 22 / 49

Page 23: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Dose-Response Curves

Compute standard dose-response curves for afixed set of parameters

Only measuring tc = tc(u, d , α) and Vc

For a fixed value of d (= 0.1):

Very similar qualitative dynamics for both types of drug

Maximum response time occurring at intermediate dosage (singular controls)

Jim Greene (RU,CQB) Kolchin November 30, 2018 23 / 49

Page 24: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Aside: Maximum Response Dose

Observed an intermediate constant dosage yielding the maximum responsetime (uc)

Understand viacompetitionbetween sensitiveand resistant cells

Critical size Vc is approximately the carrying capacity of sensitive cells(ignoring resistant dynamics)

uc ≈1− ε− Vc

α + d

d0 0.5 1 1.5 2 2.5 3 3.5 4

u

0

0.5

1

1.5

2

2.5

3

3.5Maximum dosage yield T

α

(d)

NumericalTheory

Jim Greene (RU,CQB) Kolchin November 30, 2018 24 / 49

Page 25: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Varying d

Imagine we can, in vitro, vary the drug sensitivity d

May be difficultBut may be possible to alter the expression of MDR1 via ABCBC1 oreven CDX2Correlate d with MDR1 expression

αs = 0 αi = 10−2

0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 5

u

0

50

100

150

200

250

300

350

400

450

t c

Constant therapy dose response, α =0

d=0.1d=0.2d=0.95d=1.45d=2.95

0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 5

u

0

20

40

60

80

100

120

140

160

t c

Constant therapy dose response, α = 10-2

d=0.1d=0.2d=0.95d=1.45d=2.95

Maximum response time is:

Constant for α = 0

Increasing in d for α > 0Jim Greene (RU,CQB) Kolchin November 30, 2018 25 / 49

Page 26: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Maximum Response Time

Tα(d) := suputc(u, d , α)

αs = 0 αi = 10−2

0.5 1 1.5 2 2.5 3

d

0

50

100

150

200

250

300

350

400

450

Maximum critical time as a function of sensitivity, α =0

0.5 1 1.5 2 2.5 3

d

0

20

40

60

80

100

120

140

Maximum critical time as a function of sensitivity, α = 10-2

Shape of maximum response time is an indicator of phenotype-switching inductionof drug

Did not even have to know anything about mechanisms

Jim Greene (RU,CQB) Kolchin November 30, 2018 26 / 49

Page 27: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Identifying α (Part II)

Tα(d) := suputc(u, d , α)

In principle, we should be able to measure α from Tα(d) curve

0.5 1 1.5 2 2.5

d

20

40

60

80

100

120

140

160

180

Maximum critical time for different induced mutation rates

α=5.00e-03

α=6.00e-03

α=7.00e-03

α=8.00e-03

α=9.00e-03

α=1.00e-02

α=1.10e-02

α=1.20e-02

α=1.30e-02

α=1.40e-02

α=1.50e-02

0.5 1 1.5 2 2.5

d

0

50

100

150

200

250

300

350

400

450

Maximum critical time for different induced mutation rates

α = 0

α=10-6

α=10-5

α=10-4

α=10-3

α=10-2

Two possible methods:

Increasing slope at d = 0 as α→ 0

∂d

∣∣∣d=0

T0(d) = kδ(d)

Increasing slope at d > 0 (away from 0) as α ↑Jim Greene (RU,CQB) Kolchin November 30, 2018 27 / 49

Page 28: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Limitations

Practical limitations to consider:

Difficult to precisely vary drug sensitivity d

Measuring derivatives from experimental data is not realistic

Control over administered dose must be exact

tc has a high degree of sensitivity for u ≈ uc

Focus on qualitative distinctions of induced drug resistance (α > 0) undersimplest treatment regime (constant)

“Thought experiment”

Jim Greene (RU,CQB) Kolchin November 30, 2018 28 / 49

Page 29: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Formulation of Control Problem

Recall:

Treatment outcome may be impacted by induction rate of treatment(α)

We can (theoretically and “practically”) identify this rate (not shown)

Natural then to ask what is the best therapy (i.e. optimal control problem)

Specifically: how (and if!) does the structure change as a function of α

uα(t) := uopt(t;α)

Method to characterize level of resistance induction of a drug

Testable (in vitro)

Clinically relevant!

Dose densification may no longer be optimal (Norton-Simon)

Jim Greene (RU,CQB) Kolchin November 30, 2018 29 / 49

Page 30: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Formulation (continued)

x = f (x) + u(t)g(x), x =

(SR

)∈ R2

𝑹

𝑺

Ω𝑐

𝑥0 = (𝑆0, 𝑅0)

(0,1)

Only natural metric to rank therapies in simplified model:

tc = supu(t)∈U

J(u(t)) ,

J(u(t)) = tf =

∫ tf

01dt,

U = u : [0,T ]→ [0,M] |T > 0, u is Lebesgue measurable.

Note that a path constraint exists along the boundary V = Vc :

ψ(S(t),R(t)) := S(t) + R(t)− Vc ≤ 0

Jim Greene (RU,CQB) Kolchin November 30, 2018 30 / 49

Page 31: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Existence Results

x = f (x) + u(t)g(x)

tc = supu(t)∈U

∫ tf

01 dt

𝑹

𝑺

Ω𝑐

𝑥0 = (𝑆0, 𝑅0)

(0,1)

Maximization of time trajectory remains inside the region Ωc

Is this maximum obtained?

supu∈U

tc(u) <∞

Since (0, 1) is globally attracting for all u ∈ U : Yes!

Otherwise we could construct a control that remains a fixed positivedistance ε from (0, 1):

u∗ = u1,∗ ∗ u2,∗ ∗ · · ·Thus we can apply the Maximum Principle to analyze necessary conditionssatisfied by extremals

Jim Greene (RU,CQB) Kolchin November 30, 2018 31 / 49

Page 32: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Elimination of Path Constraints

Synthesize unconstrained (int(Ωc))and path-constrained (∂Ωc) optimalcontrols

𝑹

𝑺

Ω𝑐

(0,1)

𝑥0 = (𝑆0, 𝑅0)

𝑥(𝑇)

𝑥(𝑇 − 𝜖)

𝜕Ω𝑐

TheoremSuppose that x∗ is an optimal trajectory. Let T be the first time such that x(t) ∈ N. Fix ε > 0such that T − ε > 0, and

ξ = x(T − ε).

Define z(t) := x∗(t)|t∈[0,T−ε]. Then the trajectory z is a local solution of the corresponding time

maximization problem tf with boundary conditions x(0) = x0, x(tf ) = ξ, and no additional path

constraints.

Idea: Optimal control consists of concatenations of controls obtained from the unconstrainednecessary conditions and controls of the form

up(S ,R) =1

d

(1− (S + R))(S + prR)

S.

Jim Greene (RU,CQB) Kolchin November 30, 2018 32 / 49

Page 33: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Unconstrained Maximum Principle

We can then use the Maximum Principle to analyze necessary conditionssatisfied by extremals at point interior to Ωc :

Minimize Hamiltonian H = H(λ, x , u) pointwise w.r.t. u along extremallifts Γ = ((x , u), λ):

H(x , u, λ) = −1 + 〈λ, f (x)〉+ u〈λ, g(x)〉

Note: we have converted to a minimization problem to be consistent withthe literature

Jim Greene (RU,CQB) Kolchin November 30, 2018 33 / 49

Page 34: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Basic Properties of Extremals (int(Ωc))

H(x , u, λ) = −1 + 〈λ(t), f (x)〉+ u〈λ(t), g(x)〉x = f (x) + u(t)g(x)

λ = −λ (Df (x(t)) + uDg(x(t)))

Properties independent of α:

λ0 = 1, since abnormal extremals (λ0 = 0) are simply classified(u∗(t) ≡ 0,M)

λ(t) 6= 0

H(t) := H(x(t), u(t), λ(t)) ≡ 0 on [0, tc ] for any extremal lift Γ

The switching function Φ(t) is given by

Φ(t) = 〈λ(t), g(x(t))〉

along Γ, so that an extremal control must satisfy

u∗(t) =

0 Φ(t) > 0,

M Φ(t) < 0.

Note: H(t) = −1 + 〈λ(t), f (x)〉+ u(t)Φ(t)Jim Greene (RU,CQB) Kolchin November 30, 2018 34 / 49

Page 35: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Singular Arcs

u(t) =

0 Φ(t) > 0,

M Φ(t) < 0.

x = f (x) + u(t)g(x)

Φ(t) = 〈λ(t), g(x(t))〉

Control structure is bang-bang (u(t) = 0 or u(t) = M) outside of possiblesingular arcs (0 < u(t) < M):

Φ(t) ≡ 0Questions:

On what subsets of the SR-plane are singular arcs allowed?How does the geometry of the subsets depend on α?Are singular arcs (hence intermediate dosages) optimal?

Differential geometric arguments inspired by Sussmann (1982, 1986)Jim Greene (RU,CQB) Kolchin November 30, 2018 35 / 49

Page 36: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Switching Function

u(t) =

0 Φ(t) > 0,

M Φ(t) < 0.

x = f (x) + u(t)g(x)

Φ(t) = 〈λ(t), g(x(t))〉

On singular arcs, the switching function Φ(t) must satisfy

Φ(t) ≡ 0

This is a strong condition, which implies all higher-order derivatives mustalso vanish identically:

Φ(t) ≡ 0

Φ(t) ≡ 0, etc.

Furthermore, these derivatives can be calculated via iterated Lie brackets:

Φ(t) = 〈λ(t), [f , g ](x(t))〉Φ(t) = 〈λ(t), [f , [f , g ]](x(t))〉+ u(t)〈λ(t), [g , [f , g ]](x(t))〉

where[f , g ](x(t)) = Dg(x(t))f (x(t))− Df (x(t))g(x(t))

Jim Greene (RU,CQB) Kolchin November 30, 2018 36 / 49

Page 37: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Switching Function (continued)

u(t) =

0 Φ(t) > 0,

M Φ(t) < 0.

x = f (x) + u(t)g(x)

Φ(t) = 〈λ(t), g(x(t))〉Φ(t) = 〈λ(t), [f , g ](x(t))〉

Key observation: f (x) and g(x) are linearly independent in our region ofinterest Ω (0 < V ≤ Vc < 1), which implies

[f , g ](x) = γ(x) f (x) + β(x)g(x)

γ(x): determines geometric structure of singular arc

Allow us to write closed form system of ODEs for x(t) and Φ(t) alongextremals (solutions NOT unique)Indeed, since H(t) ≡ 0, we may solve for 〈λ(t), f (x)〉 to obtain

Φ(t) = γ(x(t)) +(β(x(t))− u(t)γ(x(t))

)Φ(t)

Theorem

Singular arcs can only occur in the SR plane where γ(x) = 0. Furthermore,in Ω, this is precisely the line aS + bR = c.

Jim Greene (RU,CQB) Kolchin November 30, 2018 37 / 49

Page 38: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Geometry of Singular Arc

u(t) =

0 Φ(t) > 0,

M Φ(t) < 0.Φ(t) = γ(x(t)) +

(β(x(t))− u(t)γ(x(t))

)Φ(t)

Denote the bang-bang controls via X and Y :

X = f (x) (⇔ u = 0), Y := f (x) + Mg(x) (⇔ u = M)

Switching point (τ such that Φ(τ) = 0) order is determined by sign of γaway from singular arcs:

=⇒ structure determined outside of singular arc

𝑹 = 𝒙𝟐

𝑺 = 𝒙𝟏

𝛾 < 0

𝛾 > 0

⟺ 𝑋 = 𝑓

⟺ 𝑌 = 𝑓 +𝑀𝑔

𝑺∗

R∗ ℒ

𝒀𝑿

𝑿𝒀

𝒖 = 𝒖 𝒙

⟺ ℒ

Jim Greene (RU,CQB) Kolchin November 30, 2018 38 / 49

Page 39: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Geometry of Singular Arc

Other properties of extremals:

Singular arc L is an extremal

Control u(x) is uniquelydetermined there via

u(x) = MLXγ(x)

LXγ(x)− LY γ(x)

Non-restrictive assumptions(M, ε) imply that L is in Γ andfeasible AND extremal:

0 < u(x) < M

𝑹 = 𝒙𝟐

𝑺 = 𝒙𝟏

𝛾 < 0

𝛾 > 0

⟺ 𝑋 = 𝑓

⟺ 𝑌 = 𝑓 +𝑀𝑔

𝑺∗

R∗ ℒ

𝒀𝑿

𝑿𝒀

𝒖 = 𝒖 𝒙

⟺ ℒ

Note: last claim requires α > 0, and will determine structure globally

Jim Greene (RU,CQB) Kolchin November 30, 2018 39 / 49

Page 40: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Non-Induced Control Structure (α = 0)

X := f (x) Y := f (x) + Mg(x)

Theorem

In the case of a non drug resistance inducing drug (α = 0), the optimalcontrol structure is of the form

u = YXupY

Proof𝑹 = 𝒙𝟐

𝑺 = 𝒙𝟏

𝑎𝑆 + 𝑏𝑅 = 𝑐

𝛾 < 0

𝛾 > 0

⟺ 𝑋 = 𝑓

⟺ 𝑌 = 𝑓 +𝑀𝑔

𝒀𝑿

𝑿𝒀

𝑋𝑌

Recall that the resistant population is always increasingJim Greene (RU,CQB) Kolchin November 30, 2018 40 / 49

Page 41: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Induced control structure (α > 0)

Proven that control structure in classical drug-independent paradigm isbang-bang, with at most two switches.

What about when α > 0?

Are singular arcs (locally)optimal?

Does switching structurechange?

𝑹 = 𝒙𝟐

𝑺 = 𝒙𝟏

𝛾 < 0

𝛾 > 0

⟺ 𝑋 = 𝑓

⟺ 𝑌 = 𝑓 +𝑀𝑔

𝑺∗

R∗ ℒ

𝒀𝑿

𝑿𝒀

𝒖 = 𝒖 𝒙

⟺ ℒ

Jim Greene (RU,CQB) Kolchin November 30, 2018 41 / 49

Page 42: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Singular controls are NOT optimal𝑹 = 𝒙𝟐

𝑺 = 𝒙𝟏

𝛾 < 0

𝛾 > 0

⟺ 𝑋 = 𝑓

⟺ 𝑌 = 𝑓 +𝑀𝑔

ഥℒ

𝒀𝑿

𝑿𝒀⟺ ഥℒ

𝒒𝟏

𝒒𝟏

⟺ 𝑢𝑠

𝑹

Δ

𝑹 = 𝒙𝟐

𝑺 = 𝒙𝟏

𝛾 < 0

𝛾 > 0

⟺ 𝑋 = 𝑓

⟺ 𝑌 = 𝑓 +𝑀𝑔

ഥℒ

𝒀𝑿

𝑿𝒀⟺ ഥℒ

𝒒𝟏

Using the Lie algebra structure of vector field, we can show that the singulararc L is not optimal. That is, L is a fast singular arc.

Legendre-Clebsch condition is violatedExplicit clock-form ω ∈ (TΩ)∨ to compare times along bang-bang andsingular arcs:

s + t − τ =

∫∆ω =

∫Rdω = −

∫R

γ

det(f , g)

If α > 0, optimal control is still bang locally near LHence global interior structure of control is bang-bangHowever: switches through the arc L are allowedJim Greene (RU,CQB) Kolchin November 30, 2018 42 / 49

Page 43: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Switching Structure for α > 0

Theorem

For any α ≥ 0, the optimal control to maximize the time to reach a criticaltime is a concatenation of bang-bang and path-constraint controls. In fact,the general control structure takes the form

(YX )nupY , (1)

where (YX )n := (YX )n−1YX and n ∈ N, and the order should beinterpreted left to right.

How does n = n(α) vary as α is increased?

n(0) = 1 (at most two switches in case of non-resistant inducing drug)

Switches can only occur across singular arc LAt most one bang in a (sufficiently small) neighborhood of arc(g -conjugate points, variational vector fields)

Larger sections L lie in the control set U as α increases

Jim Greene (RU,CQB) Kolchin November 30, 2018 43 / 49

Page 44: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Variation in L𝑹 = 𝒙𝟐

𝑺 = 𝒙𝟏

𝑎𝑆 + 𝑏𝑅 = 𝑐 (𝛾 = 0)

⟺ 𝑋 = 𝑓

⟺ 𝑌 = 𝑓 +𝑀𝑔

⟺ ℒ

α = 0

Geometry of arc L suggests that number of switchings increases as αincreases

α = 0 : u = YXupYα > 0 : u = (YX )n(α)upYn(α) increases with induction rate αAt least for small values of α:

L becomes vertical (hence outside of U) for large α

Jim Greene (RU,CQB) Kolchin November 30, 2018 44 / 49

Page 45: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Number of Switchings

Cartoon of bang-bang structure as a function of induction rate α

All other parameters constant

Maximum for an intermediate α where region L is largest

Note: just a cartoonJim Greene (RU,CQB) Kolchin November 30, 2018 45 / 49

Page 46: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Conclusions

dS

dt= (1− (S + R)) S − (ε+ αu(t))S − du(t)S ,

dR

dt= pr (1− (S + R))R + (ε+ αu(t))S .

Formulated a mathematical framework to distinguish mechanisms by whichdrug resistance originates

Random (drug-independent) resistanceInduced phenotype switching

Control structure varies as a function of the degree to which the drugpromotes the resistant phenotype

α = 0: u = YXupYα > 0: u = (YX )nupY , n ≥ 1Geometry suggests that ∂n

∂α > 0, at least initially (small α)

Clinically relevant:

Suggests different treatment strategies based on how “mutagenic”chemotherapy isProvides testable hypothesis to determine α in vitro

Test which types of treatment strategies are better to infer α valueJim Greene (RU,CQB) Kolchin November 30, 2018 46 / 49

Page 47: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Current and Future Work

Understand fully switching structure as a function of α

No proofs yet

Numerical results suggest switching is optimal, at least along someregions of L

Further control techniques related to feedback

Switching dictated along aS + bR = c , which we cannot a priorimeasure

Possibly approximate via volume measurements?

Adaptive therapy, a la Gatenby

Validate and expand with experimental data

Working with A. Pisco (CZF) utilizing Nature Communications data(2013)

Extend to sequential therapy by targeting induced resistant cells

Jim Greene (RU,CQB) Kolchin November 30, 2018 47 / 49

Page 48: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Multidrug and Sequential Therapy Extension

Leverage induction to study optimal treatment combinations

N = rN

(1− V

K

)N − d

N ,1u1(t)N − dN ,2u2(t)N

S = rS

(1− V

K

)S − (ε+ αu1(t))S − d

S ,1u1(t)S − dS ,2u2(t)S + γR

R = rR

(1− V

K

)R + (ε+ αu1(t))S − γR − d

R ,2u2(t)R

Two treatments with distinct mechanisms of action:

u1 : docetaxel (induces resistance via activation of SFK/Hck)

u2 : dasatinib (SFK/BCR-Abl inhibitor)

Jim Greene (RU,CQB) Kolchin November 30, 2018 48 / 49

Page 49: Mathematics Behind Induced Drug Resistance in Cancer ...pogudin/ksda/kolchin_greene.pdfMathematics Behind Induced Drug Resistance in Cancer Chemotherapy Jim Greene Department of Mathematics,

Numerical Results

Sequential versus combination therapy

Sequential therapy yields a small tumor volume at conclusion of treatment

Order is therapy is important

Natural control questionsJim Greene (RU,CQB) Kolchin November 30, 2018 49 / 49