ema workshop case study on analytical similarity · case study on analytical similarity josé g....
TRANSCRIPT
![Page 1: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/1.jpg)
AT
1
EMA Workshop Case Study on Analytical Similarity
José G. Ramírez, Ph.D. Amgen Inc.
EMA Workshop “Draft Reflection Paper on statistical methodology for the comparative assessment of quality attributes in drug development”
3-4 May 2018
![Page 2: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/2.jpg)
2
This is a joint industry presentation on behalf of the trade associations shown
![Page 3: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/3.jpg)
• Analytical Similarity
• Herceptin ADCC Data Based on Kim et al (2017)
• Comparing RP vs BP Means
• Quality Range
• How do we define statistically similar?
• Summary
Outline
![Page 4: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/4.jpg)
• “Biosimilar candidate has ‘a highly similar’ quality profile as compared to the reference medicinal product.”1
• “The goal to demonstrate equivalence is the focus in the biosimilar setting.”1
• “Test of Mean Equivalence (FDA Tier 1) is typically recommended for quality attributes with the highest risk ranking.”2
Analytical Similarity
1Draft Reflection Paper on statistical methodology for the comparative assessment of quality attributes in drug development 2FDA Statistical Approaches to Evaluate Analytical Similarity Guidance for Industry
![Page 5: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/5.jpg)
• Analytical Similarity
• Herceptin ADCC Data Based on Kim et al (2017)
Outline
![Page 6: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/6.jpg)
Analytical Similarity Example Simulated ADCC Data Based on Kim et al (2017)
• Reference Product (RP) – Random
– Mimics US Herceptin
• Biosimilar Product (BP) – Random
– Centered on first RP group
Kim et al (2017). Drifts in ADCC-related quality attributes of Herceptin® Impact on development of a trastuzumab biosimilar
![Page 7: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/7.jpg)
Analytical Similarity Example Simulated ADCC Data Based on Kim et al (2017)
![Page 8: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/8.jpg)
• Analytical Similarity
• Herceptin ADCC Data Based on Kim et al (2017)
• Comparing RP vs BP Means
– equivalence test
Outline
![Page 9: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/9.jpg)
Means are not equivalent to ±39.12
• EAC = ± 1.5RP Std. Dev. – ±1.526.08 = ± 39.12
• BP not equivalent to RP
Analytical Similarity Example Test of Mean Equivalence for Relative ADCC
Label BP
Mean RP
Mean Means
Difference 90% LCL
90% UCL
EAC
BP vs. US 102.67 73.45 29.22 14.62 43.80 ±39.12
![Page 10: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/10.jpg)
• Downward shift in RP data – Manufacturing changes?
• Lag 1 Autocorrelation – Same DS batch?
• Residuals not normal – Bimodal distribution?
Equivalence Test Assumptions Check
![Page 11: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/11.jpg)
• RP distribution skewed? – Mean (73.45) > median (58)
– Std. Dev. = 26.08
Equivalence Test Assumptions Check
![Page 12: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/12.jpg)
Data cannot be approximated by a unimodal distribution
• RP distribution skewed? – Mean (73.45) > median (58)
– Std. Dev. = 26.08
• RP distribution bimodal? – MeanRP1 = 55.9
– MeanRP2 = 104.2
– MeanBP = 102.65
Equivalence Test Assumptions Check
![Page 13: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/13.jpg)
Assumptions Are Not Met
Samples are random and representative of each population
Observations are independent and identically distributed (i.i.d)
Data can be approximated by a normal (unimodal) distribution – Skewed or bimodal distribution
Homogeneous variances – Variances are different
Do We Meet Equivalence Test Assumptions?
![Page 14: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/14.jpg)
Manufacturing changes can induce multimodal distribution
Equivalence of means • Which RP mean? • Overall average?
– Can be too low or too high
Variances are different • Std DevRP=26.08 ≫ Std DevBP=6.5
– Increases confidence interval width
• Large Std DevRP → Inflated EAC • Does this matter?
Why Do We Fail the Test of Mean Equivalence? Bimodal Distribution
![Page 15: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/15.jpg)
• Analytical Similarity
• Herceptin ADCC Data Based on Kim et al (2017)
• Comparing RP vs BP Means
• Quality Range
Outline
![Page 16: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/16.jpg)
Quality range “represents” specification limits
RP quality range
• RP mean ± 3 RP std. dev. – 0 (-4.8) to 151.7
BP data 100% inside quality range
• Same performance as RP
But the BP data is within the RP Quality Range…
![Page 17: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/17.jpg)
Means vs individual values: not the same comparison
Equivalence Test or Quality Range? Compares average performance Compares individual performance
![Page 18: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/18.jpg)
• Analytical Similarity
• Herceptin ADCC Data Based on Kim et al (2017)
• Comparing RP vs BP Means
• Quality Range
• How do we define statistically similar?
Outline
![Page 19: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/19.jpg)
We want the RP and BP distributions to be “similar”
• Manufacturing changes, process improvements, over time can induce a multimodal distribution. – Tests assumptions may not hold
– Several average values are possible
• Biosimilar is “similar” to reference product – To which mean?
– Within a quality range?
– Do differences in variance matter?
How do we define statistically similar?
![Page 20: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/20.jpg)
Totality of evidence: One statistical test is not enough
• Statistical tests depend on assumptions – Need to verify assumptions to insure test results are reliable
• How do we define statistically similar? – Distance between means? – Individual values within a “quality range”? We want to show that the RP and BP distributions are “similar”
• Manufacturing changes can induce multimodal distribution – Several means to choose from
• Overall mean too low or to high
– Increases overall variance
Summary
![Page 21: EMA Workshop Case Study on Analytical Similarity · Case Study on Analytical Similarity José G. Ramírez, Ph.D. ... 3-4 May 2018 . 2 This is a joint industry presentation on behalf](https://reader033.vdocument.in/reader033/viewer/2022050107/5f45c53d8006c42f973f93e4/html5/thumbnails/21.jpg)
• Franz Innerbichler, Novartis
Acknowledgements