mycobacterium tuberculosis resistance prediction from ... · tuberculosis •worldwide occurring...

98
Mycobacterium tuberculosis resistance prediction from genome sequencing: comparison of automated software tools V. Schleusener S. Feuerriegel S. Niemann Research Center Borstel, Borstel, Germany 2nd Conference Rapid Microbial NGS and Bioinformatics: Translation Into Practice, 2016

Upload: others

Post on 03-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Mycobacterium tuberculosis resistance prediction fromgenome sequencing:

comparison of automated software tools

V. Schleusener S. Feuerriegel S. Niemann

Research Center Borstel, Borstel, Germany

2nd Conference Rapid Microbial NGS and Bioinformatics:Translation Into Practice, 2016

Page 2: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Outline

1 MotivationThe Basic ProblemState of the art

2 ComparisonVisualizationValidation datasetPerformance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 0 / 14

Page 3: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Outline

1 MotivationThe Basic ProblemState of the art

2 ComparisonVisualizationValidation datasetPerformance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 0 / 14

Page 4: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 5: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 6: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 7: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 8: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 9: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Tuberculosis

• Worldwide occurring infection (normally of the lung)

• 1.5 million deaths annually

• 9.6 million cases (1/3 of the worlds population infected)

• Infection caused by pathogens of the Mycobacterium tuberculosisComplex (MTBC)

• Treatment impaired by increasing numbers of antibiotic resistance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 1 / 14

Page 10: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Molecular Drug Susceptibility Testing

PacBio RSII

Ion Torrent Proton

Illumina NextSeq

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 2 / 14

• Key to control: timely diagnosis

• Fast molecular Tests such as GeneXpert

• Highest resolution with Next-GenerationSequencing (NGS) data

• NGS analysis complex and computationallyintensive

Automated tools needed:Raw data ⇒ resistance profile

Page 11: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Molecular Drug Susceptibility Testing

PacBio RSII

Ion Torrent Proton

Illumina NextSeq

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 2 / 14

• Key to control: timely diagnosis

• Fast molecular Tests such as GeneXpert

• Highest resolution with Next-GenerationSequencing (NGS) data

• NGS analysis complex and computationallyintensive

Automated tools needed:Raw data ⇒ resistance profile

Page 12: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Molecular Drug Susceptibility Testing

PacBio RSII

Ion Torrent Proton

Illumina NextSeq

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 2 / 14

• Key to control: timely diagnosis

• Fast molecular Tests such as GeneXpert

• Highest resolution with Next-GenerationSequencing (NGS) data

• NGS analysis complex and computationallyintensive

Automated tools needed:Raw data ⇒ resistance profile

Page 13: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Molecular Drug Susceptibility Testing

PacBio RSII

Ion Torrent Proton

Illumina NextSeq

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 2 / 14

• Key to control: timely diagnosis

• Fast molecular Tests such as GeneXpert

• Highest resolution with Next-GenerationSequencing (NGS) data

• NGS analysis complex and computationallyintensive

Automated tools needed:Raw data ⇒ resistance profile

Page 14: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Molecular Drug Susceptibility Testing

PacBio RSII

Ion Torrent Proton

Illumina NextSeq

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 2 / 14

• Key to control: timely diagnosis

• Fast molecular Tests such as GeneXpert

• Highest resolution with Next-GenerationSequencing (NGS) data

• NGS analysis complex and computationallyintensive

Automated tools needed:Raw data ⇒ resistance profile

Page 15: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

NGS Analysis

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 3 / 14

Automated analysis tools for TBavailable?

Page 16: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

NGS Analysis

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 3 / 14

Automated analysis tools for TBavailable?

Page 17: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - Screening

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 4 / 14

Page 18: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - Screening

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 4 / 14

Page 19: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - Screening

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 4 / 14

Page 20: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - Screening

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 4 / 14

Page 21: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Outline

1 MotivationThe Basic ProblemState of the art

2 ComparisonVisualizationValidation datasetPerformance

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 4 / 14

Page 22: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools-CASTBCASTB - Comprehensive Analysis Server for MTBC

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 5 / 14

Iwai et. al.,Tuberculosis (Edinb), 2015

Page 23: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools-CASTBCASTB - Comprehensive Analysis Server for MTBC

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 5 / 14

Iwai et. al.,Tuberculosis (Edinb), 2015

Page 24: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools-CASTBCASTB - Comprehensive Analysis Server for MTBC

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 5 / 14

Iwai et. al.,Tuberculosis (Edinb), 2015

Page 25: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools-CASTBCASTB - Comprehensive Analysis Server for MTBC

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 5 / 14

Iwai et. al.,Tuberculosis (Edinb), 2015

Page 26: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools-CASTBCASTB - Comprehensive Analysis Server for MTBC

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 5 / 14

Iwai et. al.,Tuberculosis (Edinb), 2015

Page 27: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools-KvarQ

KvarQ

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 6 / 14

MTBC/phylo: lineage 4MTBC/resistance: Streptomycin resistance::SNP781687AG=rpsL.K43R;Isoniazid resistance [2155168CG=katG.S315T];Rifampicin resistance (RRDR) [761155CT=rpoB.S450L]

Steiner et. al., BMC Genomics, 2014

Page 28: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools-KvarQ

KvarQ

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 6 / 14

MTBC/phylo: lineage 4MTBC/resistance: Streptomycin resistance::SNP781687AG=rpsL.K43R;Isoniazid resistance [2155168CG=katG.S315T];Rifampicin resistance (RRDR) [761155CT=rpoB.S450L]

Steiner et. al., BMC Genomics, 2014

Page 29: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools-KvarQ

KvarQ

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 6 / 14

MTBC/phylo: lineage 4

MTBC/resistance: Streptomycin resistance::SNP781687AG=rpsL.K43R;Isoniazid resistance [2155168CG=katG.S315T];Rifampicin resistance (RRDR) [761155CT=rpoB.S450L]

Steiner et. al., BMC Genomics, 2014

Page 30: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools-KvarQ

KvarQ

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 6 / 14

MTBC/phylo: lineage 4MTBC/resistance: Streptomycin resistance::SNP781687AG=rpsL.K43R;Isoniazid resistance [2155168CG=katG.S315T];Rifampicin resistance (RRDR) [761155CT=rpoB.S450L]

Steiner et. al., BMC Genomics, 2014

Page 31: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools-KvarQ

KvarQ

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 6 / 14

MTBC/phylo: lineage 4

MTBC/resistance: Streptomycin resistance::SNP781687AG=rpsL.K43R;Isoniazid resistance [2155168CG=katG.S315T];Rifampicin resistance (RRDR) [761155CT=rpoB.S450L]

Steiner et. al., BMC Genomics, 2014

Page 32: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - MykrobePredictor TB

MykrobePredictor TB

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 7 / 14

Bradley et. al., Nat Commun, 2015

Page 33: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - MykrobePredictor TB

MykrobePredictor TB

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 7 / 14

Bradley et. al., Nat Commun, 2015

Page 34: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - MykrobePredictor TB

MykrobePredictor TB

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 7 / 14

Bradley et. al., Nat Commun, 2015

Page 35: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - MykrobePredictor TB

MykrobePredictor TB

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 7 / 14

Bradley et. al., Nat Commun, 2015

Page 36: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - PhyResSE

PhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 37: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - PhyResSE

PhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 38: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - PhyResSE

PhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 39: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - PhyResSEPhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 40: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - PhyResSEPhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 41: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - PhyResSEPhyResSE - Phylo-Resistance Search Engine

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 8 / 14

Feuerriegel et. al., JCM, 2015

Page 42: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - TBProfilerTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 9 / 14

Coll et al., Genome Medicine, 2015

Page 43: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - TBProfilerTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 9 / 14

Coll et al., Genome Medicine, 2015

Page 44: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - TBProfilerTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 9 / 14

Coll et al., Genome Medicine, 2015

Page 45: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - TBProfilerTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 9 / 14

Coll et al., Genome Medicine, 2015

Page 46: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Available tools - TBProfilerTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 9 / 14

Coll et al., Genome Medicine, 2015

Page 47: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 48: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 49: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 50: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 51: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 52: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 53: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

Easiest handling with PhyResSE

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 54: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 55: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 56: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 57: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 58: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 59: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

KvarQ is a fast, mapping-free algorithm

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 60: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 61: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 62: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 63: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 64: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 65: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Feature comparison

Feature CASTB KvarQ MykrobePredictor PhyResSE TBProfiler(Version 1.1) (Version 0.12.2) (Version 0.1.3) (Version 1.0)

Web-based Yes No No Yes YesBatch mode No Yes No Yes NoPaired-end reads Yes Merged files Merged files Yes YesPipeline Velvet assembly; Python modules Stampy mapping bwa mapping (H37Rv V3), snap mapping ;

BIGSdb; with C extensions (H37Rv V2); duplicates samtools (edited H37Rv V3)MUMmer mapping; (No mapping) variant calling samtools recalibration, variant calling samtools/

custom scripts re-alignment and; vcftoolsvariant calling GATK

Modifiable No Yes Yes Yes (undocumented) Yes

Programming skills needed for KvarQ, MykrobePredictor TB andTBProfiler

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 10 / 14

Page 66: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Sierra Leone dataset

No (%)

Total 92 (100)Fully sensitive 44 (47.8)

Any resistance 48 (52.2)Any SM resistance 22 (23.9)Any INH resistance 30 (32.6)Any RMP resistance 15 (16.3)Any EMB resistance 14 (15.2)Any PZA resistance 9 (9.8)

Any Mono-resistance 23 (25)SM only 14 (15.2)INH only 8 (8.7)RMP only 1 (1.1)EMB only -PZA only -

MDR 11 (12)

Classical DST, Sanger sequencing, IS6110 RFLP DNA fingerprinting,spoligotyping and 24-loci MIRU-VNTR typing available.

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 11 / 14

Feuerriegel et. al., BMC Microbiology, 2012

Page 67: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Sierra Leone dataset

No (%)

Total 92 (100)Fully sensitive 44 (47.8)

Any resistance 48 (52.2)Any SM resistance 22 (23.9)Any INH resistance 30 (32.6)Any RMP resistance 15 (16.3)Any EMB resistance 14 (15.2)Any PZA resistance 9 (9.8)

Any Mono-resistance 23 (25)SM only 14 (15.2)INH only 8 (8.7)RMP only 1 (1.1)EMB only -PZA only -

MDR 11 (12)

Classical DST, Sanger sequencing, IS6110 RFLP DNA fingerprinting,spoligotyping and 24-loci MIRU-VNTR typing available.

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 11 / 14

Feuerriegel et. al., BMC Microbiology, 2012

Page 68: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Sierra Leone dataset

No (%)

Total 92 (100)Fully sensitive 44 (47.8)

Any resistance 48 (52.2)Any SM resistance 22 (23.9)Any INH resistance 30 (32.6)Any RMP resistance 15 (16.3)Any EMB resistance 14 (15.2)Any PZA resistance 9 (9.8)

Any Mono-resistance 23 (25)SM only 14 (15.2)INH only 8 (8.7)RMP only 1 (1.1)EMB only -PZA only -

MDR 11 (12)

Classical DST, Sanger sequencing, IS6110 RFLP DNA fingerprinting,spoligotyping and 24-loci MIRU-VNTR typing available.

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 11 / 14

Feuerriegel et. al., BMC Microbiology, 2012

Page 69: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Sierra Leone dataset

No (%)

Total 92 (100)Fully sensitive 44 (47.8)

Any resistance 48 (52.2)Any SM resistance 22 (23.9)Any INH resistance 30 (32.6)Any RMP resistance 15 (16.3)Any EMB resistance 14 (15.2)Any PZA resistance 9 (9.8)

Any Mono-resistance 23 (25)SM only 14 (15.2)INH only 8 (8.7)RMP only 1 (1.1)EMB only -PZA only -

MDR 11 (12)

Classical DST, Sanger sequencing, IS6110 RFLP DNA fingerprinting,spoligotyping and 24-loci MIRU-VNTR typing available.

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 11 / 14

Feuerriegel et. al., BMC Microbiology, 2012

Page 70: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Sierra Leone dataset

No (%)

Total 92 (100)Fully sensitive 44 (47.8)

Any resistance 48 (52.2)Any SM resistance 22 (23.9)Any INH resistance 30 (32.6)Any RMP resistance 15 (16.3)Any EMB resistance 14 (15.2)Any PZA resistance 9 (9.8)

Any Mono-resistance 23 (25)SM only 14 (15.2)INH only 8 (8.7)RMP only 1 (1.1)EMB only -PZA only -

MDR 11 (12)

Classical DST, Sanger sequencing, IS6110 RFLP DNA fingerprinting,spoligotyping and 24-loci MIRU-VNTR typing available.

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 11 / 14

Feuerriegel et. al., BMC Microbiology, 2012

Page 71: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Page 72: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Page 73: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Rough digestion into the 7 main phylogenetic lineages.

Page 74: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Page 75: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Highest resolutional depth by using SNPs from Coll et al. 2015

Page 76: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Page 77: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

MykrobePredictor TB is unable to classify strains belonging tolin. 5/ WA 1

Page 78: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

Page 79: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Phylogenetic lineage

Genotype #strains CASTB KvarQ Mykr.Pred. PhyResSE TBProfilerEAI 4 lin. 1 lin. 1 lin. 1 lin.1.1.1 lin.1.1.1Beijing 4 lin. 2 lin. 2 lin. 2 lin.2.2.1 lin.2.2.1Ghana 1 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1Sierra Leone-1 7 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.1

X-type1 lin. 4 lin. 4 lin. 4 lin.4.1.1.1 lin.4.1.1.11 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.3

Haarlem 12 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.1

LAM

9 lin. 4 lin. 4 lin. 4 lin.4.3.3 lin.4.3.31 M. bovis lin. 4 lin. 4 lin.4.3.3 lin.4.3.32 lin. 4 lin. 4 lin. 4 lin.4.3.4.1 lin.4.3.4.13 lin. 4 lin. 4 lin. 4 lin.4.3.4.2 lin.4.3.4.2

S-type 3 lin. 4 lin. 4 lin. 4 lin.4.4.1.1 lin.4.4.1.1Cameroon 4 lin. 4 lin. 4 lin. 4 lin.4.6.2.2 lin.4.6.2.2Sierra Leone-2 9 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8WA 1 6 lin. 5 lin. 5 Unknown lin.5 lin.5WA 2 14 lin. 6 lin. 6 lin. 6 lin.6 lin.6

None

3 lin. 4 lin. 4 lin. 4 lin.4.1 lin.4.13 lin. 4 lin. 4 lin. 4 lin.4.1.1.3 lin.4.1.1.31 lin. 4 lin. 4 lin. 4 lin.4.1.2.1 lin.4.1.2.11 lin. 4 lin. 4 lin. 4 lin.4.6 lin.4.6.13 lin. 4 lin. 4 lin. 4 lin.4.8 lin.4.8

lin. 1:East-African/Indian; lin 4: Euro-American Superlineage; lin 5: West African 1; lin 6: WestAfrican 2

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 12 / 14

CASTB classified one strain belonging to lineage 4.3.3/LAM asM. bovis

Page 80: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Page 81: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Page 82: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Use phylogenetic marker kasA Gly269Ser as marker for INH resistance.

Page 83: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Page 84: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Miss markers embB Trp332Arg, Asp354Ala, Gly406Asp, Gln497Lys andHis1002Arg for EMB resistance

Page 85: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Skip gidB for SM resistance prediction.

Page 86: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Indels in gidB promotor region are reported but not flagged asresistance-mediating.

Page 87: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Performance-Resistance prediction

Antibiotic Sanger CASTB KvarQ MykrobePredictor PhyResSE TBProfiler#R #R = - + #R = - + #R = - + #R = - + #R = - +

Isoniazid 27 37 25 27 29 37inhA 2 3 2 0 1 3 2 0 1 0 0 2 0 4 2 0 2 1 0 2 1katG 24 23 23 1 n.a. 22 22 2 0 23 22 2 1 24 24 0 0 23 23 1 0ahpC 1 1 0 1 1 - - - - 0 0 0 0 1 1 0 0 5 0 1 5fabG1 n.a. 4 - - 4 - - - - 4 - - 4 4 - - 4 4 - - 4kasA n.a. 7 - - 7 - - - - - - - - - - - - 7 - - 7

Rifampicin 19 17 18 27 20 20rpoB 19 17 17 2 0 18 18 1 0 27 19 0 8 20 19 0 1 20 19 0 1

Ethambutol 16 8 7 8 15 15embB 16 8 8 8 0 7 7 8 0 8 7 9 1 15 15 1 0 15 15 1 0

Streptomycin 39 11 22 22 33 22rpsL 20 11 11 9 0 20 20 0 0 20 20 0 0 20 20 0 0 20 20 0 0gidB 17 0 0 17 0 0 0 17 0 0 0 17 0 11 11 6 0 0 0 17 0rrs 2 0 0 2 0 2 2 0 0 2 2 0 0 2 2 0 0 2 2 0 0

Pyrazinamid 11 5 5 9 7pncA 11 5 5 6 0 5 5 6 0 n.a. n.a. n.a. n.a. 9 8 3 1 7 6 5 1

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 13 / 14

Skips the analysis of pncA.

Page 88: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 89: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 90: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 91: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 92: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 93: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 94: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 95: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 96: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Summary

• 5 automated tools for resistance prediction available

• Making NGS-based resistance determination available to a largercommunity.

• Tools differ in:

• Handling• Pipeline• Output presentation• Resistance Profile

y Consistent, approved database for resistance-conferring mutationsneeded!

V. Schleusener Comparison of automated software tools RaMi-NGS 2016 14 / 14

Page 97: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Acknowledgements

Molecular and Experimental Mycobacteriology:Stefan Niemann Susanne HomolkaSilke Feuerriegel Matthias MerkerChristiane Gerlach Judith PetersenThomas Kohl Patrick BeckertAnja Lüdemann Julia ZalletSilvia Maaß Vanessa MohrSven Malm Tanja UbbenTanja Struwe-Sonnenschein Leila JeljeliGlennah Kerubi Doreen BeyerBarbara Tizzano Christian UtpatelRobin Koch Yassir Adam ShuaibEcaterina Noroc Anna Engström

Thank you for your attention!

Contact: [email protected]

Page 98: Mycobacterium tuberculosis resistance prediction from ... · Tuberculosis •Worldwide occurring infection (normally of the lung) •1.5 million deaths annually •9.6 million cases

Acknowledgements

Molecular and Experimental Mycobacteriology:Stefan Niemann Susanne HomolkaSilke Feuerriegel Matthias MerkerChristiane Gerlach Judith PetersenThomas Kohl Patrick BeckertAnja Lüdemann Julia ZalletSilvia Maaß Vanessa MohrSven Malm Tanja UbbenTanja Struwe-Sonnenschein Leila JeljeliGlennah Kerubi Doreen BeyerBarbara Tizzano Christian UtpatelRobin Koch Yassir Adam ShuaibEcaterina Noroc Anna Engström

Thank you for your attention!

Contact: [email protected]