Results Overview

Mappers were evaluated for the given test data set. The table below shows the used parameters, mapping statistics and throughput for each mapper. Detailed results for a mapper can be displayed by clicking on its name in the table or the navigation on top.

StateMapperParametersCorrectly MappedWrongly MappedNot MappedThroughput (reads/s)
BWA87.419%11.544%1.037%5054
BWA-MEM88.286%11.699%0.015%6709
BWA-SW85.862%11.581%2.556%2749
NGM88.236%11.634%0.130%6808
Bowtie 288.038%11.649%0.313%8241

The figure below visualizes above results by directly comparing accuracy and throughput. The optimal mapper showing both highest accuracy and throughput, if any, will be located in the top right corner.

Data Set

This section contains information on the benchmark data set.

Simulation Overview

Input Data SourceSimulated data set (created using Teaser)
Sequencing Platformillumina
Read Length60
Read Count598858
Sequence Divergence0.0010 overall mutation rate, 0.3000 indel fraction, 1.0000 indel average length
Paired-EndNo
Insert SizeNone
Reads by Edit DistanceThe edit distance of a read is calculated as the total number of bases that are different to the reference. This includes mutations and sequencing errors.

Simulation Details

Subsampling enabledYes
Simulator/project/teaser/genometeaser/software/mason illumina --read-name-prefix read --sq -n 60 -N 598858 --ll 500 --le 50 --hi 0.000300 --hs 0.000700 --hm 1 --hM 4 --source-no-N /project/teaser/genometeaser/references/D_melanogaster.fasta.sampled.4.600.120.fasta
Sampling ratio0.250
Sampling region length600
Reference Genome File/project/teaser/genometeaser/references/D_melanogaster.fasta
Read File(s)/project/teaser/genometeaser/tests_generated/36c0b9ed4ca2236f8f8f48f19e427ab8/reads.fastq
Gold Standard Alignment File/project/teaser/genometeaser/tests_generated/36c0b9ed4ca2236f8f8f48f19e427ab8/mapping_comparison.sam
Mapping Statistics

This plot shows the fractions of correctly, wrongly and not mapped reads for each mapper and the selected mapping quality cutoff. Reads that have been filtered using the mapping quality cutoff are shown as unmapped. The interactive legend can be used to, for example, display only the number of wrongly and not mapped reads.

Edit Distance

This plot shows the effect of the number of mismatches introduced in reads on mapping rates.

Mapping Quality

This section represents an overview of the distribution of mapping quality values for all mappers. A detailed evaluation of mapping qualities for specific mappers can be found on the respective mapper results page (accessible using the navigation on top). The first plot rates each mapping quality threshold (0-255) by comparing the numbers of wrongly and correctly mapped reads that would be removed due to falling under the threshold. The second plot shows the total number of mapped reads for each mapping quality threshold (all reads with a mapping quality value smaller or equal to the threshold).

 

MAPQ ROC

Precision and Recall
Correctly Mapped/s
Memory Usage