SortMeRNA Benchmark Summary

Generated: 2026-07-05 10:27:52 | SortMeRNA v6.0.2 | Database: smr_v6.0.2_default_db | E-value: 1e-5 | AWS EC2 r6i.16xlarge (64 vCPUs, 512 GB RAM), 40 threads

Datasets: Benchmark datasets from Deng et al. 2022 (Nucleic Acids Research, doi:10.1093/nar/gkac112). FN = rRNA input (measures sensitivity); FP = non-rRNA input (measures specificity); FN+FP = mixed.

DatasetTestPairsDescription
SILVA_rRNAFN20,000,000SILVA SSU+LSU rRNA sequences
OMA_CDSFP20,000,000Prokaryotic and eukaryotic mRNA
oma_silvaFP1,027,675OMA mRNA CDSs with ≥70% identity to rRNA genes; FPR on rRNA-similar mRNA
homd_fpFP100,558HOMD oral-microbe mRNA CDSs with ≥70% identity to high-FPR rRNA hits in OMA_CDS
ENA_virusFP27,206,792Viral gene sequences from ENA
Amplicon_16SFN7,917,920Real 16S V1-V2 amplicon reads (oral microbiome)
Human_ncRNAFP6,330,381Human non-coding RNA
MetaTFN+FP9,165,829Oral metatranscriptome: 4.7M prokaryotic mRNA, 2.5M human mRNA, 73K viral mRNA, 1.9M rRNA (21% rRNA fraction)

Metrics: Sensitivity = (total - misclassifications) / total for FN datasets. FPR = misclassifications / total for FP datasets. MetaT reports reads classified as rRNA vs. the expected ~21% rRNA fraction.

DatasetTypeTotal pairs Misclassifications / rRNA classifiedMetricValue Wall time (s)Memory (MB)
oma_silvanonrrna102767515966FPR1.55%36283805
homd_fpnonrrna1005581604FPR1.60%153784
OMA_CDSnonrrna200000001448FPR0.01%91033814
SILVA_rRNArrna200000005345Sensitivity99.97%41394358
Amplicon_16Srrna79179207Sensitivity100.00%12714214
Human_ncRNAnonrrna63303812003FPR0.03%1413798
MetaTmixed91658291888130 (20.6% of reads classified as rRNA; ~21% expected)NANA9943981
ENA_virusnonrrna27206792217FPR0.00%3673792