Concordance-gated public results

Benchmarks

AutoZyme reports wall-clock speedups against upstream toolkits, with method-specific output checks for every run. The first view is grouped by accelerated task; the raw run table remains below for audit.

98
Public runs
18
Accelerated tasks
8.5×
Median passing speedup
4,363×
Peak passing speedup
98.0%
96/98 pass
Fastest win
4,363×
Scanpy sc_rank_genes
heart_adult · 32 threads · 21.81 min to 300 ms
Seurat path
69.9×
run_pca
pbmc68k · 1.86 min to 1.60 s
Longest baseline
86.29 min
Seurat sctransform
Optimized to 1.80 min with 47.9× speedup
Coverage
18 tasks
2 toolkits · 5 datasets
96/98 public runs pass their concordance gate

Accelerated tasks

18 of 18 tasks shown

Preprocessing

7 tasks
Seurat5/5 pass

normalize_data

Best59.5×
Median2.00×
Datasets3
pbmc68k · 32 threads2.38 s to 40 ms
heart_adult, pbmc200k, pbmc68k1, 32 threadsmin concordance 1.000 data_cor
Seurat3/3 pass

sctransform

Best47.9×
Median18.1×
Datasets2
pbmc200k · 1 threads86.29 min to 1.80 min
pbmc200k, pbmc68k1, 32 threadsmin concordance 1.000 residual_cor
Scanpy6/6 pass

sc_highly_variable

Best34.5×
Median16.3×
Datasets3
heart_adult · 32 threads6.90 s to 200 ms
heart_adult, pbmc200k_glaucoma, pbmc68k1, 32 threadsmin concordance 1.000 hvg_overlap
Scanpy6/6 pass

sc_normalize

Best31.7×
Median20.8×
Datasets3
heart_adult · 32 threads9.50 s to 300 ms
heart_adult, pbmc200k_glaucoma, pbmc68k1, 32 threadsmin concordance 1.000 data_cor
Seurat5/5 pass

scale_data

Best18.9×
Median9.04×
Datasets3
pbmc68k · 32 threads2.08 s to 110 ms
heart_adult, pbmc200k, pbmc68k1, 32 threadsmin concordance 1.000 data_cor
Seurat5/5 pass

find_variable_features

Best16.8×
Median8.07×
Datasets3
pbmc200k · 32 threads10.89 s to 650 ms
heart_adult, pbmc200k, pbmc68k1, 32 threadsmin concordance 1.000 top2000_jaccard
Scanpy6/6 pass

sc_scale

Best8.01×
Median5.46×
Datasets3
pbmc68k · 1 threads500 ms to 62 ms
heart_adult, pbmc200k_glaucoma, pbmc68k1, 32 threadsmin concordance 1.000 data_cor

Dimensionality reduction

4 tasks
Seurat6/6 pass

run_pca

Best69.9×
Median30.0×
Datasets3
pbmc68k · 32 threads1.86 min to 1.60 s
heart_adult, pbmc200k, pbmc68k1, 32 threadsmin concordance 1.000 embedding_cor
Scanpy6/6 pass

sc_pca

Best28.7×
Median16.0×
Datasets3
pbmc200k_glaucoma · 32 threads57.40 s to 2.00 s
heart_adult, pbmc200k_glaucoma, pbmc68k1, 32 threadsmin concordance 1.000 embedding_cor
Seurat6/6 pass

run_umap

Best3.79×
Median3.35×
Datasets3
pbmc200k · 1 threads4.54 min to 1.20 min
heart_adult, pbmc200k, pbmc68k1, 32 threadsmin concordance 0.963 embedding_cor
Scanpy6/6 pass

sc_umap

Best2.00×
Median1.58×
Datasets3
heart_adult · 1 threads4.61 min to 2.31 min
heart_adult, pbmc200k_glaucoma, pbmc68k1, 32 threadsmin concordance 0.971 embedding_cor

Graph + clustering

4 tasks
Scanpy6/6 pass

sc_neighbors

Best35.6×
Median9.96×
Datasets3
pbmc68k · 32 threads32.00 s to 900 ms
heart_adult, pbmc200k_glaucoma, pbmc68k1, 32 threadsmin concordance 0.917 nn_overlap
Seurat4/6 pass

find_clusters_leiden

Best8.95×
Median7.07×
Datasets3
heart_adult · 1 threads3.27 min to 21.92 s
heart_adult, pbmc200k, pbmc68k1, 32 threadsmin concordance 0.922 ari
Scanpy6/6 pass

sc_leiden

Best8.53×
Median7.49×
Datasets3
heart_adult · 1 threads1.96 min to 13.80 s
heart_adult, pbmc200k_glaucoma, pbmc68k1, 32 threadsmin concordance 0.980 ari
Seurat6/6 pass

find_clusters_louvain

Best3.90×
Median2.83×
Datasets3
pbmc200k · 1 threads1.18 min to 18.23 s
heart_adult, pbmc200k, pbmc68k1, 32 threadsmin concordance 0.961 ari

Differential expression

2 tasks
Scanpy6/6 pass

sc_rank_genes

Best4,363×
Median1,699×
Datasets3
heart_adult · 32 threads21.81 min to 300 ms
heart_adult, pbmc200k_glaucoma, pbmc68k1, 32 threadsmin concordance 1.000 top100_overlap
Seurat6/6 pass

find_all_markers

Best48.5×
Median31.9×
Datasets3
heart_adult · 1 threads44.46 min to 54.97 s
heart_adult, pbmc200k, pbmc68k1, 32 threadsmin concordance 1.000 gene_jaccard

Integration

1 task
Seurat2/2 pass

integrate_cca

Best8.32×
Median8.10×
Datasets1
ifnb · 32 threads1.82 min to 13.14 s
ifnb1, 32 threadsmin concordance 0.999 embedding_cor
Raw benchmark runs98 of 98 shownShow table