P1 / single-small
- Warm p50
- -2.49%
- Warm p95
- +10.24%
- Cold
- -5.94%
- Alerts
- none
Benchmark Evidence
Final v0.2.0 snapshot: workflow_dispatch / tier200 / v0.2.0 on ubuntu-24.04 (Node 22). The workflow ran in advisory mode; a separate strict comparison found no alerts. Both runs used the same release commit, so differences reflect run-to-run variation, not a version comparison. Results are specific to this dataset and environment.
Peak throughput
645.71img/s
batch-all warm cache
Max cold→warm speedup
295.12x
across profiles and scenarios
Headline scenario
P2 / batch-all
96.82 s cold, 328.63 ms warm p50
P1
single-small
148.5 ms
single-median
173.2 ms
single-large
944.2 ms
batch-all
14.45 s
P2
single-small
250.1 ms
single-median
497.1 ms
single-large
6.22 s
batch-all
96.82 s
P3
single-small
294.1 ms
single-median
847.1 ms
single-large
1.16 s
batch-all
59.39 s
P1
single-small
122.70 ms
single-median
125.57 ms
single-large
121.56 ms
batch-all
305.66 ms
P2
single-small
125.70 ms
single-median
123.42 ms
single-large
124.10 ms
batch-all
328.63 ms
P3
single-small
126.49 ms
single-median
128.86 ms
single-large
129.57 ms
batch-all
520.06 ms
P1 / single-small
P1 / single-median
P1 / single-large
P1 / batch-all
P2 / single-small
P2 / single-median
P2 / single-large
P2 / batch-all
P3 / single-small
P3 / single-median
P3 / single-large
P3 / batch-all
P1
645.71 img/s
P2
609.63 img/s
P3
384.07 img/s
Snapshot
41064862724.1
Snapshot
29073324785.1
Snapshot
28919942283.1
Snapshot
28773187398.1
Snapshot
28731699604.1
Snapshot
28641837684.1
Snapshot
28491481030.1
Snapshot
28346747895.1
Source workflow
Benchmark CI
.github/workflows/benchmark-ci.yml
Governance owner
Fabien Campana
dataset 1.0.0