Benchmark Evidence

Latest approved benchmark snapshot

Canonical source policy: nightly tier200 on main. Current snapshot: schedule / tier200 / main on ubuntu-24.04 (Node 22). Updates are synced via PR and require manual review before merge.

0 regression alertssnapshot 23102468979.1as of March 15, 2026

Peak throughput

1556.20img/s

batch-all warm cache

Max cold→warm speedup

600.65x

across profiles and scenarios

Headline scenario

P2 / batch-all

79.62 s cold, 132.26 ms warm p50

Cold wall time

single-small

122.6 ms

single-median

152.3 ms

single-large

984.4 ms

batch-all

15.19 s

single-small

210.9 ms

single-median

376.8 ms

single-large

4.96 s

batch-all

79.62 s

single-small

234.9 ms

single-median

681.7 ms

single-large

957.4 ms

batch-all

50.57 s

Warm p50 wall time

single-small

94.44 ms

single-median

93.08 ms

single-large

94.02 ms

batch-all

128.89 ms

single-small

92.36 ms

single-median

92.68 ms

single-large

95.65 ms

batch-all

132.26 ms

single-small

93.18 ms

single-median

94.38 ms

single-large

95.69 ms

batch-all

249.40 ms

Head vs base deltas

P1 / single-small

Warm p50: +1.74%
Warm p95: +3.34%
Cold: -4.96%
Alerts: none

P1 / single-median

Warm p50: +2.72%
Warm p95: +3.11%
Cold: +1.69%
Alerts: none

P1 / single-large

Warm p50: +1.27%
Warm p95: -4.34%
Cold: -3.85%
Alerts: none

P1 / batch-all

Warm p50: +2.81%
Warm p95: +1.25%
Cold: +9.96%
Alerts: none

P2 / single-small

Warm p50: +1.78%
Warm p95: +3.05%
Cold: +2.91%
Alerts: none

P2 / single-median

Warm p50: +1.85%
Warm p95: +2.27%
Cold: +0.36%
Alerts: none

P2 / single-large

Warm p50: +3.44%
Warm p95: +5.23%
Cold: +0.32%
Alerts: none

P2 / batch-all

Warm p50: -3.09%
Warm p95: -1.40%
Cold: +0.13%
Alerts: none

P3 / single-small

Warm p50: -1.60%
Warm p95: -2.66%
Cold: -1.22%
Alerts: none

P3 / single-median

Warm p50: +0.51%
Warm p95: +1.16%
Cold: +0.02%
Alerts: none

P3 / single-large

Warm p50: -0.42%
Warm p95: -0.69%
Cold: -0.46%
Alerts: none

P3 / batch-all

Warm p50: -1.43%
Warm p95: -0.30%
Cold: +0.28%
Alerts: none

Profile	Scenario	Warm p50 Δ	Warm p95 Δ	Cold Δ	Alerts
P1	single-small	+1.74%	+3.34%	-4.96%	none
P1	single-median	+2.72%	+3.11%	+1.69%	none
P1	single-large	+1.27%	-4.34%	-3.85%	none
P1	batch-all	+2.81%	+1.25%	+9.96%	none
P2	single-small	+1.78%	+3.05%	+2.91%	none
P2	single-median	+1.85%	+2.27%	+0.36%	none
P2	single-large	+3.44%	+5.23%	+0.32%	none
P2	batch-all	-3.09%	-1.40%	+0.13%	none
P3	single-small	-1.60%	-2.66%	-1.22%	none
P3	single-median	+0.51%	+1.16%	+0.02%	none
P3	single-large	-0.42%	-0.69%	-0.46%	none
P3	batch-all	-1.43%	-0.30%	+0.28%	none

Throughput (batch-all, warm)

1556.20 img/s

1508.80 img/s

803.26 img/s

Recent approved snapshots

Snapshot

23102468979.1

As of: March 15, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

23079143524.1

As of: March 14, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

23034537191.1

As of: March 13, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

22984963566.1

As of: March 12, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

22885337653.1

As of: March 10, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

22836893673.1

As of: March 9, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

22812819023.1

As of: March 8, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

22790751551.1

As of: March 7, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot	As of	Tier	Run
23102468979.1	March 15, 2026	tier200	open
23079143524.1	March 14, 2026	tier200	open
23034537191.1	March 13, 2026	tier200	open
22984963566.1	March 12, 2026	tier200	open
22885337653.1	March 10, 2026	tier200	open
22836893673.1	March 9, 2026	tier200	open
22812819023.1	March 8, 2026	tier200	open
22790751551.1	March 7, 2026	tier200	open

Source workflow

Benchmark CI

.github/workflows/benchmark-ci.yml

Governance owner

ImageForge Maintainers (CLI + Growth)

dataset 1.0.0