Benchmark Evidence

Latest approved benchmark snapshot

Canonical source policy: nightly tier200 on main. Current snapshot: schedule / tier200 / main on ubuntu-24.04 (Node 22). Updates are synced via PR and require manual review before merge.

0 regression alertssnapshot 26928624304.2as of June 4, 2026

Peak throughput

1565.83img/s

batch-all warm cache

Max cold→warm speedup

584.47x

across profiles and scenarios

Headline scenario

P2 / batch-all

79.85 s cold, 136.42 ms warm p50

Cold wall time

single-small

139.1 ms

single-median

149.0 ms

single-large

977.4 ms

batch-all

15.08 s

single-small

205.4 ms

single-median

374.9 ms

single-large

4.94 s

batch-all

79.85 s

single-small

237.8 ms

single-median

677.5 ms

single-large

957.1 ms

batch-all

50.95 s

Warm p50 wall time

single-small

93.72 ms

single-median

92.01 ms

single-large

93.22 ms

batch-all

126.83 ms

single-small

92.01 ms

single-median

92.18 ms

single-large

91.46 ms

batch-all

136.42 ms

single-small

94.50 ms

single-median

94.11 ms

single-large

94.85 ms

batch-all

247.85 ms

Head vs base deltas

P1 / single-small

Warm p50: -1.99%
Warm p95: -1.69%
Cold: +13.42%
Alerts: none

P1 / single-median

Warm p50: -1.74%
Warm p95: +7.32%
Cold: -0.30%
Alerts: none

P1 / single-large

Warm p50: +0.52%
Warm p95: +17.46%
Cold: -0.39%
Alerts: none

P1 / batch-all

Warm p50: -0.39%
Warm p95: +0.53%
Cold: +8.26%
Alerts: none

P2 / single-small

Warm p50: -1.79%
Warm p95: +0.23%
Cold: -0.95%
Alerts: none

P2 / single-median

Warm p50: -0.22%
Warm p95: -3.39%
Cold: -0.66%
Alerts: none

P2 / single-large

Warm p50: -2.31%
Warm p95: -3.53%
Cold: -0.49%
Alerts: none

P2 / batch-all

Warm p50: +0.82%
Warm p95: -5.76%
Cold: -0.30%
Alerts: none

P3 / single-small

Warm p50: -0.05%
Warm p95: -0.43%
Cold: -0.03%
Alerts: none

P3 / single-median

Warm p50: -1.82%
Warm p95: -0.41%
Cold: +0.08%
Alerts: none

P3 / single-large

Warm p50: -0.61%
Warm p95: -4.28%
Cold: -1.54%
Alerts: none

P3 / batch-all

Warm p50: +1.21%
Warm p95: +0.35%
Cold: +0.44%
Alerts: none

Profile	Scenario	Warm p50 Δ	Warm p95 Δ	Cold Δ	Alerts
P1	single-small	-1.99%	-1.69%	+13.42%	none
P1	single-median	-1.74%	+7.32%	-0.30%	none
P1	single-large	+0.52%	+17.46%	-0.39%	none
P1	batch-all	-0.39%	+0.53%	+8.26%	none
P2	single-small	-1.79%	+0.23%	-0.95%	none
P2	single-median	-0.22%	-3.39%	-0.66%	none
P2	single-large	-2.31%	-3.53%	-0.49%	none
P2	batch-all	+0.82%	-5.76%	-0.30%	none
P3	single-small	-0.05%	-0.43%	-0.03%	none
P3	single-median	-1.82%	-0.41%	+0.08%	none
P3	single-large	-0.61%	-4.28%	-1.54%	none
P3	batch-all	+1.21%	+0.35%	+0.44%	none

Throughput (batch-all, warm)

1565.83 img/s

1463.89 img/s

812.62 img/s

Recent approved snapshots

Snapshot

26928624304.2

As of: June 4, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25648761301.1

As of: May 11, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25618756159.1

As of: May 10, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25590464975.1

As of: May 9, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25534995887.1

As of: May 8, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25474442767.1

As of: May 7, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25414870461.1

As of: May 6, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25356252947.1

As of: May 5, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot	As of	Tier	Run
26928624304.2	June 4, 2026	tier200	open
25648761301.1	May 11, 2026	tier200	open
25618756159.1	May 10, 2026	tier200	open
25590464975.1	May 9, 2026	tier200	open
25534995887.1	May 8, 2026	tier200	open
25474442767.1	May 7, 2026	tier200	open
25414870461.1	May 6, 2026	tier200	open
25356252947.1	May 5, 2026	tier200	open

Source workflow

Benchmark CI

.github/workflows/benchmark-ci.yml

Governance owner

ImageForge Maintainers (CLI + Growth)

dataset 1.0.0