Benchmark Evidence

Latest approved benchmark snapshot

Canonical source policy: nightly tier200 on main. Current snapshot: schedule / tier200 / main on ubuntu-24.04 (Node 22). Updates are synced via PR and require manual review before merge.

0 regression alertssnapshot 25648761301.1as of May 11, 2026

Peak throughput

1600.90img/s

batch-all warm cache

Max cold→warm speedup

600.30x

across profiles and scenarios

Headline scenario

P2 / batch-all

79.42 s cold, 132.37 ms warm p50

Cold wall time

single-small

120.3 ms

single-median

150.5 ms

single-large

980.0 ms

batch-all

13.82 s

single-small

206.6 ms

single-median

373.6 ms

single-large

4.93 s

batch-all

79.42 s

single-small

235.6 ms

single-median

673.3 ms

single-large

951.5 ms

batch-all

50.36 s

Warm p50 wall time

single-small

90.41 ms

single-median

93.02 ms

single-large

90.26 ms

batch-all

124.73 ms

single-small

91.70 ms

single-median

91.01 ms

single-large

90.14 ms

batch-all

132.37 ms

single-small

91.64 ms

single-median

91.66 ms

single-large

92.84 ms

batch-all

236.62 ms

Head vs base deltas

P1 / single-small

Warm p50: -1.15%
Warm p95: +8.53%
Cold: +3.03%
Alerts: none

P1 / single-median

Warm p50: +2.62%
Warm p95: +4.26%
Cold: -2.21%
Alerts: none

P1 / single-large

Warm p50: -1.49%
Warm p95: -1.03%
Cold: +0.61%
Alerts: none

P1 / batch-all

Warm p50: +0.47%
Warm p95: +3.87%
Cold: +0.40%
Alerts: none

P2 / single-small

Warm p50: +1.96%
Warm p95: +3.97%
Cold: +0.69%
Alerts: none

P2 / single-median

Warm p50: +0.71%
Warm p95: +4.22%
Cold: -0.32%
Alerts: none

P2 / single-large

Warm p50: -0.27%
Warm p95: +1.88%
Cold: +0.19%
Alerts: none

P2 / batch-all

Warm p50: +0.71%
Warm p95: +0.19%
Cold: -0.24%
Alerts: none

P3 / single-small

Warm p50: -1.09%
Warm p95: +2.00%
Cold: -0.06%
Alerts: none

P3 / single-median

Warm p50: -1.81%
Warm p95: +0.49%
Cold: -3.04%
Alerts: none

P3 / single-large

Warm p50: +0.05%
Warm p95: +3.78%
Cold: +0.06%
Alerts: none

P3 / batch-all

Warm p50: -0.88%
Warm p95: -0.86%
Cold: -0.09%
Alerts: none

Profile	Scenario	Warm p50 Δ	Warm p95 Δ	Cold Δ	Alerts
P1	single-small	-1.15%	+8.53%	+3.03%	none
P1	single-median	+2.62%	+4.26%	-2.21%	none
P1	single-large	-1.49%	-1.03%	+0.61%	none
P1	batch-all	+0.47%	+3.87%	+0.40%	none
P2	single-small	+1.96%	+3.97%	+0.69%	none
P2	single-median	+0.71%	+4.22%	-0.32%	none
P2	single-large	-0.27%	+1.88%	+0.19%	none
P2	batch-all	+0.71%	+0.19%	-0.24%	none
P3	single-small	-1.09%	+2.00%	-0.06%	none
P3	single-median	-1.81%	+0.49%	-3.04%	none
P3	single-large	+0.05%	+3.78%	+0.06%	none
P3	batch-all	-0.88%	-0.86%	-0.09%	none

Throughput (batch-all, warm)

1600.90 img/s

1511.71 img/s

842.52 img/s

Recent approved snapshots

Snapshot

25648761301.1

As of: May 11, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25618756159.1

As of: May 10, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25590464975.1

As of: May 9, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25534995887.1

As of: May 8, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25474442767.1

As of: May 7, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25414870461.1

As of: May 6, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25356252947.1

As of: May 5, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

25299558476.1

As of: May 4, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot	As of	Tier	Run
25648761301.1	May 11, 2026	tier200	open
25618756159.1	May 10, 2026	tier200	open
25590464975.1	May 9, 2026	tier200	open
25534995887.1	May 8, 2026	tier200	open
25474442767.1	May 7, 2026	tier200	open
25414870461.1	May 6, 2026	tier200	open
25356252947.1	May 5, 2026	tier200	open
25299558476.1	May 4, 2026	tier200	open

Source workflow

Benchmark CI

.github/workflows/benchmark-ci.yml

Governance owner

ImageForge Maintainers (CLI + Growth)

dataset 1.0.0