Benchmark Evidence

Latest approved benchmark snapshot

Canonical source policy: nightly tier200 on main. Current snapshot: schedule / tier200 / main on ubuntu-24.04 (Node 22). Updates are synced via PR and require manual review before merge.

0 regression alertssnapshot 29073324785.1as of July 10, 2026

Peak throughput

1548.10img/s

batch-all warm cache

Max cold→warm speedup

534.82x

across profiles and scenarios

Headline scenario

P2 / batch-all

72.49 s cold, 134.82 ms warm p50

Cold wall time

single-small

142.0 ms

single-median

151.0 ms

single-large

934.6 ms

batch-all

14.15 s

single-small

201.9 ms

single-median

359.8 ms

single-large

4.54 s

batch-all

72.49 s

single-small

231.1 ms

single-median

641.9 ms

single-large

891.0 ms

batch-all

46.65 s

Warm p50 wall time

single-small

92.21 ms

single-median

95.61 ms

single-large

94.69 ms

batch-all

129.62 ms

single-small

94.22 ms

single-median

93.98 ms

single-large

94.62 ms

batch-all

134.82 ms

single-small

95.88 ms

single-median

95.23 ms

single-large

93.71 ms

batch-all

243.41 ms

Head vs base deltas

P1 / single-small

Warm p50: -1.72%
Warm p95: +5.52%
Cold: +11.06%
Alerts: none

P1 / single-median

Warm p50: +4.61%
Warm p95: +7.83%
Cold: +0.34%
Alerts: none

P1 / single-large

Warm p50: +3.18%
Warm p95: -3.01%
Cold: +1.33%
Alerts: none

P1 / batch-all

Warm p50: +2.41%
Warm p95: +4.09%
Cold: +6.38%
Alerts: none

P2 / single-small

Warm p50: +0.36%
Warm p95: +1.65%
Cold: -0.07%
Alerts: none

P2 / single-median

Warm p50: -1.22%
Warm p95: -2.25%
Cold: +0.30%
Alerts: none

P2 / single-large

Warm p50: +0.40%
Warm p95: +17.16%
Cold: -0.34%
Alerts: none

P2 / batch-all

Warm p50: -0.42%
Warm p95: +2.89%
Cold: +0.54%
Alerts: none

P3 / single-small

Warm p50: +0.90%
Warm p95: +0.66%
Cold: +0.33%
Alerts: none

P3 / single-median

Warm p50: -1.43%
Warm p95: -4.51%
Cold: +0.22%
Alerts: none

P3 / single-large

Warm p50: -1.21%
Warm p95: -0.20%
Cold: -0.57%
Alerts: none

P3 / batch-all

Warm p50: +0.58%
Warm p95: +1.60%
Cold: -0.27%
Alerts: none

Profile	Scenario	Warm p50 Δ	Warm p95 Δ	Cold Δ	Alerts
P1	single-small	-1.72%	+5.52%	+11.06%	none
P1	single-median	+4.61%	+7.83%	+0.34%	none
P1	single-large	+3.18%	-3.01%	+1.33%	none
P1	batch-all	+2.41%	+4.09%	+6.38%	none
P2	single-small	+0.36%	+1.65%	-0.07%	none
P2	single-median	-1.22%	-2.25%	+0.30%	none
P2	single-large	+0.40%	+17.16%	-0.34%	none
P2	batch-all	-0.42%	+2.89%	+0.54%	none
P3	single-small	+0.90%	+0.66%	+0.33%	none
P3	single-median	-1.43%	-4.51%	+0.22%	none
P3	single-large	-1.21%	-0.20%	-0.57%	none
P3	batch-all	+0.58%	+1.60%	-0.27%	none

Throughput (batch-all, warm)

1548.10 img/s

1475.58 img/s

813.59 img/s

Recent approved snapshots

Snapshot

29073324785.1

As of: July 10, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

28919942283.1

As of: July 8, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

28773187398.1

As of: July 6, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

28731699604.1

As of: July 5, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

28641837684.1

As of: July 3, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

28491481030.1

As of: July 1, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

28346747895.1

As of: June 29, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot

28310093029.1

As of: June 28, 2026
Tier: tier200
Alerts: 0

Open run

Snapshot	As of	Tier	Run
29073324785.1	July 10, 2026	tier200	open
28919942283.1	July 8, 2026	tier200	open
28773187398.1	July 6, 2026	tier200	open
28731699604.1	July 5, 2026	tier200	open
28641837684.1	July 3, 2026	tier200	open
28491481030.1	July 1, 2026	tier200	open
28346747895.1	June 29, 2026	tier200	open
28310093029.1	June 28, 2026	tier200	open

Source workflow

Benchmark CI

.github/workflows/benchmark-ci.yml

Governance owner

ImageForge Maintainers (CLI + Growth)

dataset 1.0.0