Skip to main content
ImageForge is sunset. The site and npm package remain available; no new feature work is planned.
imageforge
Back to landing

Benchmark Evidence

Latest approved benchmark snapshot

Final v0.2.0 snapshot: workflow_dispatch / tier200 / v0.2.0 on ubuntu-24.04 (Node 22). The workflow ran in advisory mode; a separate strict comparison found no alerts. Both runs used the same release commit, so differences reflect run-to-run variation, not a version comparison. Results are specific to this dataset and environment.

0 regression alertssnapshot 41064862724.1as of October 30, 2026

Peak throughput

645.71img/s

batch-all warm cache

Max cold→warm speedup

295.12x

across profiles and scenarios

Headline scenario

P2 / batch-all

96.82 s cold, 328.63 ms warm p50

Cold wall time

P1

single-small

148.5 ms

single-median

173.2 ms

single-large

944.2 ms

batch-all

14.45 s

P2

single-small

250.1 ms

single-median

497.1 ms

single-large

6.22 s

batch-all

96.82 s

P3

single-small

294.1 ms

single-median

847.1 ms

single-large

1.16 s

batch-all

59.39 s

Warm p50 wall time

P1

single-small

122.70 ms

single-median

125.57 ms

single-large

121.56 ms

batch-all

305.66 ms

P2

single-small

125.70 ms

single-median

123.42 ms

single-large

124.10 ms

batch-all

328.63 ms

P3

single-small

126.49 ms

single-median

128.86 ms

single-large

129.57 ms

batch-all

520.06 ms

Head vs base deltas

P1 / single-small

Warm p50
-2.49%
Warm p95
+10.24%
Cold
-5.94%
Alerts
none

P1 / single-median

Warm p50
-0.40%
Warm p95
-0.94%
Cold
+0.78%
Alerts
none

P1 / single-large

Warm p50
-4.78%
Warm p95
-1.19%
Cold
+0.29%
Alerts
none

P1 / batch-all

Warm p50
-1.52%
Warm p95
+6.13%
Cold
+8.35%
Alerts
none

P2 / single-small

Warm p50
-0.76%
Warm p95
-1.15%
Cold
+0.70%
Alerts
none

P2 / single-median

Warm p50
+0.00%
Warm p95
+1.42%
Cold
+2.31%
Alerts
none

P2 / single-large

Warm p50
-0.84%
Warm p95
+0.82%
Cold
+0.08%
Alerts
none

P2 / batch-all

Warm p50
+0.21%
Warm p95
-0.53%
Cold
+0.35%
Alerts
none

P3 / single-small

Warm p50
+2.18%
Warm p95
-0.22%
Cold
+0.10%
Alerts
none

P3 / single-median

Warm p50
+0.59%
Warm p95
+0.36%
Cold
+0.34%
Alerts
none

P3 / single-large

Warm p50
+0.08%
Warm p95
+0.09%
Cold
+0.52%
Alerts
none

P3 / batch-all

Warm p50
+0.19%
Warm p95
+1.31%
Cold
-0.05%
Alerts
none

Throughput (batch-all, warm)

P1

645.71 img/s

P2

609.63 img/s

P3

384.07 img/s

Recent approved snapshots

Snapshot

41064862724.1

As of
October 30, 2026
Tier
tier200
Alerts
0

Open run

Snapshot

29073324785.1

As of
July 10, 2026
Tier
tier200
Alerts
0

Open run

Snapshot

28919942283.1

As of
July 8, 2026
Tier
tier200
Alerts
0

Open run

Snapshot

28773187398.1

As of
July 6, 2026
Tier
tier200
Alerts
0

Open run

Snapshot

28731699604.1

As of
July 5, 2026
Tier
tier200
Alerts
0

Open run

Snapshot

28641837684.1

As of
July 3, 2026
Tier
tier200
Alerts
0

Open run

Snapshot

28491481030.1

As of
July 1, 2026
Tier
tier200
Alerts
0

Open run

Snapshot

28346747895.1

As of
June 29, 2026
Tier
tier200
Alerts
0

Open run

Source workflow

Benchmark CI

.github/workflows/benchmark-ci.yml

Governance owner

Fabien Campana

dataset 1.0.0