ROI: from stopwatch to dollars
The report is the pitch artifact, and it answers exactly one question:
what did the stopwatch say, and what does that buy? It is generated
mechanically — just report <run-id> reads a ledger row and the
calibrated bench and renders the numbers; nothing is hand-typed.
The three conversions
- Throughput → cores → dollars. A speedup
son a CPU-bound fleet ofNcores returnsN × (1 − 1/s)cores; at a$/core-hourrate that is an annual saving. Both flow through the speedup's confidence interval, so the report quotes a range. - Latency → percentile deltas → value. Under replayed load, the p50/p99 latency speedups with their CIs; a p50 service-time reduction maps to throughput capacity for a CPU-bound service.
- Batch windows → wall-clock hours returned to a schedule.
The rule that makes it survive review
Every figure carries its CI and its workload, and the methodology ships inside the report — the interleaved A/B, the pristine baseline, the bootstrap CI, the gates, the calibration. And the number the report tells you to quote is the CI lower bound, never the median:
On a 500-core fleet at $0.04/core-hour, the cJSON service win (+6.2% p50 latency) returns 27.5 cores / $9,621 per year at the CI lower bound (median 29.4 / $10,290). The point estimate is not a promise.
What the report refuses to do
It will not mint a clean dollar figure for a change that wasn't shipped. A
row whose verdict isn't accepted, or an accepted row that isn't
sanitizer-clean (a pre-gate accept the audit overturned), gets a bold Not
shipped banner before any number. That guard was itself added by the
adversarial review,
which caught the generator pitching the overturned comrak patch. The pitch
artifact is held to the same standard as everything else: it cannot claim
what wasn't proven.