chore(ci): remove benchmark workflow #365

Merged

jwilger-ai-bot merged 4 commits from fix/ci-benchmark-benches-flag into main

2026-04-12 19:04:02 -07:00

jwilger-ai-bot commented

2026-04-12 12:55:25 -07:00

(Migrated from github.com)

Summary

Remove the bench.yml CI workflow entirely
Benchmarks on shared GitHub runners produce unreliable results due to noisy-neighbor effects
The bench crate and Criterion setup remain for local use

Test plan

CI passes without the benchmark workflow

## Summary - Remove the `bench.yml` CI workflow entirely - Benchmarks on shared GitHub runners produce unreliable results due to noisy-neighbor effects - The bench crate and Criterion setup remain for local use ## Test plan - [ ] CI passes without the benchmark workflow

jwilger (Migrated from github.com) approved these changes

2026-04-12 19:03:10 -07:00

github-actions[bot] commented

2026-04-12 19:04:34 -07:00

(Migrated from github.com)

Benchmark Results

test execute/single_stream/memory/cold_start ... bench:       2,110 ns/iter (+/- 45)

test execute/single_stream/warm/memory/10 ... bench:     852,158 ns/iter (+/- 164,555)
test execute/single_stream/warm/memory/100 ... bench:     932,493 ns/iter (+/- 177,263)
test execute/single_stream/warm/memory/1000 ... bench:   1,044,723 ns/iter (+/- 177,710)

test execute/multi_stream/memory/atomic_transfer ... bench:       3,625 ns/iter (+/- 29)

test serialization/serialize/bank_account_event ... bench:          91 ns/iter (+/- 0)

test serialization/deserialize/bank_account_event ... bench:         175 ns/iter (+/- 3)

test store/append/memory/1 ... bench:         954 ns/iter (+/- 14)
test store/append/sqlite/1 ... bench:      66,499 ns/iter (+/- 5,751)
test store/append/memory/10 ... bench:       7,633 ns/iter (+/- 34)
test store/append/sqlite/10 ... bench:     169,429 ns/iter (+/- 5,752)
test store/append/memory/100 ... bench:      78,744 ns/iter (+/- 915)
test store/append/sqlite/100 ... bench:   1,012,340 ns/iter (+/- 22,865)

test store/read_stream/memory/10 ... bench:         384 ns/iter (+/- 26)
test store/read_stream/sqlite/10 ... bench:      42,560 ns/iter (+/- 3,958)
test store/read_stream/memory/100 ... bench:       4,869 ns/iter (+/- 99)
test store/read_stream/sqlite/100 ... bench:      82,481 ns/iter (+/- 3,921)
test store/read_stream/memory/1000 ... bench:      37,882 ns/iter (+/- 1,237)
test store/read_stream/sqlite/1000 ... bench:     450,443 ns/iter (+/- 2,968)

test store/append/postgres/1 ... bench:   1,038,425 ns/iter (+/- 40,433)
test store/append/postgres/10 ... bench:   3,037,760 ns/iter (+/- 82,665)
test store/append/postgres/100 ... bench:  22,834,380 ns/iter (+/- 727,074)

test store/read_stream/postgres/10 ... bench:     383,710 ns/iter (+/- 5,001)
test store/read_stream/postgres/100 ... bench:     562,211 ns/iter (+/- 17,729)
test store/read_stream/postgres/1000 ... bench:   2,234,062 ns/iter (+/- 21,536)

## Benchmark Results ``` test execute/single_stream/memory/cold_start ... bench: 2,110 ns/iter (+/- 45) test execute/single_stream/warm/memory/10 ... bench: 852,158 ns/iter (+/- 164,555) test execute/single_stream/warm/memory/100 ... bench: 932,493 ns/iter (+/- 177,263) test execute/single_stream/warm/memory/1000 ... bench: 1,044,723 ns/iter (+/- 177,710) test execute/multi_stream/memory/atomic_transfer ... bench: 3,625 ns/iter (+/- 29) test serialization/serialize/bank_account_event ... bench: 91 ns/iter (+/- 0) test serialization/deserialize/bank_account_event ... bench: 175 ns/iter (+/- 3) test store/append/memory/1 ... bench: 954 ns/iter (+/- 14) test store/append/sqlite/1 ... bench: 66,499 ns/iter (+/- 5,751) test store/append/memory/10 ... bench: 7,633 ns/iter (+/- 34) test store/append/sqlite/10 ... bench: 169,429 ns/iter (+/- 5,752) test store/append/memory/100 ... bench: 78,744 ns/iter (+/- 915) test store/append/sqlite/100 ... bench: 1,012,340 ns/iter (+/- 22,865) test store/read_stream/memory/10 ... bench: 384 ns/iter (+/- 26) test store/read_stream/sqlite/10 ... bench: 42,560 ns/iter (+/- 3,958) test store/read_stream/memory/100 ... bench: 4,869 ns/iter (+/- 99) test store/read_stream/sqlite/100 ... bench: 82,481 ns/iter (+/- 3,921) test store/read_stream/memory/1000 ... bench: 37,882 ns/iter (+/- 1,237) test store/read_stream/sqlite/1000 ... bench: 450,443 ns/iter (+/- 2,968) test store/append/postgres/1 ... bench: 1,038,425 ns/iter (+/- 40,433) test store/append/postgres/10 ... bench: 3,037,760 ns/iter (+/- 82,665) test store/append/postgres/100 ... bench: 22,834,380 ns/iter (+/- 727,074) test store/read_stream/postgres/10 ... bench: 383,710 ns/iter (+/- 5,001) test store/read_stream/postgres/100 ... bench: 562,211 ns/iter (+/- 17,729) test store/read_stream/postgres/1000 ... bench: 2,234,062 ns/iter (+/- 21,536) ```