Skip to content

docs(reference): add the benchmarks page#54

Open
coderdan wants to merge 1 commit into
v2from
docs/benchmarks-reference
Open

docs(reference): add the benchmarks page#54
coderdan wants to merge 1 commit into
v2from
docs/benchmarks-reference

Conversation

@coderdan

@coderdan coderdan commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

Adds /docs/reference/benchmarks — the performance numbers with methodology, per the IA. Closes the gap where these figures existed only in the external benches repo.

Source

Numbers distilled from the public cipherstash/benches EQL v3 suite (PR: eql-v3-benches), specifically the report/BENCHMARK_REPORT.md "vs plaintext PostgreSQL" table and report/V3_COMPARISON.md. Every figure is cross-checked against the plaintext baseline; nothing is restated without a source.

What the page covers

  • Query latency @ 1M rows with the ratio to plaintext Postgres on the same shape with an equivalent index: exact match 0.12 ms (1.3x), OPE range 0.12 ms (1.2x), ORE range 0.52 ms (5.2x), JSON @> 0.40 ms (1.4x), GROUP BY 83 ms (2.2x).
  • Scaling — the fast-path ratios stay flat 10k → 10M.
  • OPE-vs-ORE range/order tradeoff (incl. index build 1 s vs 44 s), free-text bloom match (100-400x vs seq scan), ingest throughput, methodology, caveats, and repro steps.
  • Cross-links to Searchable encryption and EQL indexes.

Verification

  • bun run build green (694 pages); validate-links reports no broken links.
  • Environment noted on the page: Apple M1 Max, PostgreSQL 17, EQL v3.

Notes / scope

  • ZeroKMS-vs-AWS-KMS throughput (the listing's "14x" claim) is not included: it isn't in the benches suite I was pointed at, and there's no /concepts/compare/aws-kms page yet to cross-link. Left it out rather than restate an unsourced number — happy to add a "key-management throughput" section once that benchmark/page lands.
  • Charts not embedded — the benches report has ~60 PNGs; I linked to it rather than copy binary assets. Can embed a couple of hero charts as a follow-up if you want them inline.
  • One honest caveat carried onto the page: the JSON contains 10M outlier is a documented plan artifact, flagged as such.

Publishes the EQL v3 query-performance numbers from cipherstash/benches at
/reference/benchmarks, so the performance claims have a docs page to land on:

- encrypted-vs-plaintext query latency (exact match and OPE range within
  ~1.2-1.4x of plaintext, flat from 10k to 10M rows)
- the OPE-vs-ORE range/order tradeoff, free-text bloom match, JSON, GROUP BY
- ingest throughput, methodology, caveats, and repro steps

Every figure is sourced from the public benches report and cross-checked
against the plaintext baseline. Ticks the IA checklist item.
@vercel

vercel Bot commented Jul 8, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
public-docs Ready Ready Preview, Comment Jul 8, 2026 9:51am

Request Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant