Skip to content

[runtime] Integrate atomic blob storage backends - #4502

Draft
patrick-ogrady wants to merge 1 commit into
atomic-blobs-productionfrom
atomic-blobs-backends
Draft

[runtime] Integrate atomic blob storage backends#4502
patrick-ogrady wants to merge 1 commit into
atomic-blobs-productionfrom
atomic-blobs-backends

Conversation

@patrick-ogrady

@patrick-ogrady patrick-ogrady commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Summary

Connects the atomic blob engine to the remaining runtime and storage backends. The cohesive engine already includes the minimal Memory and raw Tokio storage adapters needed to exercise its inline and background drivers; this layer adds the forwarding and platform-specific integrations around them.

This is layer 2 of 6 in the atomic blob stack. It depends on the cohesive engine in #4490, and ordinary-to-atomic migration follows as a separate review unit in #4495.

The layer adds atomic backend/resource integration for:

  • deterministic runtime contexts;
  • audited, faulty, and metered storage wrappers;
  • Linux io_uring storage;
  • Tokio runtime contexts; and
  • the shared recording backend used by runtime tests.

Review focus

  • Every wrapper forwards one coherent Worker and AtomicResources lineage without changing ownership.
  • Deterministic and Tokio contexts expose the same atomic storage contract as their underlying backends.
  • io_uring exact-open and namespace handling match the raw Tokio storage implementation.
  • This layer contains adapters only; the atomic grammar, recovery engine, and public API remain unchanged.

Diff size

  • Production code: +257 / -18 LOC
  • Tests and test infrastructure: +393 / -13 LOC
  • Total: +650 / -31 LOC

Counts are physical diff lines, including comments and blank lines. Test-only files, hooks, and lines inside #[cfg(test)] modules are counted as tests; everything else is counted as production code.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Aug 14, 2026

Copy link
Copy Markdown

Deploying monorepo with  Cloudflare Pages  Cloudflare Pages

Latest commit: 2c338ac
Status: ✅  Deploy successful!
Preview URL: https://c4a4d8f9.monorepo-eu0.pages.dev
Branch Preview URL: https://atomic-blobs-backends.monorepo-eu0.pages.dev

View logs

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Aug 14, 2026

Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Updated (UTC)
✅ Deployment successful!
View logs
commonware-mcp a103c43 Aug 14 2026, 09:05 PM

@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown

Benchmark results

Regressions: 0.

✅ `qmdb::merkleize/v=any::unordered::fixed::mmr k=10000 ch=false s=true cc=true` (2/2 gates passed)
Field Value
Package commonware-storage
Benchmark target qmdb_gungraun
Variant qmdb::merkleize/v=any::unordered::fixed::mmr k=10000 ch=false s=true cc=true
Filter *::bench_merkleize::any_unordered_fixed_mmr
Baseline suite commonware-storage
Gates EstimatedCycles should decrease; tolerance 10.00%; blob_reads should decrease; tolerance 10.00%
Cargo flags --features test-traits
Metric Baseline Current Delta Gate
Ir 13,159,318 13,143,661 -0.12% -
L1hits 16,819,414 16,800,065 -0.12% -
LLhits 94,113 93,468 -0.69% -
RamHits 11,467 13,264 +15.67% -
TotalRW 16,924,994 16,906,797 -0.11% -
EstimatedCycles 17,691,324 17,731,645 +0.23% EstimatedCycles should decrease; tolerance 10.00%
blob_reads 158 158 +0.00% blob_reads should decrease; tolerance 10.00%
✅ `qmdb::merkleize/v=current::ordered::fixed::mmb chunk=256 k=10000 ch=false s=true cc=true` (2/2 gates passed)
Field Value
Package commonware-storage
Benchmark target qmdb_gungraun
Variant qmdb::merkleize/v=current::ordered::fixed::mmb chunk=256 k=10000 ch=false s=true cc=true
Filter *::bench_merkleize::current_ordered_fixed_mmb_chunk_256
Baseline suite commonware-storage
Gates EstimatedCycles should decrease; tolerance 10.00%; blob_reads should decrease; tolerance 10.00%
Cargo flags --features test-traits
Metric Baseline Current Delta Gate
Ir 15,488,996 15,450,384 -0.25% -
L1hits 20,313,311 20,241,479 -0.35% -
LLhits 132,020 136,176 +3.15% -
RamHits 17,946 17,641 -1.70% -
TotalRW 20,463,277 20,395,296 -0.33% -
EstimatedCycles 21,601,521 21,539,794 -0.29% EstimatedCycles should decrease; tolerance 10.00%
blob_reads 235 235 +0.00% blob_reads should decrease; tolerance 10.00%

Baseline commit(s): f04a442f1c3c

@codecov

codecov Bot commented Aug 14, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 89.31624% with 50 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (atomic-blobs-production@6aafe39). Learn more about missing BASE report.

Files with missing lines Patch % Lines
runtime/src/storage/mod.rs 59.61% 21 Missing ⚠️
runtime/src/storage/faulty.rs 48.00% 12 Missing and 1 partial ⚠️
runtime/src/storage/iouring.rs 94.51% 6 Missing and 3 partials ⚠️
runtime/src/tokio/runtime.rs 83.33% 7 Missing ⚠️
@@                    Coverage Diff                     @@
##             atomic-blobs-production    #4502   +/-   ##
==========================================================
  Coverage                           ?   95.16%           
==========================================================
  Files                              ?      608           
  Lines                              ?   279063           
  Branches                           ?     6906           
==========================================================
  Hits                               ?   265562           
  Misses                             ?    11164           
  Partials                           ?     2337           
Files with missing lines Coverage Δ
runtime/src/deterministic.rs 97.12% <100.00%> (ø)
runtime/src/storage/audited.rs 95.02% <100.00%> (ø)
runtime/src/storage/metered.rs 100.00% <100.00%> (ø)
runtime/src/tokio/runtime.rs 87.05% <83.33%> (ø)
runtime/src/storage/iouring.rs 98.06% <94.51%> (ø)
runtime/src/storage/faulty.rs 95.46% <48.00%> (ø)
runtime/src/storage/mod.rs 96.33% <59.61%> (ø)

Continue to review full report in Codecov by Harness.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6aafe39...a103c43. Read the comment docs.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@patrick-ogrady patrick-ogrady added this to the v2026.9.0 milestone Aug 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant