Read back retained ext4 filesystem contents #579

Open
erikinkinen wants to merge 7 commits from feature/retained-ext4-image-readback into fix/source-descriptor-acquisition-custody
Owner

Compare a complete selected ext4 namespace through the original image descriptor, including inode metadata, file bytes, hardlinks, extent trees, allocation maps and the empty journal. Reads share the original finite input budget; failures remain sticky. No mount or filesystem utility is used.

The live population-tree adapter compares bounded ranges from the original registered source descriptors without caching every file body. Content descriptions grant no reads by themselves, and source retirement revokes borrowed reads before closing descriptors.

Builds on original descriptor custody and supplies readback for clean native image assembly. Readback alone does not establish source provenance or build acceptance.

  • Implement retained descriptor readback and document its authority boundary.
  • Cover expectation parsing, real formatter data and corruption refusal.
  • Exercise native hardlinks, symlinks and multi-group geometry.
  • Stream expectations from the live population tree with retained source custody.
  • Connect to the same-process clean image finalizer.
Compare a complete selected ext4 namespace through the original image descriptor, including inode metadata, file bytes, hardlinks, extent trees, allocation maps and the empty journal. Reads share the original finite input budget; failures remain sticky. No mount or filesystem utility is used. The live population-tree adapter compares bounded ranges from the original registered source descriptors without caching every file body. Content descriptions grant no reads by themselves, and source retirement revokes borrowed reads before closing descriptors. Builds on [original descriptor custody](https://git.erikinkinen.fi/erix/integration/pulls/580) and supplies readback for [clean native image assembly](https://git.erikinkinen.fi/erix/integration/pulls/574). Readback alone does not establish source provenance or build acceptance. - [x] Implement retained descriptor readback and document its authority boundary. - [x] Cover expectation parsing, real formatter data and corruption refusal. - [x] Exercise native hardlinks, symlinks and multi-group geometry. - [x] Stream expectations from the live population tree with retained source custody. - [x] Connect to the same-process clean image finalizer.
erikinkinen added this to the Alpha 1 milestone 2026-11-08 05:21:48 +01:00
feat: Read back retained ext4 filesystem contents
Some checks failed
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / rust (push) Has been cancelled
CI / native_sources (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / host_two (push) Has been cancelled
CI / host_three (push) Has been cancelled
CI / integration (push) Has been cancelled
Coreutils provider graph / coreutils (push) Has been cancelled
Markdown / markdown (push) Has been cancelled
c12472a83e
Compare the complete selected namespace, inode metadata, file contents and allocation census through the original image descriptor. Keep the existing finite input counter and sticky failures while avoiding mounts and filesystem utility authority.
fix: Preserve native ext4 link and timestamp semantics
Some checks failed
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / rust (push) Has been cancelled
CI / native_sources (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / host_two (push) Has been cancelled
CI / host_three (push) Has been cancelled
CI / integration (push) Has been cancelled
Coreutils provider graph / coreutils (push) Has been cancelled
Markdown / markdown (push) Has been cancelled
39dd01b81e
Allow explicit hardlink identities for every supported non-directory inode and check journal timestamps against the format epoch independently of root metadata. Keep a compact first-party native formatter fixture for complete descriptor readback and corruption controls across two block groups.
fix: Check initialized ext4 metadata and padding
Some checks failed
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / rust (push) Has been cancelled
CI / native_sources (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / host_two (push) Has been cancelled
CI / host_three (push) Has been cancelled
CI / integration (push) Has been cancelled
Coreutils provider graph / coreutils (push) Has been cancelled
Markdown / markdown (push) Has been cancelled
6207834c26
Require native inode fields, extent slots, directory records and final file blocks to contain only selected contents and initialized padding. Refuse unrepresentable symlink and device expectations before reading image bytes, and preserve the original refusal across repeated observations.
erikinkinen changed target branch from feature/clean-native-image-closure to fix/source-descriptor-acquisition-custody 2026-11-08 06:30:48 +01:00
fix: Retain original source descriptor acquisition and retirement custody
Some checks failed
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / host_three (push) Has been cancelled
CI / rust (push) Has been cancelled
CI / native_sources (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / host_two (push) Has been cancelled
CI / integration (push) Has been cancelled
Coreutils provider graph / coreutils (push) Has been cancelled
Markdown / markdown (push) Has been cancelled
65c322888e
A missing open result must not be treated as an empty receiver. Record actual capture and confirmed native negative outcomes separately from once-only close, preserve uncertain results and signal restoration, and refuse foreign record or opener substitution before effects.

Share that same capturer with typed filesystem inputs while retaining search-only directory rights. Non-owning descriptor views no longer acquire or close a second native handle; cleanup annotations preserve raw failures without exception-defined callbacks.
Register expected-content receivers on the original population owner and withdraw their reads before descriptor cleanup. An active or foreign borrow prevents positive source retirement instead of allowing the original descriptors to close underneath it.
Stack filesystem readback on the defining source capture repair so content borrows use its original descriptor and signal retirement evidence. Preserve both source-capture and readback checks in their original order.
feat: Stream filesystem expectations from retained sources
Some checks failed
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
Markdown / markdown (push) Failing after 13s
CI / rust (push) Failing after 2m12s
Coreutils provider graph / coreutils (push) Successful in 4m17s
CI / native_sources (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / host_one (push) Has been skipped
CI / host_two (push) Has been skipped
CI / host_three (push) Has been skipped
CI / integration (push) Has been skipped
016d5446f7
Derive complete inode metadata and hardlink identities from the live population tree. Compare bounded ranges from its original registered source descriptors under the same input counter instead of caching every file body. Keep content descriptions separate from read authority and withdraw each borrow before original source retirement.
erikinkinen changed title from WIP: Read back retained ext4 filesystem contents to Read back retained ext4 filesystem contents 2026-11-08 07:02:27 +01:00
Author
Owner

The clean-image finalizer in #574 now invokes streaming readback while the original population sources remain live.

The clean-image finalizer in #574 now invokes streaming readback while the original population sources remain live.
docs: Wrap feature documentation consistently
Some checks failed
Markdown / markdown (push) Has been cancelled
CI / rust (push) Failing after 1m44s
Coreutils provider graph / coreutils (push) Successful in 2m58s
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / native_sources (push) Has been skipped
CI / host_two (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / host_one (push) Has been skipped
CI / host_three (push) Has been skipped
CI / integration (push) Has been skipped
800a0816cd
Keep the existing feature documentation within the shared Markdown layout rules without changing its content.
Some checks failed
Markdown / markdown (push) Has been cancelled
CI / rust (push) Failing after 1m44s
Coreutils provider graph / coreutils (push) Successful in 2m58s
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / native_sources (push) Has been skipped
CI / host_two (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / host_one (push) Has been skipped
CI / host_three (push) Has been skipped
CI / integration (push) Has been skipped
This pull request can be merged automatically.
This branch is out-of-date with the base branch
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin 'feature/retained-ext4-image-readback:feature/retained-ext4-image-readback'
git switch 'feature/retained-ext4-image-readback'

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch 'fix/source-descriptor-acquisition-custody'
git merge --no-ff 'feature/retained-ext4-image-readback'
git switch 'feature/retained-ext4-image-readback'
git rebase 'fix/source-descriptor-acquisition-custody'
git switch 'fix/source-descriptor-acquisition-custody'
git merge --ff-only 'feature/retained-ext4-image-readback'
git switch 'feature/retained-ext4-image-readback'
git rebase 'fix/source-descriptor-acquisition-custody'
git switch 'fix/source-descriptor-acquisition-custody'
git merge --no-ff 'feature/retained-ext4-image-readback'
git switch 'fix/source-descriptor-acquisition-custody'
git merge --squash 'feature/retained-ext4-image-readback'
git switch 'fix/source-descriptor-acquisition-custody'
git merge --ff-only 'feature/retained-ext4-image-readback'
git switch 'fix/source-descriptor-acquisition-custody'
git merge 'feature/retained-ext4-image-readback'
git push origin 'fix/source-descriptor-acquisition-custody'
Sign in to join this conversation.
No description provided.