WIP: Verify catalog helpers within retained namespace boundaries #693

Draft
erikinkinen wants to merge 21 commits from perf/catalog-helper-verification into feature/native-build-script-producers
Owner

Summary and rationale

Recheck catalog helpers in a fixed read-only batch under the original source Scope and retained parent. Every file still receives fresh byte/hash, OFD and named-edge checks, with complete namespace/ancestry checks around the batch and unchanged limits.

Tracking and scope

Refs #663; depends on #665 and #691. This covers helper verification and cleanup. Complete script, target and EFI execution remain open.

Architecture, authority and failure behavior

The actual graph source and original Scope/TreeAccess enrollment select the receivers. Descriptive rows supply no owners. Results stay provisional through the independent postcheck; source effects are refused inside the body. Partial captures remain with the original capturer, and first/secondary failures are retained.

Validation evidence

  • Eight isolated controls passed under the original 120/15 caller and 90/30 graph/source policy, including genuine source/query/helper reads, changed bytes, namespace changes, forbidden effects, partial opens, admission failure and lost-parent restoration. Each caller confirmed cleanup and forest retirement.
  • Complete 446-module source declaration checked twice; all Python sources parse. Original seven helper hashes and bootstrap are unchanged.
  • All 203 Markdown files pass. Full script/target performance and native/guest acceptance remain pending; no measured speedup is claimed.

Review checklist

  • Signed commits and documented original implementation
  • Authored files below 1,000 lines and contract links updated
  • Positive and failure/cleanup controls
  • Complete matching-source native and CI acceptance
## Summary and rationale Recheck catalog helpers in a fixed read-only batch under the original source Scope and retained parent. Every file still receives fresh byte/hash, OFD and named-edge checks, with complete namespace/ancestry checks around the batch and unchanged limits. ## Tracking and scope Refs #663; depends on #665 and #691. This covers helper verification and cleanup. Complete script, target and EFI execution remain open. ## Architecture, authority and failure behavior The actual graph source and original Scope/TreeAccess enrollment select the receivers. Descriptive rows supply no owners. Results stay provisional through the independent postcheck; source effects are refused inside the body. Partial captures remain with the original capturer, and first/secondary failures are retained. ## Validation evidence - Eight isolated controls passed under the original 120/15 caller and 90/30 graph/source policy, including genuine source/query/helper reads, changed bytes, namespace changes, forbidden effects, partial opens, admission failure and lost-parent restoration. Each caller confirmed cleanup and forest retirement. - Complete 446-module source declaration checked twice; all Python sources parse. Original seven helper hashes and bootstrap are unchanged. - All 203 Markdown files pass. Full script/target performance and native/guest acceptance remain pending; no measured speedup is claimed. ## Review checklist - [x] Signed commits and documented original implementation - [x] Authored files below 1,000 lines and contract links updated - [x] Positive and failure/cleanup controls - [ ] Complete matching-source native and CI acceptance
erikinkinen added this to the Alpha 1 milestone 2026-11-10 18:53:53 +01:00
Keep fresh original file reads, hashes, OFD and immediate edges while performing complete retained ancestry and namespace proofs around the fixed read-only batch. Preserve original source families, independent postchecks, accounting and capture cleanup.
Keep the selected original record index readonly and check the same held directory identity around every native file observation.
Derive the whole immutable source closure for the closed helper body.
Authenticate the complete source declaration before genuine helper controls.
Accept the defining OperationSources receiver through its original GeneratedCiCargo constructor registration, retaining exact pipeline, completion and graph counter bindings without casts or owners from DATA.
Renew every source row from the corrected defining owner registration.
Authenticate the complete actual source before the changed genuine control.
fix: Reject malformed runners before refreshing helper declarations
Some checks failed
Markdown / markdown (push) Successful in 27s
CI / cargo_publications (push) Failing after 1m9s
CI / native_sources (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / host_two (push) Has been cancelled
CI / host_three (push) Has been cancelled
CI / integration (push) Has been cancelled
CI / rust (push) Has been cancelled
Coreutils provider graph / coreutils (push) Has been cancelled
f70ac1ec69
Parse the defining input runner independently of the helper import closure so orphaned binding continuations cannot pass inventory checks or alter declarations.
test: Check generated runner syntax in integration CI
Some checks failed
Markdown / markdown (push) Successful in 32s
CI / cargo_publications (push) Failing after 1m6s
CI / cargo_publications (pull_request) Has been skipped
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
Coreutils provider graph / coreutils (push) Failing after 2m44s
CI / rust (push) Failing after 5m25s
CI / native_sources (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / host_one (push) Has been skipped
CI / host_two (push) Has been skipped
CI / host_three (push) Has been skipped
CI / integration (push) Has been skipped
02fac806ff
Run the malformed-runner regressions in CI and preserve their complete ordered host syntax command. Document why runner syntax is independent of the helper inventory.
Keep namespace postchecks independent of semantic first failure, reject replay before captures, validate original source tables before callbacks, and exercise real byte namespace effect and partial-capture failures.
Keep per-case original source and graph policy explicit without describing real source controls as pure configuration data.
Renew the complete original source graph after fixed postproof and cleanup controls.
Authenticate whole original source bytes before the finite real negative cases.
Initialize the once-only journal before birth, retain the actual close prefix before fallible admission, and exercise genuine preflight failure without a quota change or new capture.
Bind original Scope and TreeAccess enrollment independently of current selectors, refuse copied source senders and parent replacement before callbacks, and drain only the original helper parent at final source retirement.
Derive every module after fixing partial admission and receiver enrollment.
Authenticate complete actual source bytes before changed finite failure controls.
Keep the exact ordered syntax oracle and validate generated input-runner code before refreshing cohort declarations.
Renew the entire source declaration after normal syntax prerequisite composition.
Authenticate complete original source and valid runner syntax before publication.
docs: Link original catalog helper verification contract
Some checks failed
Markdown / markdown (push) Successful in 22s
CI / cargo_publications (push) Failing after 1m20s
CI / cargo_publications (pull_request) Has been skipped
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / rust (push) Failing after 4m38s
CI / native_sources (push) Has been skipped
CI / host_three (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / host_one (push) Has been skipped
CI / host_two (push) Has been skipped
CI / integration (push) Has been skipped
Coreutils provider graph / coreutils (push) Successful in 6m3s
7276df6bfa
Keep source namespace and read-only batch lifetime documentation discoverable beside the native recipe contracts.
Some checks failed
Markdown / markdown (push) Successful in 22s
CI / cargo_publications (push) Failing after 1m20s
CI / cargo_publications (pull_request) Has been skipped
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / rust (push) Failing after 4m38s
CI / native_sources (push) Has been skipped
CI / host_three (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / host_one (push) Has been skipped
CI / host_two (push) Has been skipped
CI / integration (push) Has been skipped
Coreutils provider graph / coreutils (push) Successful in 6m3s
This pull request is marked as a work in progress.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin 'perf/catalog-helper-verification:perf/catalog-helper-verification'
git switch 'perf/catalog-helper-verification'

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch 'feature/native-build-script-producers'
git merge --no-ff 'perf/catalog-helper-verification'
git switch 'perf/catalog-helper-verification'
git rebase 'feature/native-build-script-producers'
git switch 'feature/native-build-script-producers'
git merge --ff-only 'perf/catalog-helper-verification'
git switch 'perf/catalog-helper-verification'
git rebase 'feature/native-build-script-producers'
git switch 'feature/native-build-script-producers'
git merge --no-ff 'perf/catalog-helper-verification'
git switch 'feature/native-build-script-producers'
git merge --squash 'perf/catalog-helper-verification'
git switch 'feature/native-build-script-producers'
git merge --ff-only 'perf/catalog-helper-verification'
git switch 'feature/native-build-script-producers'
git merge 'perf/catalog-helper-verification'
git push origin 'feature/native-build-script-producers'
Sign in to join this conversation.
No description provided.