WIP: Freeze original exporter source selections once #659

Draft
erikinkinen wants to merge 8 commits from perf/immutable-source-export-selection into feature/production-source-bundle-publications
Owner

Summary and rationale

Freeze each exporter's validated source table once. Streaming an archive previously rebuilt the complete literal table at every parent check; nested fields are now read-only, and each boundary checks the original table identity.

Tracking and scope

Depends on #655. Updates shared preparation for source-only and complete production exporters, their genuine controls, and architecture/design documentation. Removes the unused mutable inventory cache. Wire formats and native owner interfaces are unchanged.

Architecture, authority and failure behavior

The existing recursive freezer copies the validated table into private read-only maps and tuples before preparation effects. Callers cannot mutate its backing data. The actual preparation receiver independently retains the original table registration. Replacing both current table views still records the original failure, including after restoration; foreign receivers receive no callbacks. Source-byte, namespace, work, clock and native-retirement checks remain active.

Validation evidence

Head a64d82dd73352d9377adf2559e7e8eccb3f7c4ce; code 35306b87ec2f6afeb6069d6a4354df51a3796b89.

  • Genuine production export/admission and source-only export/admission pass, including nested mutation and foreign replacement controls; caller and descendant cleanup confirmed.
  • A fresh 142-member archive profile makes zero recursive catalog snapshot calls, compared with 1,191,680 in the baseline. Both perform 2,533 path-verification calls. These are separate fresh Git fixtures, not identical archive bytes or a full-workload benchmark.
  • Eighteen source/codec controls, recursive syntax and the syntax oracle pass. All 195 Markdown files pass. Complete 407-module declaration checked twice; native owners and bootstrap unchanged.
  • Complete CI and the full source/native/guest workload remain pending. No Rust source, public ABI or VM scenario changes.

Review checklist

  • Original implementation and dependency policy retained
  • Signed commits, inline invariants and source-size policy checked
  • Architecture, roadmap and source-catalog documentation updated
  • Focused failure and performance evidence qualified to actual sources
  • Complete current CI acceptance
## Summary and rationale Freeze each exporter's validated source table once. Streaming an archive previously rebuilt the complete literal table at every parent check; nested fields are now read-only, and each boundary checks the original table identity. ## Tracking and scope Depends on #655. Updates shared preparation for source-only and complete production exporters, their genuine controls, and architecture/design documentation. Removes the unused mutable inventory cache. Wire formats and native owner interfaces are unchanged. ## Architecture, authority and failure behavior The existing recursive freezer copies the validated table into private read-only maps and tuples before preparation effects. Callers cannot mutate its backing data. The actual preparation receiver independently retains the original table registration. Replacing both current table views still records the original failure, including after restoration; foreign receivers receive no callbacks. Source-byte, namespace, work, clock and native-retirement checks remain active. ## Validation evidence Head `a64d82dd73352d9377adf2559e7e8eccb3f7c4ce`; code `35306b87ec2f6afeb6069d6a4354df51a3796b89`. - Genuine production export/admission and source-only export/admission pass, including nested mutation and foreign replacement controls; caller and descendant cleanup confirmed. - A fresh 142-member archive profile makes zero recursive catalog snapshot calls, compared with 1,191,680 in the baseline. Both perform 2,533 path-verification calls. These are separate fresh Git fixtures, not identical archive bytes or a full-workload benchmark. - Eighteen source/codec controls, recursive syntax and the syntax oracle pass. All 195 Markdown files pass. Complete 407-module declaration checked twice; native owners and bootstrap unchanged. - Complete CI and the full source/native/guest workload remain pending. No Rust source, public ABI or VM scenario changes. ## Review checklist - [x] Original implementation and dependency policy retained - [x] Signed commits, inline invariants and source-size policy checked - [x] Architecture, roadmap and source-catalog documentation updated - [x] Focused failure and performance evidence qualified to actual sources - [ ] Complete current CI acceptance
erikinkinen added this to the Alpha 1 milestone 2026-11-10 07:14:56 +01:00
Retain an independently copied read-only source table instead of rebuilding the complete literal snapshot at every operation boundary. Reject nested mutation at the write and preserve original table identity, sticky replacement failures, source-byte checks and native retirement; remove the unused mutable inventory cache.
Record the complete helper graph containing the independently frozen exporter source table and its original receiver checks.
build: Bind original source selection declaration
Some checks failed
Markdown / markdown (push) Successful in 26s
CI / rust (push) Failing after 1m35s
CI / native_sources (push) Has been skipped
CI / host_one (push) Has been skipped
CI / host_three (push) Has been skipped
CI / host_two (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / integration (push) Has been skipped
Coreutils provider graph / coreutils (push) Failing after 2m8s
CI / cargo_publications (push) Successful in 4m3s
4a2c620847
Bind all three input runners to the complete immutable source-selection helper declaration and code revision.
Bind the independently frozen source table to the actual preparation birth as well as the exporter. Refuse replacement of both current table views before source callbacks, and keep the original refusal sticky after restoration.
Record the complete helper graph with the preparation receiver retaining the original immutable source-table reference.
build: Bind original source selection registration
Some checks failed
Markdown / markdown (push) Successful in 35s
CI / cargo_publications (pull_request) Has been skipped
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / rust (push) Failing after 1m39s
CI / native_sources (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / host_one (push) Has been skipped
CI / host_two (push) Has been skipped
CI / host_three (push) Has been skipped
CI / integration (push) Has been skipped
CI / cargo_publications (push) Successful in 4m1s
Coreutils provider graph / coreutils (push) Successful in 5m35s
a64d82dd73
Bind all three input runners to the complete helper declaration that independently retains the source selection.
merge: Qualify immutable source fixture interpreter selections
Some checks failed
CI / cargo_publications (pull_request) Has been skipped
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
Markdown / markdown (push) Successful in 24s
Coreutils provider graph / coreutils (push) Failing after 2m56s
CI / cargo_publications (push) Successful in 6m27s
CI / rust (push) Failing after 8m5s
CI / native_sources (push) Has been skipped
CI / host_three (push) Has been skipped
CI / host_one (push) Has been skipped
CI / host_two (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / integration (push) Has been skipped
078b05b47b
Compose the prepared source and archive fixture correction without mutating the frozen immutable-selection author or its production helper cohort.
fix: Order native fixture retirement after observed cleanup
Some checks failed
CI / cargo_publications (pull_request) Has been skipped
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
Markdown / markdown (push) Successful in 27s
Coreutils provider graph / coreutils (push) Failing after 2m23s
CI / cargo_publications (push) Successful in 6m19s
CI / rust (push) Successful in 15m18s
CI / native_sources (push) Failing after 1m53s
CI / host_three (push) Has been skipped
CI / host_two (push) Has been skipped
CI / host_one (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / integration (push) Has been skipped
8066c2815d
Replace the unsynchronized negative sleep with a marker emitted only after the copied runner selects its actual missing-result cleanup branch. Retain the same owner through original finish, preserve raw errors, delay only the first positive probe, and keep all original production clocks and assertions unchanged.

(cherry picked from commit bffeb91b4a)
Some checks failed
CI / cargo_publications (pull_request) Has been skipped
CI / rust (pull_request) Has been skipped
CI / native_sources (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
Markdown / markdown (push) Successful in 27s
Coreutils provider graph / coreutils (push) Failing after 2m23s
CI / cargo_publications (push) Successful in 6m19s
CI / rust (push) Successful in 15m18s
CI / native_sources (push) Failing after 1m53s
CI / host_three (push) Has been skipped
CI / host_two (push) Has been skipped
CI / host_one (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / integration (push) Has been skipped
This pull request is marked as a work in progress.
This branch is out-of-date with the base branch
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin 'perf/immutable-source-export-selection:perf/immutable-source-export-selection'
git switch 'perf/immutable-source-export-selection'

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch 'feature/production-source-bundle-publications'
git merge --no-ff 'perf/immutable-source-export-selection'
git switch 'perf/immutable-source-export-selection'
git rebase 'feature/production-source-bundle-publications'
git switch 'feature/production-source-bundle-publications'
git merge --ff-only 'perf/immutable-source-export-selection'
git switch 'perf/immutable-source-export-selection'
git rebase 'feature/production-source-bundle-publications'
git switch 'feature/production-source-bundle-publications'
git merge --no-ff 'perf/immutable-source-export-selection'
git switch 'feature/production-source-bundle-publications'
git merge --squash 'perf/immutable-source-export-selection'
git switch 'feature/production-source-bundle-publications'
git merge --ff-only 'perf/immutable-source-export-selection'
git switch 'feature/production-source-bundle-publications'
git merge 'perf/immutable-source-export-selection'
git push origin 'feature/production-source-bundle-publications'
Sign in to join this conversation.
No description provided.