WIP: Produce retained native runtime links #530

Draft
erikinkinen wants to merge 28 commits from feature/retained-native-runtime-links into feature/native-boot-linked-artifact-owners
Owner

Materialize the complete selected object topology and link final native ELF outputs and runtime registries under their defining owners.

  • Implement the retained producer and its ownership checks.
  • Complete matching-source native and current-head CI acceptance.

Depends on #528. Also depends on #529.

Materialize the complete selected object topology and link final native ELF outputs and runtime registries under their defining owners. - [x] Implement the retained producer and its ownership checks. - [ ] Complete matching-source native and current-head CI acceptance. Depends on [#528](https://git.erikinkinen.fi/erix/integration/pulls/528). Also depends on [#529](https://git.erikinkinen.fi/erix/integration/pulls/529).
erikinkinen added this to the Alpha 1 milestone 2026-11-07 18:58:23 +01:00
ci: include object symbol sources in syntax checks
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
CI / markdown (push) Successful in 9s
Coreutils provider graph / coreutils (push) Successful in 3m5s
CI / rust (push) Successful in 4m35s
CI / host_one (push) Successful in 10m7s
CI / host_two (push) Successful in 13m56s
CI / host_zero (push) Successful in 15m19s
CI / host_three (push) Failing after 18m40s
CI / integration (push) Has been skipped
07fbe41d3a
Enroll the object-symbol reader and its differential controls in the shared host syntax command list and its independent ordered fixture.
Retain both the C runtime producer commands and independently published object-symbol checks in the ordered host syntax fixture. Preserve every prior private graph command and the public command addition.
feat: preserve explicit compiler library variants
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
CI / markdown (push) Successful in 11s
Coreutils provider graph / coreutils (push) Successful in 3m7s
CI / rust (push) Successful in 4m46s
CI / host_one (push) Successful in 11m48s
CI / host_two (push) Successful in 15m49s
CI / host_three (push) Successful in 17m50s
CI / host_zero (push) Successful in 19m58s
CI / integration (push) Failing after 3m7s
9872982b6f
Carry full compiler-unit variants through registry validation, dependency anchors, image naming and placement while preserving package metadata and legacy spellings. Share compiler alias helpers with the Kernel builder and refuse standalone source reconstruction of a requested variant.
Normally join the reviewed variant-name/registry/image consumers while retaining the private actual source/compiler/link ownership graph and distinct Kernel public-memory producer. Preserve all additive documentation and complete syntax argv vectors, including existing private graph controls.

The public-memory validator addition is disjoint from registry naming changes. Data naming does not establish source or native authority; final native linking and image closure remain active work.
refactor: inspect native artifacts through retained bytes
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
CI / markdown (push) Successful in 12s
Coreutils provider graph / coreutils (push) Successful in 3m30s
CI / rust (push) Successful in 5m14s
CI / host_two (push) Successful in 11m42s
CI / host_three (push) Successful in 14m36s
CI / host_zero (push) Successful in 16m41s
CI / host_one (push) Successful in 17m18s
CI / integration (push) Failing after 2m26s
707c7e7dab
Use the same caller-read bytes for ELF metadata, symbols and relocation checks instead of reopening diagnostic paths. Decode undefined object references alongside definitions, including weak references and empty objects, without a native query per codegen unit.
Add a finite fixed assembler/linker entry under the existing outer native forest and inherited bounded captures. Validate all readonly/scratch/output topology before effects and preserve the same actual file and parent descriptors through generated metadata symbol restoration.

Factor the unchanged pure symbol encoding/restoration helper for the native entry and existing service consumer. Seven framing/overlap/backend negatives pass; this private checkpoint does not admit a source/compiler owner or complete final artifacts. Actual graph-owned producer wiring remains in progress.
Normally join the independent byte-only artifact and undefined-symbol decoders. Keep the existing pure symbol restoration factoring while preserving the new data-based inspector call sites and complete additive source controls.

These decoders describe actual retained bytes only; source/compiler/native ownership stays with the graph producer. No final native artifact or image acceptance is implied by this composition.
Retain the actual registered target archive owner before compiler effects and include its comparison identity in unit compatibility. Final linking requires that same original binding; unbound compiler controls cannot be upgraded by a late query or digest. Keep relevant runtime file, source and helper checks without repeatedly consuming unrelated Cargo profiles and tools.
Construct the closed final native phase from actual compiler, pre-codegen runtime and Cstd owners. Materialize all CGUs and exact selected dependency metadata, retain compiler-bound variants, and inspect every native ELF, metadata record, dependency edge and original output descriptor before product use.

Keep the original finite forest/capture/effect path and central phase lifecycle table. Add source-level admission and file occupation controls. This private implementation checkpoint still requires normal composition of the runtime binding API and real Timed/Kernel native controls; it does not claim completed whole-image acceptance.
Normally join the original compiler/runtime resource binding before final native linking. Preserve the new final-link phase and public Kernel-memory tables, plus all additive docs and complete independent syntax command vectors.

Final link admission requires each selected producing compiler stage to retain its actual pre-codegen runtime owner. Runtime digests remain comparison data only; the original source/compiler/native/file resources stay mandatory.
Keep actual source, compiler, runtime, Cstd and materialized input resources through the final graph-born native phase. Restrict the defining driver to complete disjoint input, scratch and output trees, preserve the original output descriptor during symbol restoration, and require the executable reachable closure before admitting results. Add the complete original-source control entry and enroll all defining bodies in the independent syntax vector. Actual final native execution and the companion export-visibility gate remain pending.
fix: preserve dynamic symbol export visibility
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
CI / markdown (push) Successful in 4s
Coreutils provider graph / coreutils (push) Successful in 1m51s
CI / rust (push) Successful in 2m37s
CI / host_two (push) Successful in 8m26s
CI / host_three (push) Successful in 9m14s
CI / host_zero (push) Successful in 11m7s
CI / host_one (push) Successful in 12m22s
CI / integration (push) Failing after 3m12s
ae57d921ec
Retain raw ELF symbol visibility and distinguish externally visible GLOBAL and WEAK definitions from local, hidden and internal symbols. Expose the same classification in artifact reports so final-link closure checks cannot treat every defined symbol as an external provider.
Normally join the retained-byte visibility inspection companion and preserve the full graph runtime binding and syntax cohorts. Cross-object strong-reference providers, DSO anchors and public Kernel memory exports now require actual export-eligible dynamic symbols, while own defined symbols remain available for local resolution. Exact reachable per-program closure continues to match the maintained native resolver scope.
Preserve the first failed integration attempt and strict source admission. Include the actual Cstd workspace main-branch declaration closure, including PosixABI and its providers, and use a distinct tiny dependency URL so the original Cstd source is never paired with an incompatible fixture replacement. Emit bounded inert original failure diagnostics before owner-preserving fail-stop cleanup and keep the first control error through independent fixture retirement.
Use the actual registered compiler observation and already-retained binary metadata duty for executable roots, whose native no-link metadata can legitimately be empty. Keep the dependency-library accessor unchanged and retain all actual CGUs separately. Regular data files may have zero extent; final ELF and metadata-role validation still occurs before any accepted native publication. Extend the genuine compiler fixture to verify the same binary metadata duty.
Preserve the original sixteen-GiB work limit and failed native-link evidence. Authenticate each runtime owner through the actual active RuntimeInputBorrow and its original compiler/phase/file registrations while the defining full source and byte pre/post checks remain live. Materialize inputs and check native boundaries with complete lexical resource intervals rather than recursively repeating all archive reads per selected unit. Add real original-source controls for same-owner access and copied or ended interval refusal; native effects remain excluded until interval retirement.
Preserve full original Cstd and Integration source verification and the failed sixteen-GiB evidence. Materialize only original file duties returned by the complete compatibility precheck while the actual native-excluded RuntimeInputBorrow remains active. Always attempt both compatibility and public-memory postchecks before the interval can finish, preserve the first error, and retain separate full native pre/post checks. Avoid recursively checking the entire source tree for each already-returned file.
Prepare the actual requested destination before effects and publish inspected native bytes through the same RuntimeLinkOperation before native-scope retirement. Retain the original renamed publication and independent reader descriptors, verify publication integrity on every completed use, bracket publication with complete source/input checks, and preserve source-read exclusions by actual publication record identity. Extend the original-source control with sticky selected-output mutation and descriptor-retirement checks plus bounded actual phase-counter diagnostics; diagnostics grant no source or native authority.
Preserve the measured sixteen-GiB failure and every original source, native evidence and runtime archive check. The defining compiler-source consumer now obtains command records exactly once from its actual registered observation while validating the same original runtime binding and sysroot constraints internally; callers cannot supply records or verification results. The registration interval retains complete pre/post checks and replaces a redundant immediately preceding observation pass. Existing standalone required/unbound binding semantics remain unchanged.
Keep the same original graph, source owner/context/tree, completion registration, container occupations, immutable target, pinned Rustc and consumed helper bodies before and after the readonly native query, including failure paths. Remove unrelated duplicate Cargo profile/lock observations from that fixed query; actual compiler consumers retain their complete checks. Replace the original-control hardcoded checkout/revision read with an authored maintained linker fixture committed into its actual local Git source.
Remove name-based local-definition substitution for undefined strong references; defined reference rows still resolve locally and cross-object references require real eligible exports in the complete admitted program scope. Preserve source bracketing while sharing one defining original observation check in the compiler getter. Keep the established sixteen-GiB control/default and its failures unchanged; expose a separately selected aggregate graph bound with actual per-scope limits in bounded diagnostics, leaving every source/native, retained and clock limit unchanged.
ci: Use shared development inputs for retained runtime links
Some checks failed
CI / rust (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / host_two (push) Has been cancelled
CI / host_three (push) Has been cancelled
CI / integration (push) Has been cancelled
Coreutils provider graph / coreutils (push) Has been cancelled
Markdown / markdown (push) Has been cancelled
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
8b91f2511a
Use the central provider profile with one recorded helper fetch per run. Preserve the existing Cargo gates and frozen original native controls, and keep Markdown concurrency separate so the workflows stay below the source size limit.
fix: Retire graph owners when consumer entry fails
Some checks failed
CI / rust (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / host_two (push) Has been cancelled
CI / host_three (push) Has been cancelled
CI / integration (push) Has been cancelled
Coreutils provider graph / coreutils (push) Has been cancelled
Markdown / markdown (push) Has been cancelled
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
0c0d5d7f22
Context managers do not call exit when entry raises. Close the same graph on a fresh entry-check failure and preserve the original refusal if retirement also fails, so partially held duties cannot escape through that path.
fix: Preserve graph failures through retirement
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / rust (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / host_two (push) Has been cancelled
CI / host_three (push) Has been cancelled
CI / integration (push) Has been cancelled
Coreutils provider graph / coreutils (push) Has been cancelled
Markdown / markdown (push) Has been cancelled
948f1a028e
Retire the original graph on construction, entry and consumer failures through one path. Keep the first cause when disposal independently fails, while still reporting cleanup errors after a successful consumer.
fix: Check actual unresolved Kernel symbols against dynamic exports
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / rust (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / host_two (push) Has been cancelled
CI / host_three (push) Has been cancelled
CI / integration (push) Has been cancelled
Markdown / markdown (push) Has been cancelled
Coreutils provider graph / coreutils (push) Has been cancelled
50e74ab37e
Inspect decoded nm output from the original Kernel link operation against
that operation's selected DSO exports. Reject binary observations and role
labels as symbol sets, and retain ELF visibility so hidden, internal and
local definitions cannot satisfy another object's unresolved references.
test: Initialize the non-profiled heap reservation fixture
Some checks failed
CI / rust (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / host_two (push) Has been cancelled
CI / host_three (push) Has been cancelled
CI / integration (push) Has been cancelled
Coreutils provider graph / coreutils (push) Has been cancelled
Markdown / markdown (push) Has been cancelled
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
e60373620b
Match Scope initialization before checking destination filesystem space.
The fixture selects no telemetry sink, so its initial reservation is zero;
the actual checkpoint still accounts for pending writes and destination space.
fix: Preserve the Kernel's actual allocation failure policy
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / rust (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / host_two (push) Has been cancelled
CI / host_three (push) Has been cancelled
CI / integration (push) Has been cancelled
Coreutils provider graph / coreutils (push) Has been cancelled
Markdown / markdown (push) Has been cancelled
037d9f0aa7
Bind Abort to the retained successful root compiler invocations and forward
observed allocation wrappers to the original custom handler or the uniquely
observed default in the selected held liballoc archive. Refuse unsupported
or ambiguous contracts instead of synthesizing a privileged halt handler.
fix: Refuse legacy custom Kernel allocation handlers
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
Markdown / markdown (push) Successful in 14s
Coreutils provider graph / coreutils (push) Successful in 4m42s
CI / rust (push) Successful in 7m34s
CI / host_zero (push) Failing after 21m34s
CI / host_one (push) Failing after 23m34s
CI / host_two (push) Failing after 22m17s
CI / host_three (push) Failing after 23m41s
CI / integration (push) Has been skipped
bc7484c793
Keep observed legacy and unsupported custom handler names in the refusal set.
An unrecognized custom allocation policy must not disappear during symbol
selection and silently select the liballoc default instead.
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / host_two (pull_request) Has been skipped
CI / host_three (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Coreutils provider graph / coreutils (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
Markdown / markdown (push) Successful in 14s
Coreutils provider graph / coreutils (push) Successful in 4m42s
CI / rust (push) Successful in 7m34s
CI / host_zero (push) Failing after 21m34s
CI / host_one (push) Failing after 23m34s
CI / host_two (push) Failing after 22m17s
CI / host_three (push) Failing after 23m41s
CI / integration (push) Has been skipped
This pull request has changes conflicting with the target branch.
  • scripts/check-python-host-syntax.sh
  • tests/fixtures/python-host-syntax-commands.json
View command line instructions

Manual merge helper

Use this merge commit message when completing the merge manually.

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin 'feature/retained-native-runtime-links:feature/retained-native-runtime-links'
git switch 'feature/retained-native-runtime-links'

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch 'feature/native-boot-linked-artifact-owners'
git merge --no-ff 'feature/retained-native-runtime-links'
git switch 'feature/retained-native-runtime-links'
git rebase 'feature/native-boot-linked-artifact-owners'
git switch 'feature/native-boot-linked-artifact-owners'
git merge --ff-only 'feature/retained-native-runtime-links'
git switch 'feature/retained-native-runtime-links'
git rebase 'feature/native-boot-linked-artifact-owners'
git switch 'feature/native-boot-linked-artifact-owners'
git merge --no-ff 'feature/retained-native-runtime-links'
git switch 'feature/native-boot-linked-artifact-owners'
git merge --squash 'feature/retained-native-runtime-links'
git switch 'feature/native-boot-linked-artifact-owners'
git merge --ff-only 'feature/retained-native-runtime-links'
git switch 'feature/native-boot-linked-artifact-owners'
git merge 'feature/retained-native-runtime-links'
git push origin 'feature/native-boot-linked-artifact-owners'
Sign in to join this conversation.
No description provided.