WIP: Link original C memory support into native artifacts #322

Draft
erikinkinen wants to merge 26 commits from feature/native-c-memory-producer into feature/packaging-catalog-layout-controls
Owner

Native artifact builds still generate an Integration copy of C memory routines. Select the original C runtime source role and assembler producer instead, and link its public memory object into the kernel and hidden support into shared objects.

Use the existing original-object and literal-source owners through private Git metadata. Bind the complete helper code before execution, retain actual completing source objects through rechecks, and use the supplier's original native caller lifetime. Cache and artifact records remain descriptive; they cannot create source or process authority.

  • Replace the duplicate memory generator across current native producers and consumers.
  • Bind the C runtime source, tool, helper and output identities in cache and registry records.
  • Connect explicit native source/tool inputs to host CI and existing artifact fixtures.
  • Reject altered Git metadata, substituted helper code and changed tracked source; check actual memory instructions.
  • Complete whole-image and native EriX acceptance against the coordinated provider graph.

Depends on the C runtime command-owner supplier lib-cstd #76, its #77 followup and the catalog controls in #315. Later command-owner changes, including #318, require a coordinated supplier and adapter update before composing that newer source graph. Kernel bootstrap remains memory-only; process heap, initialized-thread and wider runtime support are separate changes.

Native artifact builds still generate an Integration copy of C memory routines. Select the original C runtime source role and assembler producer instead, and link its public memory object into the kernel and hidden support into shared objects. Use the existing original-object and literal-source owners through private Git metadata. Bind the complete helper code before execution, retain actual completing source objects through rechecks, and use the supplier's original native caller lifetime. Cache and artifact records remain descriptive; they cannot create source or process authority. - [x] Replace the duplicate memory generator across current native producers and consumers. - [x] Bind the C runtime source, tool, helper and output identities in cache and registry records. - [x] Connect explicit native source/tool inputs to host CI and existing artifact fixtures. - [x] Reject altered Git metadata, substituted helper code and changed tracked source; check actual memory instructions. - [ ] Complete whole-image and native EriX acceptance against the coordinated provider graph. Depends on the C runtime command-owner supplier [lib-cstd #76](https://git.erikinkinen.fi/erix/lib-cstd/pulls/76), its [#77](https://git.erikinkinen.fi/erix/lib-cstd/pulls/77) followup and the catalog controls in [#315](https://git.erikinkinen.fi/erix/integration/pulls/315). Later command-owner changes, including [#318](https://git.erikinkinen.fi/erix/integration/pulls/318), require a coordinated supplier and adapter update before composing that newer source graph. Kernel bootstrap remains memory-only; process heap, initialized-thread and wider runtime support are separate changes.
erikinkinen added this to the Alpha 1 milestone 2026-11-05 19:37:47 +01:00
Encode the exact version-seven 104-byte startup record and reserve three native route columns per realm client in both runtime and image admission. Keep ordinary intake independent of retained job, provider, realm and authority storage.

Size canonical plans for the current 144-byte header and 80-byte client records, preserving original process, descriptor, ring and timeout budgets. Select matching Bootstrap and Rootd providers and retain independent capacity-exhaustion controls.
build: Compose explicit standard readiness policy
Some checks failed
CI / markdown (push) Successful in 23s
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Failing after 3m27s
CI / host_one (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / integration (push) Has been skipped
d782ad7703
Preserve the independent standard service policy fix alongside current startup framing so explicit standard selection provides complete counted terminal and recipient storage.
Carry the selected complete packet budget through runtime policy, both image callers and deployment reports. Install Procd version-two typed arena geometry with a separate page-backed byte region while retaining the exact packet count and terminal stack extent. Reject malformed budgets, retired descriptors and positive storage without a packaged Procd owner.
Preserve the independent current startup framing and counted client policy alongside the original Procd TLS packet prerequisite before deriving full image storage.

# Conflicts:
#	ARCHITECTURE.md
#	README.md
#	ROADMAP.md
docs: Wrap the TLS packet layout description
Some checks failed
CI / markdown (push) Successful in 23s
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Successful in 5m51s
CI / host_one (push) Failing after 35m35s
CI / host_zero (push) Successful in 37m2s
CI / integration (push) Has been skipped
3edb3ce148
Keep each descriptor field readable beside its target word layout.
fix: Keep runtime heap profiles within native policy
Some checks failed
CI / markdown (push) Successful in 27s
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Successful in 5m48s
CI / host_one (push) Successful in 35m44s
CI / host_zero (push) Successful in 36m54s
CI / integration (push) Failing after 27m0s
0faeb8a9dc
Reserve the original 80 MiB topology minimum in the sample and reduced-topology fixture profiles. Keep the native storage gate unchanged and preserve the FAT-root and no-input fixtures as explicit topology refusals rather than hiding them behind an earlier heap failure.
Size loader, linker and native initial packet storage from each original packaged closure and its target-described layouts. Retain original and resolved registries, full thread images, native observations, input tails and fixups without borrowing live template storage.

Require explicit Loaderd stack policy across maintained profiles and preserve larger selected Procd packet reservations. Include every extracted producer in artifact identity and retain actual ELF mutation, layout refusal and independent numeric capacity controls.
Retain the independent heap policy repair and packet documentation correction alongside complete TLS storage so actual profiles reach their intended runtime admission or topology refusal.

# Conflicts:
#	scripts/check-python-host-syntax.sh
#	tests/fixtures/python-host-syntax-commands.json
Require complete aligned Dynlink target records and nonzero protocol widths before sizing storage. Reject page-rounded transaction arenas outside native slice addressability rather than allowing Python integers to describe an unusable native extent.

Admit original LOAD and RELRO u64 virtual extents before deriving closure metrics, including checked page rounding. Preserve empty TLS prefix semantics and reject malformed actual ELF inputs before image mutation.
fix: Keep capacity descriptors within loaded ELF bytes
Some checks failed
CI / markdown (push) Successful in 28s
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Successful in 5m47s
CI / host_one (push) Successful in 36m51s
CI / host_zero (push) Successful in 37m27s
CI / integration (push) Failing after 27m28s
e3c41ae663
Require every word of the selected native descriptor to belong to its original file-backed LOAD. An intact file tail cannot supply capacity geometry that the native runtime will not map.
Preserve the independently signed loader, linker and Procd packet producers before selecting genuine native factory delivery.
feat: Select genuine native factory intake witness
Some checks failed
CI / markdown (push) Successful in 23s
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Successful in 5m41s
CI / host_one (push) Successful in 34m56s
CI / host_zero (push) Successful in 36m41s
CI / integration (push) Failing after 25m24s
200f9fabf7
Carry the explicit factory selector through scenario normalization, initial-shell policy, feature selection and the existing native mediator and byte-client build queue. Reject conflicting diagnostics or missing caller launch before image construction.

Preserve the original realm, client, thread, packet, process and timeout budgets and every older client retirement witness. Require the genuine factory marker between completed byte-client checks and successful shell retirement without introducing another authority route.
fix: Register existing private realm client artifacts
Some checks failed
CI / markdown (push) Successful in 27s
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Successful in 5m36s
CI / host_one (push) Successful in 35m47s
CI / host_zero (push) Successful in 37m8s
CI / integration (push) Failing after 5m12s
eef1849622
Include the binding and pipe roots in the gated private-realm wave and record their exact manifest dependency declarations. Preserve the existing missing-target and static-exception boundaries; registration does not establish native execution.

Resolve the maintained pipe scenario group through the actual runner so a copied scenario identifier cannot substitute for its declared file path.
Preserve the independent migration, dependency and gated-wave records for existing native clients before adding the separately selected guarded thread target.
refactor: Inspect original ELF byte snapshots
Some checks failed
CI / markdown (push) Successful in 24s
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Failing after 2m39s
CI / host_one (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / integration (push) Has been skipped
749299face
Expose the existing ELF admission logic over one immutable selected body and retain the established path API as a one-read wrapper. Diagnostic names cannot cause a later filesystem read or replace the supplied input.

Keep parsed geometry descriptive: it grants no mapping authority and supplies no native process or VM observation.
Preserve the independently reviewed byte snapshot parser before inspecting original guarded-thread artifact geometry, with no diagnostic-path reopen.
Select the original dedicated client and linker through the existing factory scenario, with one exact private alias and its own gated dynamic target. Inspect the complete original ELF snapshot before the queued artifact can succeed.

Require distinct RX code, RW NX TLS and stacks, a guard outside every declared LOAD page, and an immutable unaliased geometry table. Keep the receipt descriptive and preserve every original factory, byte-client, process-exit and finite VM gate; callback return grants no departure, join or storage-reuse evidence.
fix: Publish thread receipts through literal file routes
Some checks failed
CI / markdown (push) Successful in 27s
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Successful in 3m52s
CI / host_zero (push) Successful in 7m57s
CI / host_one (push) Successful in 10m33s
CI / integration (push) Failing after 1m29s
f0e70bdd7a
Reject output symlinks and linked parent edges before creating an unpublished receipt. Hold the actual parent and private file occupations while writing the complete body, then atomically replace only the selected directory entry.

Preserve prior complete evidence on failed inspection, partial writes or failed publication. Cleanup addresses only the original temporary inode and retains the primary error; optional metadata remains descriptive and grants no native authority.
Preserve the genuine caller channel and verified forest retirement owner before adding native C companion production; descriptive process or source records cannot replace original command custody.

# Conflicts:
#	ARCHITECTURE.md
#	README.md
#	ROADMAP.md
Retain the canonical checked helper entry and its original defining native owner before selecting the C runtime supplier. Preserve the existing C-memory checkpoint and the separately reviewed caller-loss prerequisite as normal history.
Select the immutable C runtime source role and its actual assembler producer for kernel and shared-object compiler support. Retire the duplicate Integration memory generator while preserving allocator-only bootstrap stubs and exact object/archive identities.

Complete source selection through genuine private Git object and literal-file owners, bind the immutable helper cohort before execution, and use the selected supplier native caller lifetime. Keep source and cache records descriptive, with explicit tools and native fixture inputs throughout the host workflow.
Retain the independent packaging fixture repairs alongside the native C memory producer, so shared CI exercises real catalog lookup and the intentionally synthetic Exsh path coherently. Preserve the completed producer source checkpoint and existing prerequisite history.
refactor: Keep native memory helper code focused
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / markdown (push) Successful in 4s
CI / rust (push) Successful in 2m10s
CI / host_one (push) Successful in 9m14s
CI / host_zero (push) Successful in 11m18s
CI / integration (push) Failing after 1m37s
eb3c44d307
Remove unused import routes from the retained source helper and keep its selected companion identity aligned with the actual code. Normalize the extracted linker helper file boundary without changing native source or command semantics.
test: Reset every initial shell fixture selector
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / markdown (push) Successful in 9s
CI / rust (push) Successful in 5m44s
CI / host_one (push) Failing after 4m26s
CI / host_zero (push) Failing after 20m5s
CI / integration (push) Has been skipped
f4d30783f1
Clear independent realm, heap, thread and Boot selections between policy cases. Keep all existing positive combinations and exact negative diagnostics.

Refs: #361
ci: Use shared development dependency profiles
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / integration (push) Has been cancelled
CI / markdown (push) Has been cancelled
8dbe3e7e04
Keep authored manifests on main and select coordinated providers through Integration. Resolve branches once per run, retain the frozen snapshot and helper identity as artifacts, and use shared source checks instead of copied tests and guides.
ci: Use shared development dependency profiles
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Failing after 45s
CI / markdown (push) Successful in 14s
CI / host_zero (push) Has been skipped
CI / host_one (push) Has been skipped
CI / integration (push) Has been skipped
b7967e7eb0
Keep authored manifests on main and select coordinated providers through Integration. Resolve branches once per run, retain the frozen snapshot and helper identity as artifacts, and use shared source checks instead of copied tests and guides.
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Failing after 45s
CI / markdown (push) Successful in 14s
CI / host_zero (push) Has been skipped
CI / host_one (push) Has been skipped
CI / integration (push) Has been skipped
This pull request is marked as a work in progress.
This branch is out-of-date with the base branch
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin 'feature/native-c-memory-producer:feature/native-c-memory-producer'
git switch 'feature/native-c-memory-producer'

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch 'feature/packaging-catalog-layout-controls'
git merge --no-ff 'feature/native-c-memory-producer'
git switch 'feature/native-c-memory-producer'
git rebase 'feature/packaging-catalog-layout-controls'
git switch 'feature/packaging-catalog-layout-controls'
git merge --ff-only 'feature/native-c-memory-producer'
git switch 'feature/native-c-memory-producer'
git rebase 'feature/packaging-catalog-layout-controls'
git switch 'feature/packaging-catalog-layout-controls'
git merge --no-ff 'feature/native-c-memory-producer'
git switch 'feature/packaging-catalog-layout-controls'
git merge --squash 'feature/native-c-memory-producer'
git switch 'feature/packaging-catalog-layout-controls'
git merge --ff-only 'feature/native-c-memory-producer'
git switch 'feature/packaging-catalog-layout-controls'
git merge 'feature/native-c-memory-producer'
git push origin 'feature/packaging-catalog-layout-controls'
Sign in to join this conversation.
No description provided.