WIP: Derive complete loader TLS storage #300

Draft
erikinkinen wants to merge 10 commits from feature/loader-tls-storage-capacity into feature/procd-tls-packet-capacity
Owner

Derive loader, linker and initial native packet storage from each packaged executable closure. Account for both TLS registries, target metadata, complete thread images, native observations, input tails and fixups. Preserve larger explicitly selected Procd packet reservations and carry exact Loaderd stack policy through maintained runtime and image callers.

Target geometry, protocol widths, native integer extents and complete file-backed descriptor spans are checked before mutating the corresponding target image. Extracted producers participate in artifact identity. Runtime profile fixes preserve existing topology-negative fixtures and native storage gates.

  • Preserve complete closure, registry, image and native packet storage.
  • Require explicit stack policy across maintained profiles and real image callers.
  • Reject retired, malformed, unaddressable and partly unloaded target descriptors.
  • Retain source closure through the actual workflow prechecks and external evidence storage.
  • Compose the complete matching immutable native provider graph.
  • Execute matching-provider native materialization and lifetime controls.

The global component catalog is unchanged. Production images require Dynlinkd's version-two 38-word, Loaderd's version-three 28-word and Procd's version-two 12-word descriptors. Matching consumers include Dynlinkd #10, Loaderd #22 and Procd #40. The existing older graph cannot substitute. Hosted ELF checks do not establish native factory intake or either required guest rebuild.

Depends on #297, #296 and #298, retained by normal merges.

Derive loader, linker and initial native packet storage from each packaged executable closure. Account for both TLS registries, target metadata, complete thread images, native observations, input tails and fixups. Preserve larger explicitly selected Procd packet reservations and carry exact Loaderd stack policy through maintained runtime and image callers. Target geometry, protocol widths, native integer extents and complete file-backed descriptor spans are checked before mutating the corresponding target image. Extracted producers participate in artifact identity. Runtime profile fixes preserve existing topology-negative fixtures and native storage gates. - [x] Preserve complete closure, registry, image and native packet storage. - [x] Require explicit stack policy across maintained profiles and real image callers. - [x] Reject retired, malformed, unaddressable and partly unloaded target descriptors. - [x] Retain source closure through the actual workflow prechecks and external evidence storage. - [ ] Compose the complete matching immutable native provider graph. - [ ] Execute matching-provider native materialization and lifetime controls. The global component catalog is unchanged. Production images require Dynlinkd's version-two 38-word, Loaderd's version-three 28-word and Procd's version-two 12-word descriptors. Matching consumers include [Dynlinkd #10](https://git.erikinkinen.fi/erix/dynlinkd/pulls/10), [Loaderd #22](https://git.erikinkinen.fi/erix/loaderd/pulls/22) and [Procd #40](https://git.erikinkinen.fi/erix/procd/pulls/40). The existing older graph cannot substitute. Hosted ELF checks do not establish native factory intake or either required guest rebuild. Depends on [#297](https://git.erikinkinen.fi/erix/integration/pulls/297), [#296](https://git.erikinkinen.fi/erix/integration/pulls/296) and [#298](https://git.erikinkinen.fi/erix/integration/pulls/298), retained by normal merges.
erikinkinen added this to the Alpha 1 milestone 2026-11-05 15:34:24 +01:00
Encode the exact version-seven 104-byte startup record and reserve three native route columns per realm client in both runtime and image admission. Keep ordinary intake independent of retained job, provider, realm and authority storage.

Size canonical plans for the current 144-byte header and 80-byte client records, preserving original process, descriptor, ring and timeout budgets. Select matching Bootstrap and Rootd providers and retain independent capacity-exhaustion controls.
build: Compose explicit standard readiness policy
Some checks failed
CI / markdown (push) Successful in 23s
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Failing after 3m27s
CI / host_one (push) Has been skipped
CI / host_zero (push) Has been skipped
CI / integration (push) Has been skipped
d782ad7703
Preserve the independent standard service policy fix alongside current startup framing so explicit standard selection provides complete counted terminal and recipient storage.
Preserve the independent current startup framing and counted client policy alongside the original Procd TLS packet prerequisite before deriving full image storage.

# Conflicts:
#	ARCHITECTURE.md
#	README.md
#	ROADMAP.md
fix: Keep runtime heap profiles within native policy
Some checks failed
CI / markdown (push) Successful in 27s
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Successful in 5m48s
CI / host_one (push) Successful in 35m44s
CI / host_zero (push) Successful in 36m54s
CI / integration (push) Failing after 27m0s
0faeb8a9dc
Reserve the original 80 MiB topology minimum in the sample and reduced-topology fixture profiles. Keep the native storage gate unchanged and preserve the FAT-root and no-input fixtures as explicit topology refusals rather than hiding them behind an earlier heap failure.
Size loader, linker and native initial packet storage from each original packaged closure and its target-described layouts. Retain original and resolved registries, full thread images, native observations, input tails and fixups without borrowing live template storage.

Require explicit Loaderd stack policy across maintained profiles and preserve larger selected Procd packet reservations. Include every extracted producer in artifact identity and retain actual ELF mutation, layout refusal and independent numeric capacity controls.
Retain the independent heap policy repair and packet documentation correction alongside complete TLS storage so actual profiles reach their intended runtime admission or topology refusal.

# Conflicts:
#	scripts/check-python-host-syntax.sh
#	tests/fixtures/python-host-syntax-commands.json
Require complete aligned Dynlink target records and nonzero protocol widths before sizing storage. Reject page-rounded transaction arenas outside native slice addressability rather than allowing Python integers to describe an unusable native extent.

Admit original LOAD and RELRO u64 virtual extents before deriving closure metrics, including checked page rounding. Preserve empty TLS prefix semantics and reject malformed actual ELF inputs before image mutation.
fix: Keep capacity descriptors within loaded ELF bytes
Some checks failed
CI / markdown (push) Successful in 28s
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Successful in 5m47s
CI / host_one (push) Successful in 36m51s
CI / host_zero (push) Successful in 37m27s
CI / integration (push) Failing after 27m28s
e3c41ae663
Require every word of the selected native descriptor to belong to its original file-backed LOAD. An intact file tail cannot supply capacity geometry that the native runtime will not map.
ci: Use shared development dependency profiles
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / integration (push) Has been cancelled
CI / markdown (push) Has been cancelled
ad1765cb98
Keep authored manifests on main and select coordinated providers through Integration. Resolve branches once per run, retain the frozen snapshot and helper identity as artifacts, and use shared source checks instead of copied tests and guides.
ci: Use shared development dependency profiles
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / markdown (push) Successful in 13s
CI / rust (push) Successful in 6m7s
CI / host_one (push) Failing after 4m41s
CI / host_zero (push) Failing after 23m11s
CI / integration (push) Has been skipped
a6fc4264bc
Keep authored manifests on main and select coordinated providers through Integration. Resolve branches once per run, retain the frozen snapshot and helper identity as artifacts, and use shared source checks instead of copied tests and guides.
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / markdown (push) Successful in 13s
CI / rust (push) Successful in 6m7s
CI / host_one (push) Failing after 4m41s
CI / host_zero (push) Failing after 23m11s
CI / integration (push) Has been skipped
This pull request is marked as a work in progress.
This branch is out-of-date with the base branch
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin 'feature/loader-tls-storage-capacity:feature/loader-tls-storage-capacity'
git switch 'feature/loader-tls-storage-capacity'

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch 'feature/procd-tls-packet-capacity'
git merge --no-ff 'feature/loader-tls-storage-capacity'
git switch 'feature/loader-tls-storage-capacity'
git rebase 'feature/procd-tls-packet-capacity'
git switch 'feature/procd-tls-packet-capacity'
git merge --ff-only 'feature/loader-tls-storage-capacity'
git switch 'feature/loader-tls-storage-capacity'
git rebase 'feature/procd-tls-packet-capacity'
git switch 'feature/procd-tls-packet-capacity'
git merge --no-ff 'feature/loader-tls-storage-capacity'
git switch 'feature/procd-tls-packet-capacity'
git merge --squash 'feature/loader-tls-storage-capacity'
git switch 'feature/procd-tls-packet-capacity'
git merge --ff-only 'feature/loader-tls-storage-capacity'
git switch 'feature/procd-tls-packet-capacity'
git merge 'feature/loader-tls-storage-capacity'
git push origin 'feature/procd-tls-packet-capacity'
Sign in to join this conversation.
No description provided.