Reduce directory identity comparison overhead #415

Open
erikinkinen wants to merge 6 commits from feature/source-directory-identity-comparison into feature/owned-service-artifact-route
Owner

Profiling service builds found millions of directory identity comparisons. Compare the same device, inode, mode, user and group fields directly, without constructing a generator on every call.

The lazy order and single truth conversion are preserved. No stat observation, source check, signal mask or descriptor retirement is removed, and no identity is cached.

Depends on #412.

  • Preserve all identity fields, lazy order and mutation refusal.
  • Bind the exact changed helper in the complete native source selection.
  • Measure the focused comparison improvement.

The five-sample comparison benchmark improved about 6.4×. This is a primitive measurement; complete service build performance remains separate.

Profiling service builds found millions of directory identity comparisons. Compare the same device, inode, mode, user and group fields directly, without constructing a generator on every call. The lazy order and single truth conversion are preserved. No stat observation, source check, signal mask or descriptor retirement is removed, and no identity is cached. Depends on #412. - [x] Preserve all identity fields, lazy order and mutation refusal. - [x] Bind the exact changed helper in the complete native source selection. - [x] Measure the focused comparison improvement. The five-sample comparison benchmark improved about 6.4×. This is a primitive measurement; complete service build performance remains separate.
erikinkinen added this to the Alpha 1 milestone 2026-11-06 13:52:07 +01:00
Preserve the same five observations, lazy order and truth conversions while avoiding a generator for each comparison.
build: Bind the optimized directory source helper
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / markdown (push) Successful in 8s
CI / rust (push) Successful in 3m7s
CI / host_one (push) Failing after 10m49s
CI / host_zero (push) Failing after 14m50s
CI / integration (push) Has been skipped
f4c3f45910
Select the exact reviewed comparison body in the complete native source helper graph. Preserve every other helper and native process owner.
test: Isolate native feature forwarding from runtime intake
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / markdown (push) Successful in 15s
CI / rust (push) Failing after 58s
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / integration (push) Has been cancelled
33e506ca4f
Observe the runtime selection passed to the shared-object builder without
starting an unrelated native source acquisition in the CLI forwarding test.
ci: Use shared development dependency profiles
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / markdown (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
CI / rust (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / integration (push) Has been cancelled
CI / markdown (push) Has been cancelled
25878cd416
Keep authored manifests on main and select coordinated providers through Integration. Resolve branches once per run, retain the frozen snapshot and helper identity as artifacts, and use shared source checks instead of copied tests and guides.
ci: Separate Markdown checks from the build workflow
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
CI / rust (push) Has been cancelled
CI / host_zero (push) Has been cancelled
CI / host_one (push) Has been cancelled
CI / integration (push) Has been cancelled
Markdown / markdown (push) Has been cancelled
7761daed49
Keep each workflow below the repository size limit by giving Markdown its own file. Preserve event filters, job conditions and command bodies, with independent concurrency for the Markdown workflow.
ci: Use shared development dependency profiles
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
Markdown / markdown (push) Successful in 11s
CI / rust (push) Successful in 6m16s
CI / host_one (push) Failing after 6m19s
CI / host_zero (push) Failing after 22m56s
CI / integration (push) Has been skipped
d8eee54e94
Keep authored manifests on main and select coordinated providers through Integration. Resolve branches once per run, retain the frozen snapshot and helper identity as artifacts, and use shared source checks instead of copied tests and guides.
Some checks failed
CI / rust (pull_request) Has been skipped
CI / host_zero (pull_request) Has been skipped
CI / host_one (pull_request) Has been skipped
CI / integration (pull_request) Has been skipped
Markdown / markdown (pull_request) Has been skipped
Markdown / markdown (push) Successful in 11s
CI / rust (push) Successful in 6m16s
CI / host_one (push) Failing after 6m19s
CI / host_zero (push) Failing after 22m56s
CI / integration (push) Has been skipped
This pull request can be merged automatically.
This branch is out-of-date with the base branch
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin 'feature/source-directory-identity-comparison:feature/source-directory-identity-comparison'
git switch 'feature/source-directory-identity-comparison'

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch 'feature/owned-service-artifact-route'
git merge --no-ff 'feature/source-directory-identity-comparison'
git switch 'feature/source-directory-identity-comparison'
git rebase 'feature/owned-service-artifact-route'
git switch 'feature/owned-service-artifact-route'
git merge --ff-only 'feature/source-directory-identity-comparison'
git switch 'feature/source-directory-identity-comparison'
git rebase 'feature/owned-service-artifact-route'
git switch 'feature/owned-service-artifact-route'
git merge --no-ff 'feature/source-directory-identity-comparison'
git switch 'feature/owned-service-artifact-route'
git merge --squash 'feature/source-directory-identity-comparison'
git switch 'feature/owned-service-artifact-route'
git merge --ff-only 'feature/source-directory-identity-comparison'
git switch 'feature/owned-service-artifact-route'
git merge 'feature/source-directory-identity-comparison'
git push origin 'feature/owned-service-artifact-route'
Sign in to join this conversation.
No description provided.