Restore raw sweeps in workload-family regeneration #608

Closed
opened 2026-10-20 15:38:21 +02:00 by erikinkinen · 0 comments
Owner

Goal

Make the documented workload-family regeneration command produce its raw inputs from a clean output directory.

Reproduction

tools/regen-workload-family.sh accepts the AES binary and sweep configuration, but both calls to aes sweep are commented out. A valid baseline binary and a valid small matrix (all seven strategies, seeds 0/1, depth 2/3, fanout 2/3) fail immediately with exit 1 at cp: workload_family_run_a/experiment_runs.csv does not exist. Neither independent sweep is executed. The README advertises this command as run + validate + aggregate + plots.

Found while inspecting the P2-02 (#85) baseline archive requirements, at commit 7fe60aa840. The defect is inherited from the Phase 1 source baseline.

Steps

  • Restore both deterministic sweep executions before copying and validating the raw tables.
  • Run the complete command in a fresh output directory with the small matrix; require both 56-run inventories and repeatability validation.
  • Verify regenerated summary/figure inputs and unchanged simulator source; record the commands and results in the PR.

Acceptance

The documented command succeeds from clean output directories and produces two independently executed matching workload-family tables, the aggregate table and figures. A failed sweep still stops the command. This repair must not change strategy semantics, legacy metrics or their interpretation.

## Goal Make the documented workload-family regeneration command produce its raw inputs from a clean output directory. ## Reproduction `tools/regen-workload-family.sh` accepts the AES binary and sweep configuration, but both calls to `aes sweep` are commented out. A valid baseline binary and a valid small matrix (all seven strategies, seeds 0/1, depth 2/3, fanout 2/3) fail immediately with exit 1 at `cp`: `workload_family_run_a/experiment_runs.csv` does not exist. Neither independent sweep is executed. The README advertises this command as run + validate + aggregate + plots. Found while inspecting the P2-02 (#85) baseline archive requirements, at commit 7fe60aa84038153c9502efc7b3bc09eac58cfadd. The defect is inherited from the Phase 1 source baseline. ## Steps - [x] Restore both deterministic sweep executions before copying and validating the raw tables. - [x] Run the complete command in a fresh output directory with the small matrix; require both 56-run inventories and repeatability validation. - [x] Verify regenerated summary/figure inputs and unchanged simulator source; record the commands and results in the PR. ## Acceptance The documented command succeeds from clean output directories and produces two independently executed matching workload-family tables, the aggregate table and figures. A failed sweep still stops the command. This repair must not change strategy semantics, legacy metrics or their interpretation.
erikinkinen added this to the Phase 2 milestone 2026-10-20 15:38:21 +02:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
erikinkinen/AES#608
No description provided.