Skip to content

WordPress bench Lab runner cannot load WP Codebox runtime-core recipe builder #4188

@chubes4

Description

@chubes4

Summary

Homeboy Lab WordPress bench offloads are failing before workload execution because the WordPress extension cannot load a WP Codebox runtime-core module exporting buildWordPressBenchRecipe.

This blocks running newly merged WooCommerce checkout guardrail rigs against candidate branches.

Observed Failure

Command shape:

homeboy bench --rig woocommerce-performance \
  --path /Users/chubes/Developer/woocommerce@fix-checkout-create-order-idempotency/plugins/woocommerce \
  --scenario checkout-concurrent-create-order \
  --iterations 1 \
  --shared-state /tmp/woocommerce-old-fix-guardrails-concurrent \
  --setting-json 'bench_env={"WC_CONCURRENT_CHECKOUT_ITERATIONS":"1","WC_CONCURRENT_CHECKOUT_REQUESTS":"2"}' \
  --json-summary

The command offloads to homeboy-lab, prepares WooCommerce dependencies, then fails before the workload runs:

Error: WP Codebox recipe builder export buildWordPressBenchRecipe is unavailable.
Install/build a WP Codebox runtime-core module that exports buildWordPressBenchRecipe.
Pass --setting wp_codebox_core_module=/path/to/wp-codebox/packages/runtime-core/dist/index.js, or set HOMEBOY_WP_CODEBOX_CORE_MODULE to that built ESM entrypoint.
Fallback discovery also checks sibling wp-codebox checkouts for packages/runtime-core/dist/index.js.
This is separate from HOMEBOY_WP_CODEBOX_BIN / wp_codebox_bin, which only selects the wp-codebox CLI.
Homeboy Extensions no longer falls back to bundled WP Codebox recipe builders because that stale local copy can drift from the Codebox recipe contract.
Tried 1 candidate(s):
- @automattic/wp-codebox-core: Cannot find package '@automattic/wp-codebox-core' imported from /home/chubes/.config/homeboy/extensions/wordpress/scripts/bench/wp-codebox-recipe-builder-loader.mjs

Persisted Runs

  • Concurrent checkout guardrail run: ee7ba967-5983-4762-884a-69d74f0f37c4
  • Gateway compatibility guardrail run: cf57ff83-8238-4bb1-be02-f2e256aaa023

Inspect with:

homeboy runs show ee7ba967-5983-4762-884a-69d74f0f37c4
homeboy runs artifacts ee7ba967-5983-4762-884a-69d74f0f37c4
homeboy runs show cf57ff83-8238-4bb1-be02-f2e256aaa023
homeboy runs artifacts cf57ff83-8238-4bb1-be02-f2e256aaa023

Expected Behavior

The Lab runner should have an explicit, stable WP Codebox runtime-core recipe builder available to WordPress bench workloads, or Homeboy should fail preflight with an actionable setup/refresh path before creating a persisted bench failure.

Impact

This currently blocks verification for:

The guardrail code is installed and discoverable, but iterations remain 0 because the recipe builder fails before workload execution.

Acceptance Criteria

  • homeboy bench --rig woocommerce-performance --scenario checkout-concurrent-create-order ... reaches the WooCommerce workload on homeboy-lab.
  • homeboy bench --rig woocommerce-performance --scenario checkout-gateway-compatibility-matrix ... reaches the WooCommerce workload on homeboy-lab.
  • Missing or stale WP Codebox runtime-core setup is caught by homeboy rig check or an explicit extension setup/doctor command.
  • The fix does not restore the stale bundled recipe-builder fallback.

AI assistance

  • AI assistance: Yes
  • Tool(s): OpenCode (GPT-5.5)
  • Used for: Captured the failing commands, run IDs, and acceptance criteria from the blocked WooCommerce guardrail verification.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions