Skip to content

Preserve sweep placeholder value types - #213

Open
fallintoplace wants to merge 1 commit into
NVIDIA:mainfrom
fallintoplace:fix/vllm-boolean-value-flags
Open

Preserve sweep placeholder value types#213
fallintoplace wants to merge 1 commit into
NVIDIA:mainfrom
fallintoplace:fix/vllm-boolean-value-flags

Conversation

@fallintoplace

Copy link
Copy Markdown

Summary

Preserve the original type when a sweep placeholder is the entire config value, instead of stringifying booleans and numbers. This lets vLLM boolean flags such as enable-expert-parallel: "{ep}" expand to real booleans, so True emits --enable-expert-parallel without an extra positional value and False omits the flag.

Fixes #186.

Tests

  • uv run pytest tests/test_sweep.py tests/test_configs.py::TestVLLMDataParallelMode::test_dp_mode_command_includes_dp_flags -q
  • uv run ruff check src/srtctl/core/sweep.py tests/test_sweep.py tests/test_configs.py
  • uv run pytest tests -q

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Cannot Sweep EP values for vLLM

1 participant