Skip to content

Add a reference architecture for vllm auto tuning#447

Merged
gushob21 merged 4 commits into
mainfrom
gushob-vllm-tuner
Jun 3, 2026
Merged

Add a reference architecture for vllm auto tuning#447
gushob21 merged 4 commits into
mainfrom
gushob-vllm-tuner

Conversation

@gushob21
Copy link
Copy Markdown
Collaborator

No description provided.

gushob21 added 3 commits May 28, 2026 15:51
fixing  pipeline

Fixing permissions on scripts

adding terraform for vllm auto tuner

Adding a README.md for vLLM-auto-tune and renaming related files and directories

fixing pipelines

fixing linting issues

Refining  README instructions  reducing the auto tuner manifests to only h100 and g4

Making README changes and improving TF code

Adding reference architecture for vllm auto tuner for qwen32B model on
H100 and RTX Prod 6000
…n H100 and RTX Prod 6000

Merge branch 'main' into gushob-vllm-tuner
@gushob21 gushob21 marked this pull request as ready for review May 28, 2026 16:20
@alizaidis alizaidis self-requested a review June 2, 2026 22:29
Copy link
Copy Markdown
Collaborator

@alizaidis alizaidis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Copy Markdown
Collaborator

@laurentgrangeau laurentgrangeau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@gushob21 gushob21 merged commit 980a614 into main Jun 3, 2026
47 checks passed
@gushob21 gushob21 deleted the gushob-vllm-tuner branch June 3, 2026 14:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants