Honour --group-size when replaying a trace, and read traces from GCS - #3389

Honour --group-size when replaying a trace, and read traces from GCS#3389

wenxindongwork merged 2 commits into

mainvllm-project/tpu-inference:mainfrom

wxd-agentic-group-sizevllm-project/tpu-inference:wxd-agentic-group-sizeCopy head branch name to clipboard