Code

Bump the default max_num_seq to 2048#226

Code

Merged

sunggg merged 1 commit intooctoml:batch-servingoctoml/mlc-llm:batch-servingfrom yelite:default-max-num-seqyelite/mlc-llm:default-max-num-seqCopy head branch name to clipboardMar 7, 2024

Commits

Commits on Mar 7, 2024

• Bump the default max_num_seq to 2048

  yelite

  committed
  f1e1d25

  Copy full SHA for f1e1d25