Skip to content

Commit bd0e221

Browse files
authored
Missing type parameter for vocab_size in SamplingParams (#211)
Add required type to vocab_size in sampling_params
1 parent 2ebbacf commit bd0e221

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

serve/mlc_serve/engine/sampling_params.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -73,7 +73,7 @@ class SamplingParams:
7373
# TODO(@team): This info comes from the model config.
7474
# Currently, it is unclear what is the best way to fetch this info and
7575
# check in `_verify_args` without this field. Follow-up when we have a better idea.
76-
vocab_size = 32000
76+
vocab_size: int = 32000
7777
json_schema: Optional[Dict[str, Any]] = None
7878
logits_processor: Optional[Any] = None
7979
mask_prompt: Optional[torch.Tensor] = None

0 commit comments

Comments
 (0)