Skip to content
Assign

Internal error for batch inference: Expected query, key, and value to have the same dtype, but got query.dtype: float key.dtype: float and value.dtype: c10::Half instead. #4680

Sign in to view logs

Internal error for batch inference: Expected query, key, and value to have the same dtype, but got query.dtype: float key.dtype: float and value.dtype: c10::Half instead.

Internal error for batch inference: Expected query, key, and value to have the same dtype, but got query.dtype: float key.dtype: float and value.dtype: c10::Half instead. #4680

Triggered via issue March 17, 2025 07:18
@qinxuyeqinxuye
commented on #3064 a656318
Status Success
Total duration 9s
Artifacts –

assign.yaml

on: issue_comment
issue_assign
0s
issue_assign
Fit to window
Zoom out
Zoom in