Skip to content

Commit 63b22e0

Browse files
authored
[Model][Bugfix] fix ernie45 moe 300B SharedFusedMoE output tuple (#27316)
Signed-off-by: wangyafeng <[email protected]>
1 parent 5980604 commit 63b22e0

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

vllm/model_executor/models/ernie45_moe.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -215,6 +215,8 @@ def forward(self, hidden_states: torch.Tensor) -> torch.Tensor:
215215

216216
if self.has_shared_experts:
217217
final_hidden_states = final_hidden_states[0] + final_hidden_states[1]
218+
else:
219+
final_hidden_states = final_hidden_states[1]
218220

219221
if self.tp_size > 1:
220222
final_hidden_states = self.experts.maybe_all_reduce_tensor_model_parallel(

0 commit comments

Comments
 (0)