Qwen3-Next系列模型是不是从架构上支持不了packing

[Arcmoon-Hu]

Checklist / 检查清单

• I have searched existing issues, and this is a new question or discussion topic. / 我已经搜索过现有的 issues，确认这是一个新的问题与讨论。

Question Description / 问题描述

我看目前还是说有packing的时候，qwen3-next训练，sequence之间能看到，这个是不是因为线性注意力的问题，从架构上就优化不了

[Jintao-Huang]

是的

[Arcmoon-Hu]

是的

那有什么好的建议能加快训练速度吗，group_by_length这个参数加速明显吗，目前不用packing，训练的太慢了

[github-actions]

This issue has been inactive for over 3 months and will be automatically closed in 7 days. If this issue is still relevant, please reply to this message.

[github-actions]

This issue has been automatically closed due to inactivity. If needed, it can be reopened.

[Jintao-Huang]

modelscope/mcore-bridge#76