Skip to content

feat: add DeepSeek-V4 inference on Ascend with TP/EP/DP/CP parallel support#375

Open
Song-begin wants to merge 47 commits into
masterfrom
tongbowen/dpskv4_ascend
Open

feat: add DeepSeek-V4 inference on Ascend with TP/EP/DP/CP parallel support#375
Song-begin wants to merge 47 commits into
masterfrom
tongbowen/dpskv4_ascend

ep8 tpot_model_ms=25.5

ba91628
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar