Mixtral 7B yaml file with mcore distributed optim#328

Draft

gdengk wants to merge 1 commit intoNVIDIA:mainfrom gdengk:gaod/moe/mixtral-7B-distribtuedOptimExample

+6-4

Commits on May 17, 2024

Revert "remove mcore-dist-opt (for now) (NVIDIA#323 )"
gdengk
committed