New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: deepseek_v1 gqa and correct normalization mode #2715

Open

akhoroshev wants to merge 2 commits into NVIDIA:main from akhoroshev:feature/deepseek_v1-gqa-and-normalize

Contributor

akhoroshev commented Jan 23, 2025 •

edited

Loading

For deepssek_v1 norm_topk_prob should be false.

https://huggingface.co/deepseek-ai/deepseek-moe-16b-base/blob/main/config.json

akhoroshev added 2 commits

January 23, 2025 15:52


          correct default normalization_mode

e709a5b


          support qga

59f9b75

Collaborator

nv-guomingz commented Jan 25, 2025

Hi @akhoroshev thanks for your contribution, we'll take a look on it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet