New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Intial add of DeepSeek-V3 model #830

Draft

kwen2501 wants to merge 5 commits into main from deepseek

Contributor

kwen2501 commented Feb 11, 2025 •

edited

Loading

Adopted model code from https://huggingface.co/deepseek-ai/DeepSeek-V3-Base/blob/main/modeling_deepseek.py
Minimized dependency on huggingface/transformers.
Simplified forward function signature.

$ python model.py 
torch.Size([2, 128, 7168])

kwen2501 added 3 commits

February 10, 2025 15:10


          Initial add of DeepSeek-v3 model

b876fe4


          Lint

0cb4475


          Minimize HF transformer dependency

1a9aba6

facebook-github-bot added the CLA Signed label

kwen2501 added 2 commits

February 10, 2025 17:01


          Remove unrelated forward arguments

c185b0d


          Lint

86934e6

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels