Faster fine-tuning using TRL & Unsloth
•
44
Daniel Han-Chen
danielhanchen
AI & ML interests
None yet
Recent Activity
new activity
about 12 hours ago
microsoft/phi-4:Suggested tokenizer changes by Unsloth.ai
posted
an
update
about 17 hours ago
We fixed many bugs in Phi-4 & uploaded fixed GGUF + 4-bit versions! ✨
Our fixed versions are even higher on the Open LLM Leaderboard than Microsoft's!
GGUFs: https://huggingface.co/unsloth/phi-4-GGUF
Dynamic 4-bit: https://huggingface.co/unsloth/phi-4-unsloth-bnb-4bit
You can also now finetune Phi-4 for free on Colab: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb
Read our blogpost for more details on bug fixes etc: https://unsloth.ai/blog/phi4
new activity
1 day ago
unsloth/DeepSeek-V3-GGUF:Getting error with Q3-K-M
Articles
Organizations
danielhanchen's activity
Suggested tokenizer changes by Unsloth.ai
1
#21 opened about 22 hours ago
by
gugarosa
posted
an
update
about 17 hours ago
Post
469
We fixed many bugs in Phi-4 & uploaded fixed GGUF + 4-bit versions! ✨
Our fixed versions are even higher on the Open LLM Leaderboard than Microsoft's!
GGUFs: unsloth/phi-4-GGUF
Dynamic 4-bit: unsloth/phi-4-unsloth-bnb-4bit
You can also now finetune Phi-4 for free on Colab: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb
Read our blogpost for more details on bug fixes etc: https://unsloth.ai/blog/phi4
Our fixed versions are even higher on the Open LLM Leaderboard than Microsoft's!
GGUFs: unsloth/phi-4-GGUF
Dynamic 4-bit: unsloth/phi-4-unsloth-bnb-4bit
You can also now finetune Phi-4 for free on Colab: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb
Read our blogpost for more details on bug fixes etc: https://unsloth.ai/blog/phi4
Getting error with Q3-K-M
5
#2 opened 3 days ago
by
alain401
Advice on running llama-server with Q2_K_L quant
1
#6 opened 2 days ago
by
vmajor
liked
2
models
2 days ago
upvoted
a
collection
2 days ago
llama.cpp cannot load Q6_K model
5
#3 opened 3 days ago
by
vmajor
liked
a
model
3 days ago
updated
a
model
3 days ago
liked
a
model
3 days ago
updated
3
models
3 days ago
updated
a
model
4 days ago
posted
an
update
4 days ago
Post
2972
Deepseek V3, including GGUF + bf16 versions are now uploaded!
Includes 2, 3, 4, 5, 6 and 8-bit quantized versions.
GGUFs: unsloth/DeepSeek-V3-GGUF
bf16: unsloth/DeepSeek-V3-bf16
Min. hardware requirements to run: 48GB RAM + 250GB of disk space for 2-bit.
See how to run them with examples and the full collection: unsloth/deepseek-v3-all-versions-677cf5cfd7df8b7815fc723c
Includes 2, 3, 4, 5, 6 and 8-bit quantized versions.
GGUFs: unsloth/DeepSeek-V3-GGUF
bf16: unsloth/DeepSeek-V3-bf16
Min. hardware requirements to run: 48GB RAM + 250GB of disk space for 2-bit.
See how to run them with examples and the full collection: unsloth/deepseek-v3-all-versions-677cf5cfd7df8b7815fc723c
liked
a
model
4 days ago
updated
3
models
4 days ago