huihui-ai/SmallThinker-3B-Preview-abliterated

This is an uncensored version of PowerInfer/SmallThinker-3B-Preview created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

Use with ollama

You can use huihui_ai/smallthinker-abliterated directly

ollama run huihui_ai/smallthinker-abliterated
Downloads last month
41
Safetensors
Model size
3.09B params
Tensor type
BF16
·
Inference API
Unable to determine this model's library. Check the docs .

Model tree for huihui-ai/SmallThinker-3B-Preview-abliterated

Base model

Qwen/Qwen2.5-3B
Finetuned
(3)
this model
Quantizations
3 models