https://huggingface.co/prithivMLmods/QwQ-4B-Instruct

#549
by jrruethe - opened

Queued!

mradermacher changed discussion status to closed

Not supported unfortunately:

ValueError: Can not map tensor 'model.layers.0.mlp.down_proj.weight.absmax'

That means that there is a tensor in the model that llama.cpp doesn't know how to handle.

Sign up or log in to comment