Search results

Quantized QQQ models encountered configuration field exceptions and inference garbled text issues when deployed in vLLM 0.9.1.

Status: Open.

#39 In HandH1998/QQQ;

· ShiningMaker opened on Jul 11, 2025

QQQ OOM

Status: Open.

#38 In HandH1998/QQQ;

· LugerW-A opened on Jul 10, 2025

Is rotate_ov_proj necessary ？

Status: Open.

#37 In HandH1998/QQQ;

· jiajiyuan opened on Jun 18, 2025

关于reduce_buffer占用过多显存

Status: Open.

#34 In HandH1998/QQQ;

· 191220042 opened on Apr 9, 2025

请问支持MOE模型的量化吗，例如deepseek-v3

Status: Open.

#32 In HandH1998/QQQ;

· slchenchn opened on Mar 21, 2025

尝试量化了下DeepSeek-R1-Distill-Llama-70B 但是测下来效果很差 请问怎么调比较好

Status: Open.

#31 In HandH1998/QQQ;

· artetaout opened on Mar 7, 2025

gptq 里面的 QuantizedQwen2Model 量化的时候没有使用

Status: Open.

#28 In HandH1998/QQQ;

· wym42 opened on Feb 21, 2025

QwenVL的量化

Status: Open.

#26 In HandH1998/QQQ;

· wym42 opened on Feb 13, 2025

关于安装问题

Status: Open.

#25 In HandH1998/QQQ;

· qingkongby opened on Nov 14, 2024

Transformer 4.46.1 compat

Status: Open.

#24 In HandH1998/QQQ;

· Qubitium opened on Nov 4, 2024

关于qwen2-1.5b模型的问题

Status: Open.

#23 In HandH1998/QQQ;

· darrenearl opened on Oct 18, 2024

rotate + lm_head quantization

Status: Open.

#21 In HandH1998/QQQ;

· RanchiZhao opened on Oct 16, 2024