We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 5061adf commit 375cfbeCopy full SHA for 375cfbe
examples/quantization_w4a4_fp4/qwen3_vl_moe_w4a4_fp4.py
@@ -64,9 +64,8 @@ def data_collator(batch):
64
65
# Configure the quantization algorithm and scheme.
66
# In this case, we:
67
-# * quantize the weights to fp8 with channel-wise quantization
68
-# * quantize the activations to fp8 with dynamic token activations
69
-# NOTE: only datafree quantization is supported for Qwen3-VL-MoE currently
+# * quantize the weights to fp4 with group-wise quantization
+# * quantize the activations to fp4 with dynamic group activations
70
recipe = QuantizationModifier(
71
targets="Linear",
72
scheme="NVFP4",
0 commit comments