Skip to content

Commit 8afe228

Browse files
CUDA: mul_mat_q=true llama_context_params default (ggml-org#2912)
1 parent 71d6975 commit 8afe228

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

llama.cpp

+1-1
Original file line numberDiff line numberDiff line change
@@ -5287,7 +5287,7 @@ struct llama_context_params llama_context_default_params() {
52875287
/*.progress_callback =*/ nullptr,
52885288
/*.progress_callback_user_data =*/ nullptr,
52895289
/*.low_vram =*/ false,
5290-
/*.mul_mat_q =*/ false,
5290+
/*.mul_mat_q =*/ true,
52915291
/*.f16_kv =*/ true,
52925292
/*.logits_all =*/ false,
52935293
/*.vocab_only =*/ false,

0 commit comments

Comments
 (0)