You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Trying to use any of the models results in the error.
First Bad Commit
No response
Relevant log output
build: 4726 (6dde1782) with cc (GCC) 14.2.1 20250110 (Red Hat 14.2.1-7) for x86_64-redhat-linux
main: llama backend init
main: load the model and apply lora adapter, if any
gguf_init_from_file_impl: tensor 'blk.25.ffn_down.weight' has invalid ggml type 42 (NONE)
gguf_init_from_file_impl: failed to read tensor info
llama_model_load: error loading model: llama_model_loader: failed to load model from /mnt/model/Llama3-8B-1.58-100B-tokens-q2b1.gguf
llama_model_load_from_file_impl: failed to load model
common_init_from_params: failed to load model '/mnt/model/Llama3-8B-1.58-100B-tokens-q2b1.gguf'
main: error: unable to load model
The text was updated successfully, but these errors were encountered:
Name and Version
version: 4726 (6dde178)
built with cc (GCC) 14.2.1 20250110 (Red Hat 14.2.1-7) for x86_64-redhat-linux
Operating systems
Linux
GGML backends
CPU
Hardware
AMD Ryzen 7 4800H with Radeon Graphics
Models
Llama3-8B-1.58-100B-tokens-GGUF
Falcon3-10B-Instruct-1.58bit-GGUF
Problem description & steps to reproduce
Trying to use any of the models results in the error.
First Bad Commit
No response
Relevant log output
The text was updated successfully, but these errors were encountered: