Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tensor 'blk.25.ffn_down.weight' has invalid ggml type 42 (NONE) #11975

Open
evaninf opened this issue Feb 20, 2025 · 0 comments
Open

tensor 'blk.25.ffn_down.weight' has invalid ggml type 42 (NONE) #11975

evaninf opened this issue Feb 20, 2025 · 0 comments

Comments

@evaninf
Copy link

evaninf commented Feb 20, 2025

Name and Version

version: 4726 (6dde178)
built with cc (GCC) 14.2.1 20250110 (Red Hat 14.2.1-7) for x86_64-redhat-linux

Operating systems

Linux

GGML backends

CPU

Hardware

AMD Ryzen 7 4800H with Radeon Graphics

Models

Llama3-8B-1.58-100B-tokens-GGUF
Falcon3-10B-Instruct-1.58bit-GGUF

Problem description & steps to reproduce

Trying to use any of the models results in the error.

First Bad Commit

No response

Relevant log output

build: 4726 (6dde1782) with cc (GCC) 14.2.1 20250110 (Red Hat 14.2.1-7) for x86_64-redhat-linux
main: llama backend init
main: load the model and apply lora adapter, if any
gguf_init_from_file_impl: tensor 'blk.25.ffn_down.weight' has invalid ggml type 42 (NONE)
gguf_init_from_file_impl: failed to read tensor info
llama_model_load: error loading model: llama_model_loader: failed to load model from /mnt/model/Llama3-8B-1.58-100B-tokens-q2b1.gguf

llama_model_load_from_file_impl: failed to load model
common_init_from_params: failed to load model '/mnt/model/Llama3-8B-1.58-100B-tokens-q2b1.gguf'
main: error: unable to load model
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant