Lewdiculous
/

c4ai-command-r7b-12-2024-GGUF-IQ-ARM-Imatrix

Model card Files Files and versions Community

[experimental] My GGUF-IQ-ARM-Imatrix quants for CohereForAI/c4ai-command-r7b-12-2024.

Quants uploaded.

Downloads last month: 746

GGUF

Model size

8.03B params

Architecture

cohere2

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference API

Inference API (serverless) has been turned off for this model.

Model tree for Lewdiculous/c4ai-command-r7b-12-2024-GGUF-IQ-ARM-Imatrix

Base model

CohereForAI/c4ai-command-r7b-12-2024

Quantized

(10)

this model

Collection including Lewdiculous/c4ai-command-r7b-12-2024-GGUF-IQ-ARM-Imatrix

Quantized Models (GGUF, IQ, Imatrix)

Various quantizations of models in the GGUF format. Models with a "checkmark" are personal favorites. An "orange arrow" means it's being uploaded. • 93 items • Updated 7 days ago • 49