Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

210

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

mkurman/llama-3.2-MEDIT-3B-o1

Text Generation • Updated 4 days ago • 599 • 9

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 18.4k • 43

mlx-community/Llama-3.2-3B-Instruct-4bit

Text Generation • Updated Sep 25, 2024 • 687k • 22

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8, 2024 • 51.1k • 104

mlc-ai/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated Sep 25, 2024 • 1.18k • 4

mlc-ai/Llama-3.2-3B-Instruct-q4f32_1-MLC

Updated Sep 25, 2024 • 1.05k • 2

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated Oct 16, 2024 • 16k • 3

QuantFactory/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-GGUF

Text Generation • Updated Oct 8, 2024 • 303 • 4

kinetical/llama3.2-3b-simulMT-et-en

Updated Nov 9, 2024 • 3

andmev/Llama-3.2-3B-Instruct-CoreML

Text Generation • Updated Nov 9, 2024 • 12 • 4

nvidia/Meta-Llama-3.2-3B-Instruct-ONNX-INT4

Updated Nov 15, 2024 • 5

lumii-api/llama-3-dove-2.0-mini-gguf

Text2Text Generation • Updated Dec 10, 2024 • 40 • 3

QuantFactory/Codepy-Deepthink-3B-GGUF

Text Generation • Updated 9 days ago • 620 • 2

onnx-community/Llama-3.2-3B-Instruct

Text Generation • Updated Oct 8, 2024 • 244 • 10

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 2.16k • 19

lmstudio-community/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 3 days ago • 5.06k • 30

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 1

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated Dec 10, 2024 • 189k • 14

paultimothymooney/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 5

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 2.25M • 8

mlc-ai/Llama-3.2-3B-Instruct-q0f16-MLC

Updated Sep 25, 2024 • 15

mlc-ai/Llama-3.2-3B-Instruct-q0f32-MLC

Updated Sep 25, 2024 • 1

bartowski/Llama-3.2-3B-Instruct-exl2

Text Generation • Updated Oct 8, 2024 • 69 • 5

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated Oct 9, 2024 • 1.46k • 2

jxtngx/Meta-Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 16

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 231 • 1

neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated Oct 16, 2024 • 6.29k • 1

mukel/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26, 2024 • 125

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 13 days ago • 1.37k • 2

gaianet/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 131 • 1