Edit Models filters

Model Tree

meta-llama/Llama-3.1-8B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

304

Full-text search

Active filters: meta-llama/Llama-3.1-8B-Instruct

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Dec 1, 2024 • 86.4k • 164

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 610 • 8

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 320k • 48

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 4.38k • 13

shenzhi-wang/Llama3.1-8B-Chinese-Chat

Text Generation • Updated Jul 29, 2024 • 9.71k • 258

mradermacher/Meta-Llama-3.1-8B-Instruct-GGUF

Updated 27 days ago • 2.54k • 3

wonseokchoi1/ContY-v0.2-8B-gguf-q4_k_m

Updated Aug 2, 2024 • 3 • 1

arcee-ai/Llama-3.1-SuperNova-Lite-GGUF

Updated Oct 21, 2024 • 697 • 15

matrixportal/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 19, 2024 • 1 • 1

OzgurEnt/OZGURLUK-GPT-LinuxGeneral

Question Answering • Updated 26 days ago • 519 • 3

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym

Text Generation • Updated Dec 9, 2024 • 19 • 1

heydariAI/Dorna-2-GGUF

Text Generation • Updated about 1 month ago • 26 • 1

LLMLit/LLMLit

Updated about 12 hours ago • 11 • 1

QuantFactory/HuatuoGPT-o1-8B-GGUF

Text Generation • Updated 8 days ago • 507 • 3

YorkieOH10/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 23, 2024 • 49 • 9

DevQuasar/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Dec 4, 2024 • 14 • 1

leafspark/Meta-Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • Updated Jul 23, 2024 • 2

legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF

Text Generation • Updated Jul 27, 2024 • 455 • 5

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 27, 2024 • 43 • 1

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 2.59M • 14

Ren6767/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 23, 2024 • 3

mtsdurica/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 23, 2024 • 3

SanctumAI/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Sep 11, 2024 • 104k • 17

backyardai/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 24, 2024 • 96

HeRksTAn/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 23, 2024

xyottax/Meta-Llama-3.1-8B-Instruct-Q3_K_S-GGUF

Text Generation • Updated Jul 23, 2024 • 1

rumbleFTW/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 23, 2024 • 1 • 1

mlc-ai/Llama-3.1-8B-Instruct-q3f16_1-MLC

Updated Sep 19, 2024 • 205

mlc-ai/Llama-3.1-8B-Instruct-q0f16-MLC

Updated Sep 19, 2024

mlc-ai/Llama-3.1-8B-Instruct-q4f32_1-MLC

Updated Sep 19, 2024 • 1.96k • 2