Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

253

Full-text search

Active filters: nvidia

blockblockblock/Llama3-ChatQA-1.5-8B-bpw3.7-exl2

Text Generation • Updated May 3, 2024 • 14

MoMonir/Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 3, 2024

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4-exl2

Text Generation • Updated May 3, 2024 • 14

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.2-exl2

Text Generation • Updated May 3, 2024 • 15

LoneStriker/Llama3-ChatQA-1.5-70B-2.4bpw-h6-exl2

Text Generation • Updated May 3, 2024 • 16

LoneStriker/Llama3-ChatQA-1.5-70B-3.5bpw-h6-exl2

Text Generation • Updated May 3, 2024 • 16

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.4-exl2

Text Generation • Updated May 3, 2024 • 15

LoneStriker/Llama3-ChatQA-1.5-70B-4.0bpw-h6-exl2

Text Generation • Updated May 3, 2024 • 15

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.6-exl2

Text Generation • Updated May 3, 2024 • 15

LoneStriker/Llama3-ChatQA-1.5-70B-4.65bpw-h6-exl2

Text Generation • Updated May 3, 2024 • 14

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.8-exl2

Text Generation • Updated May 3, 2024 • 14

LoneStriker/Llama3-ChatQA-1.5-70B-5.0bpw-h6-exl2

Text Generation • Updated May 3, 2024 • 17

blockblockblock/Llama3-ChatQA-1.5-8B-bpw5-exl2

Text Generation • Updated May 3, 2024 • 13

LoneStriker/Llama3-ChatQA-1.5-70B-6.0bpw-h6-exl2

Text Generation • Updated May 4, 2024 • 16

blockblockblock/Llama3-ChatQA-1.5-8B-bpw5.5-exl2

Text Generation • Updated May 3, 2024 • 14

blockblockblock/Llama3-ChatQA-1.5-8B-bpw6-exl2

Text Generation • Updated May 3, 2024 • 16

bartowski/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • Updated May 4, 2024 • 106 • 9

alexcovo/Llama3-ChatQA-1.5-8B-256K-Q4_K_M-GGUF

Text Generation • Updated May 4, 2024

lmstudio-community/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • Updated May 4, 2024 • 29 • 6

lmstudio-community/Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 4, 2024 • 119 • 6

QuantFactory/NVIDIA-Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 6, 2024 • 339 • 2

LiteLLMs/Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 28, 2024 • 2

ivanzou/fdsfsdf24e34e

Updated Jul 29, 2024

rollend/Llama3-ChatQA-1.5-8B-Q4_K_M-GGUF

Text Generation • Updated May 31, 2024

narainp/Llama3-ChatQA-1.5-8B-Q4_K_M-GGUF

Text Generation • Updated May 31, 2024 • 1

nvidia/Llama3-70B-SteerLM-RM

Updated Jun 19, 2024 • 12 • 42

lyonsn4/Llama3-ChatQA-1.5-8B-Q3_K_M-GGUF

Text Generation • Updated Jun 7, 2024

nvidia/Llama3-70B-PPO-Chat

Updated Jun 14, 2024 • 7

nvidia/mamba2-8b-3t-4k

Text Generation • Updated Jun 13, 2024 • 13

nvidia/mamba2-hybrid-8b-3t-128k

Text Generation • Updated Jun 13, 2024 • 42