Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

4,288

Full-text search

Active filters: exl2

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated Dec 7, 2024 • 63

kisimoff/The-Trinity-Coder-7B_exl2_5bpw

Text Generation • Updated Apr 3, 2024 • 6 • 2

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 16 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 15 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 15 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 18 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 24 • 1

Slvcxc/L3-Super-Nova-RP-8B-8.0bpw-h8-exl2

Text Generation • Updated Jul 24, 2024 • 34 • 5

LoneStriker/Hermes-3-Llama-3.1-8B-3.0bpw-h6-exl2

Updated Aug 15, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 7 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-5.0bpw-h6-exl2

Updated Aug 15, 2024 • 6 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2

Updated Aug 15, 2024 • 9 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-8.0bpw-h8-exl2

Updated Aug 15, 2024 • 8 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.4bpw-h6-exl2

Updated Aug 15, 2024 • 11 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-3.5bpw-h6-exl2

Updated Aug 16, 2024 • 8 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2

Updated Aug 16, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.65bpw-h6-exl2

Updated Aug 16, 2024 • 4 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-5.0bpw-h6-exl2

Updated Aug 16, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-6.0bpw-h6-exl2

Updated Aug 16, 2024 • 1 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.25bpw-h6-exl2

Updated Aug 16, 2024 • 5 • 1

LoneStriker/Mistral-Small-Instruct-2409-4.0bpw-h6-exl2

Updated Sep 17, 2024 • 51 • 6

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-8.0bpw-h8-exl2

Updated Sep 26, 2024 • 8 • 2

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2

Updated Sep 26, 2024 • 112 • 18

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-4.0bpw-h6-exl2

Updated Sep 26, 2024 • 13 • 3

gghfez/zetasepic_Qwen2.5-72B-Instruct-abliterated-exl2-4.5bpw

Text Generation • Updated Oct 7, 2024 • 19 • 3

altomek/Llama-3.2-3B-Instruct-8bpw-EXL2

Text Generation • Updated Oct 8, 2024 • 31 • 1

waldie/UnslopSmall-22B-v1-4.65bpw-h6-exl2

Updated Oct 30, 2024 • 5 • 1

waldie/EVA-Qwen2.5-32B-v0.2-4bpw-h6-exl2

Text Generation • Updated Nov 8, 2024 • 55 • 2

wolfram/Athene-V2-Chat-4.65bpw-h6-exl2

Text Generation • Updated Nov 15, 2024 • 35 • 6

async0x42/Rombos-Coder-V2.5-Qwen-32b-exl2_4.0bpw

Text Generation • Updated Nov 16, 2024 • 23 • 1