Edit Models filters

Inference status

Misc

arxiv: 2307.03172

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

15

Full-text search

Active filters: 2307.03172

lightonai/alfred-40b-1023

Text Generation • Updated Feb 13, 2024 • 1.16k • 46

togethercomputer/Llama-2-7B-32K-Instruct

Text Generation • Updated Mar 28, 2024 • 4.75k • 159

TheBloke/Llama-2-7B-32K-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 41 • 27

TheBloke/Llama-2-7B-32K-Instruct-GGML

Updated Sep 27, 2023 • 8 • 8

TheBloke/Llama-2-7B-32K-Instruct-GGUF

Updated Oct 24, 2023 • 560 • 55

TheBloke/Llama-2-7B-32K-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 28 • 2

KallebySantos/Llama-2-7B-32K-Instruct-GGUF

Updated Oct 26, 2023 • 1

TheBloke/alfred-40B-1023-GPTQ

Text Generation • Updated Nov 17, 2023 • 16 • 3

TheBloke/alfred-40B-1023-GGUF

Updated Nov 17, 2023 • 417 • 5

TheBloke/alfred-40B-1023-AWQ

Text Generation • Updated Nov 17, 2023 • 16 • 5

maddes8cht/lightonai-alfred-40b-1023-gguf

Updated Nov 22, 2023 • 63

Dongjin-kr/ko-reranker

Text Classification • Updated May 8, 2024 • 4.95k • 54

Shan1023/shansss

Text Classification • Updated Mar 5, 2024

QuantFactory/Llama-3-8B-ProLong-64k-Instruct-GGUF

Text Generation • Updated Aug 3, 2024 • 81 • 1

RichardErkhov/princeton-nlp_-_Llama-3-8B-ProLong-64k-Base-gguf

Updated Aug 14, 2024 • 40