Llama-3.x
Collection
Gaia compatible quants for Llama 3.1, 3.2 and 3.3 Instruct models.
•
4 items
•
Updated
Llama-3.3-70B-Instruct-GGUF
Original Model
meta-llama/Llama-3.3-70B-Instruct
Run with Gaianet
Prompt template:
prompt template: llama-3-chat
Context size:
chat_ctx_size: 128000
Run with GaiaNet:
Quick start: https://docs.gaianet.ai/node-guide/quick-start
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b4273
- Downloads last month
- 1,360
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for gaianet/Llama-3.3-70B-Instruct-GGUF
Base model
meta-llama/Llama-3.1-70B
Finetuned
meta-llama/Llama-3.3-70B-Instruct