Supported Models
Inference
The following LLMs have been tested and validated for inference on TPU v5e and v6e for text generation:
- π¦ LLaMA Family
- LLaMA-2 7B
- LLaMA-3 8B, 70B
- LlaMa3.1 8B, 70B
- LLaMA-3.2 1B, 3B (text only models)
- LlaMa-3.3 70B
- π Gemma Family
- Gemma 2B, 7B
- π¨ Mistral Family
- Mistral 7B
- Mixtral 8x7B
Fine-tuning
The following models have been tested and validated for fine-tuning on TPU v5e and v6e:
- π¦ LLaMA Family
- LLaMA-2 7B
- LLaMA-3 8B
- LLaMA-3.2 1B
- π Gemma Family
- Gemma 2B
- Gemma 7B