Is there any plan for Quantized model (GGUF or others )?

[yuhuihu]

Is there any plan for Quantized model (GGUF or others )?

As designed for lower hardware from the beginning, supporting for Quantized format will make the project more suitable for production environment.

[Mega4alik]

@yuhuihu thanks for the question.
Absolutely, giving options between quantized and non-quantized versions of a model is right decision I believe.