You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to understand how exactly the chat_template is used, especially with GGUF models. My understanding is that the template is tried to be read from the .gguf on first load and stored in the model3.json. This is also what is used later and where the changes you make in the GUI end up. This is how it works with the gpt4all models and the hugging face models. Can anyone confirm this?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I'm trying to understand how exactly the chat_template is used, especially with GGUF models. My understanding is that the template is tried to be read from the .gguf on first load and stored in the model3.json. This is also what is used later and where the changes you make in the GUI end up. This is how it works with the gpt4all models and the hugging face models. Can anyone confirm this?
Beta Was this translation helpful? Give feedback.
All reactions