chat format needs "\n" or not?
#20
by
grapevine-AI
- opened
Hello.
I'm exited to appearance of lightweight and smart LM.
By the way, Model card and Paper clearly show Phi-4's chat format contains newline character.
But, I seem that HF's model contains no "\n".
Which is correct? Please tell me.
We found out that \ndoesn't play a huge role for Phi-4, thus we opted to add lstrip and rstrip to all special tokens. If you use a \n after, let's say, <|im_end|>, it will get stripped.