Python implementaion not working

[ViktorvdValk]

Hi,
The python example given in the readme gives an error,
the script looks for configuration_phi,py in the microsoft/phi-2 repo, but that doesn't exist in the latest repo.
"OSError: microsoft/phi-2 does not appear to have a file named configuration_phi.py. Checkout 'https://huggingface.co/microsoft/phi-2/main' for available files."
I've tried several workarounds:

• in AutoConfig set trust_remote_code == False, -> model outputs garbage
• loading configuration_phi.py from earlier commit -> can't get this to work properly

Does anyone have suggestions or a working pull request?

Best,
Viktor

[BramVanroy]

You might need to update your transformers version to a recent one that supports phi-2. Can you try that?

[BramVanroy]

Just now read your message about garbage output. Will check that.

[ViktorvdValk]

Oke, everything is running but the response on the example in the readme is "!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!"

[BramVanroy]

Can't reproduce that. Works fine here. What hardware are you running on? Got a pip freeze?

[ViktorvdValk]

I tried everything in a clean environment again and without the model_kwargs specified in the example. The models seems to work!

[BramVanroy]

Glad to hear it!