Why are there multiple onnx files for this model?

#23
by emorris-hypertrain - opened

I see under Files and Versions that there are multiple ONNX files available. Is there any documentation about each of these and when one would choose one over the other?

Sentence Transformers org

Hello!

There are indeed multiple ONNX files, and even multiple OpenVINO ones. They are all explained in this page: https://sbert.net/docs/sentence_transformer/usage/efficiency.html
The bottom of this page has a benchmark figure indicating the expected performance with the different options.

  • Tom Aarsen

Sign up or log in to comment