Skip to content

RuntimeError with OpenVINOExecutionProvider on Windows when using ORTModelForSeq2SeqLM #468

@prasad-pr-20

Description

@prasad-pr-20

Environment Info:

  • OS: Windows
  • Optimum==1.22.0
  • ONNX version==1.16.2
  • Python version: 3.9.19
  • ONNX Runtime version: 1.19.0
  • onnxrumtime-openvino==1.14.0
  • OpenVINO version: 2024.4.0

Issue Description
I'm encountering a runtime error when trying to use the ORTModelForSeq2SeqLM class provided by Optimum-ONNX with the OpenVINOExecutionProvider.
The issue arises when executing the following line of code: model_1 = ORTModelForSeq2SeqLM.from_pretrained("optimum/m2m100_418M", provider='OpenVINOExecutionProvider')
The error message is as follows:
RuntimeError: C:\Users\iei\Desktop\vishnu\wheel_build_after_doc_update\onnxruntime\onnxruntime\core\session\provider_bridge_ort.cc:1103 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 127 "" when trying to load "C:\Users\username\Downloads\path\path\open_vin\lib\site-packages\onnxruntime\capi\onnxruntime_providers_openvino.dll".

It's peculiar that the error message includes a different username in the file path, which does not match my machine's username.

Steps to Reproduce

  • Enabled the OpenVINO environment using setvars.bat.
  • Installed necessary packages with the following command: pip install onnx onnxruntime onnxruntime-openvino
  • Confirmed that onnxruntime_providers_openvino.dll is present in the specified directory.

Additional Context

  • I have successfully used DmlExecutionProvider and CPUExecutionProvider with the same setup.
  • The goal is to run the model with OpenVINOExecutionProvider.

Any assistance in resolving this issue would be greatly appreciated.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions