OpenVINO EP release for ONNX Runtime 1.8 & OpenVINO 2021.3

Description:
Version update for OpenVINO Execution Provider based on the OpenVINO release 2021.3.

Announcements:
This release:
Now supports Openvino EP 2021.3 Release.
Removed support for OpenVINO 2020.4..
Added support for Loading/Saving of Blobs on MyriadX devices to avoid expensive model blob compilation at runtime.

Building from source
Please refer to the OpenVINO EP build instructions for information on system pre-requisites as well as instructions to build from source.

Python Pip Wheel packages
Find below pre-built Python wheel packages (zipped) that can be installed on a dev machine with OpenVINO installed. Please refer to the OpenVINO EP build instructions for information on system pre-requisites.

APIs
Please refer to the link below for Python/C++ APIs:
https://www.onnxruntime.ai/docs/reference/execution-providers/OpenVINO-ExecutionProvider.html#configuration-options

Performance
Supports Yolov3, Mask RCNN and 2 Stage Product Reco on MyriadX

Samples
Added new Python /C++ /C # samples for further reference. Please refer to the link below:
https://www.onnxruntime.ai/docs/reference/execution-providers/OpenVINO-ExecutionProvider.html#openvino-ep-samples-tutorials

OpenVINO EP V4.0 Release for ONNX Runtime 1.11.0 & OpenVINO 2022.1

Description:
OpenVINO-EP v4.0 Release PR with OpenVINO 2022.1

Motivation and Context:
OpenVINO-EP now supports the latest OpenVINO 2022.1 version
OpenVINO-EP is now updated to use the new OpenVINO 2.0 API's starting from this release
Backward compatibility support for older OpenVINO versions (OV 2021.3, OV 2021.4) is available
New code design changes introduced to have cleaner code structure for different OpenVINO versions
Opset 13 compliance w.r.t OpenVINO (More operators added)
New features added (GPU opencl throttling, device type checks)

For all the latest information, Refer to our documentation:
https://onnxruntime.ai/docs/execution-providers/OpenVINO-ExecutionProvider.html

Build steps:
Please refer to the OpenVINO EP build instructions for information on system pre-requisites as well as instructions to build from source.
https://onnxruntime.ai/docs/build/eps.html#openvino

OpenVINO-EP samples:
https://github.com/microsoft/onnxruntime-inference-examples

Python Pip Wheel packages:
Find below pre-built Python wheel packages (zipped) that can be installed on a dev machine with OpenVINO 2022.1 installed. Please refer to the OpenVINO EP build instructions for information on system pre-requisites.

Docker Image:
The latest OpenVINO EP docker image can be downloaded from dockerhub.
https://hub.docker.com/r/openvino/onnxruntime_ep_ubuntu18

Nuget Package:
The latest OpenVINO EP Nuget Package for Windows can be downloaded from below repo

APIs:
Please refer to the link below for Python/C++ APIs:
https://onnxruntime.ai/docs/execution-providers/OpenVINO-ExecutionProvider.html#configuration-options

Note: We have few python tests disabled with OpenVINO 2022.1. This would be fixed with the next release.

OpenVINO EP for OpenVINO 2020.2 release

Description:
Version update for OpenVINO Execution Provider. Based on the latest OpenVINO release 2020.2 which now includes nGraph stack. Model conversion from ONNX to OpenVINO IR is now done using nGraph ONNX importer component.

Motivation and Context

• Supports a larger set of ONNX operators
• Supports inference of partial models using sub-graph partitioning
• Supports models with symbolic dimensions in shapes.
• Uses OpenVINO APIs with Long Term Support (LTS) providing extended support and backward compatibility.
• Upto 40% reduction in memory footprint.
• Avoids using the python components used by existing version EP thus avoiding expensive python interpreter startup and module conflicts arising from it.

Preview release v0.7

Attached python wheel for python version 3.5. Built with "CPU_FP32" option.

Requires OpenVINO 2018 R5.0.1 installed and environment sourced.