Skip to content

NPU plugin support #2066

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

NPU plugin support #2066

wants to merge 4 commits into from

Conversation

tkatila
Copy link
Contributor

@tkatila tkatila commented May 27, 2025

No description provided.

@tkatila
Copy link
Contributor Author

tkatila commented May 27, 2025

Not tested on real hardware. Development done based on the kernel API and example listings from a real system.

@tkatila
Copy link
Contributor Author

tkatila commented May 28, 2025

I dropped the preferred allocation policy as it would require more than one NPU to exist and that's not expected as the NPUs are tied to CPUs.

@tkatila
Copy link
Contributor Author

tkatila commented Aug 5, 2025

Tested the plugin on a MeteorLake hardware. Plugin works ok: it registers the resource, container requesting the resources is started, and container gets the /dev/accel/ devices.
I also tried running some tests/demos. The results are mixed. Some pass while some don't.

I'll add a test Dockerfile into this PR and move this to "ready to review" state.

@tkatila
Copy link
Contributor Author

tkatila commented Aug 5, 2025

Added a workload dockerfile and a job for it. The workload has a selection of tests that I've tested to work. There are also additional tests, but they require the NPU compiler & openvino runtime, which can be included, but they take such a long time to compile.

@tkatila tkatila marked this pull request as ready for review August 5, 2025 19:12
@tkatila tkatila force-pushed the npu-plugin branch 2 times, most recently from cc813f6 to 915ead2 Compare August 6, 2025 08:34
tkatila and others added 4 commits August 6, 2025 12:41
Supports Core Ultra 1, 2 and 200V series NPUs.

Signed-off-by: Tuomas Katila <[email protected]>
Co-authored-by: Eero Tamminen <[email protected]>
Signed-off-by: Tuomas Katila <[email protected]>
Signed-off-by: Tuomas Katila <[email protected]>
|:---- |:-------- |
| npu.intel.com/accel | NPU |

## Modes and Configuration Options

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should add a pre-requisite section where we ask user to install the driver if they have not already done so from https://github.com/intel/linux-npu-driver

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants