Skip to content

Add support for Intel GPU's - #1362

Open
leuc wants to merge 5 commits into
openai:mainfrom
leuc:main
Open

Add support for Intel GPU's#1362
leuc wants to merge 5 commits into
openai:mainfrom
leuc:main

Conversation

@leuc

@leuc leuc commented May 18, 2023

Copy link
Copy Markdown

Requires Intel Extension for PyTorch v1.13.120+xpu
Installation Guide: https://intel.github.io/intel-extension-for-pytorch/xpu/latest/tutorials/installation.html

Successfully tested on Intel ARC A770 16GB VRAM with the large model.

Common issue:
OSError: libmkl_intel_lp64.so.2: cannot open shared object file: No such file or directory

Ensure OneAPI libraries are available in the current shell by running source /opt/intel/oneapi/setvars.sh

Requires Intel Extension for PyTorch v1.13.120+xpu
https://intel.github.io/intel-extension-for-pytorch/xpu/latest/tutorials/installation.html

Tested on Intel ARC A770 16GB VRAM with large model
@xianlubird

Copy link
Copy Markdown

Can this will be used for Intel Integrated Graphics like Graphics 630 ?

@leuc

leuc commented May 19, 2023

Copy link
Copy Markdown
Author

Can this will be used for Intel Integrated Graphics like Graphics 630 ?

No. From the installation guide the verified Hardware Platforms are:

  • Intel® Data Center GPU Flex Series 170
  • Intel® Data Center GPU Max Series
  • Intel® Arc™ A-Series GPUs (Experimental support)

These are all dedicated GPU's, not integrated.

@heligan

heligan commented Aug 23, 2023

Copy link
Copy Markdown

really appreciate the work. hope it can be merged soon

@leuc

leuc commented Sep 22, 2023

Copy link
Copy Markdown
Author

seeing some speed-up for time whisper --language en --model large tests/jfk.flac with new intel_extension_for_pytorch

1.13.120+xpu
real 0m23.510s

2.0.110+xpu
real 0m19.706s

intel-i915-dkms 1.23.5.19.230406.21.5.17.0.1034+i38-1 kernel 5.17.0-1020-oem

@cibernox

cibernox commented Mar 4, 2024

Copy link
Copy Markdown

Has anyone ran this on integrated graphics with ARC architecture (12th and above I believe?)

@hauskens

Copy link
Copy Markdown

I managed to get this to run on my Intel ARC A770

@farooqkz

Copy link
Copy Markdown

What is state of this PR?

@buekera

buekera commented Jul 7, 2025

Copy link
Copy Markdown

@leuc can you have a look at the existing conflicts?

@leuc

leuc commented Nov 15, 2025

Copy link
Copy Markdown
Author

@leuc can you have a look at the existing conflicts?

done

@Digitalpeer1

Copy link
Copy Markdown

Any update on this?

@Lindenk

Lindenk commented Aug 6, 2026

Copy link
Copy Markdown

It looks like this PR has been ready to go for awhile. What's blocking this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

10 participants