chore(vulkan): enable arm64 image builds

[mudler]

Description

This PR fixes #5778

Notes for Reviewers

This is first an attempt to see if CI builds against vulkan on arm64

See docker/build-push-action#671 regarding using arm64 native runners for multiplatform builds.
Signed commits

• Yes, I signed my commits.

[netlify]

✅ Deploy Preview for localai ready!

Name	Link
🔨 Latest commit	2aed98d
🔍 Latest deploy log	https://app.netlify.com/projects/localai/deploys/68d97f46212c2d000854c887
😎 Deploy Preview	https://deploy-preview-5780--localai.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify project configuration.

[docjyJ]

Hey

Unfortunately vulkan-sdk is not precompiled for arm64. It must be compiled manually...

There also are not plans to update our Ubuntu packages for ARM. Again users can use the tarball for this situation.
See https://vulkan.lunarg.com/issue/view/654594145df11238996e13fe

[mudler]

Hey

Unfortunately vulkan-sdk is not precompiled for arm64. It must be compiled manually...

There also are not plans to update our Ubuntu packages for ARM. Again users can use the tarball for this situation.
See https://vulkan.lunarg.com/issue/view/654594145df11238996e13fe

appreciated, thanks for the heads up, will give it a shot later in the day, but I see already the CI is emitting core dumps, seen that already in ubuntu images. Might need use of our self-hosted runners for this or try to rebase and work out #5553 first.

[docjyJ]

It's great to see that it's marked on the roadmap. I'm really looking forward to running LocalAI on my RK3588. If you need any help, don't hesitate to ask.