Feature Request: container image support (similar to upstream llama.cpp)

[iggy]

Prerequisites

• I am running the latest code. Mention the version if possible as well.
• I carefully followed the README.md.
• I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
• I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

It would be nice if you could start shipping pre-built container images similar to upstream.

Motivation

I run all my models via k8s, so having a pre-built container image that is kept up-to-date with the repo would awesome. I could certainly build my own, but then I'd have to watch for new releases and update it manually, etc.

Possible Implementation

The upstream github action that does the building is .github/workflows/docker.yml.