Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OCI image size of ramalama-llama-server image #838

Open
benoitf opened this issue Feb 17, 2025 · 0 comments
Open

OCI image size of ramalama-llama-server image #838

benoitf opened this issue Feb 17, 2025 · 0 comments

Comments

@benoitf
Copy link
Contributor

benoitf commented Feb 17, 2025

The image size of quay.io/ramalama/ramalama-llama-server is around 1GB

quay.io/ramalama/ramalama-llama-server     latest     a33370809b8c  3 hours ago    1.02 GB
quay.io/ramalama/ramalama-whisper-server   latest     521107f5709a  3 hours ago    1.02 GB

if I look at 'official' images of llama.cpp :

ghcr.io/ggml-org/llama.cpp      light          3feaecf422f2  8 hours ago    83.3 MB

so maybe there is something in the middle ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant