Consumer: add examples on how to use Prem with docker CLI directly

[tiero]

At the moment the only way to interact with services is to spins up daemon & app as services, but many developers may find easier for testing or work in production to only run the exact container needed for their application, after thei done exploring through the app.

I think is worth to add an extra category here for users, something like "Use with Docker" and will point to ready-made snippets that involves the use of docker CLI. I do imagine

• Run a service (detached, with a nice name, restart on failure, attach GPU etc..)
• Check the logs (with tail of last 200 maybe)
• Stop/Delete a service

A bonus point would be to setup a simple docker swarm and define a number of desired replicas for the service.

[casperdcl]

Maybe it's better to do this in the App? i.e. in the model card, print the docker command needed to run things, e.g. on https://registry.premai.io/detail.html?service=tabby-codegen-2b display:

docker run --gpus all -p 10111:8080 -v tabbyml-data:/data -d tabbyml/tabby serve --model TabbyML/Codegen-2B --device cuda

[tiero]

Yes also in the app could be a great place, and I would say also the registry at this point! I'll keep the issue in this repo for time being, will move it

[filopedraz]

Yep, we can include it in the documentation of each service.