Provide OpenAI-alternative API

[phken91]

I would like to use this library in other services, is there any plan to provide an OpenAI-alternative standard API for external services to use?

[Mega4alik]

@phken91 I can easily make it API-runnable, but the current speed is around 1 token / 2–7 seconds (depending on the model, context size, etc.). Would that be acceptable for your use case? If so, can tell me about it a little?
Thanks!