Describe the bug
When using the "geniex serve" command to start a server, it seems to be inaccessible through any website in a web browser other than the in-built "Swagger UI"
To Reproduce
Steps to reproduce the behavior:
- Start the server ("geniex serve")
- Go to any website that accepts OpenAI-Compatible APIs (for instance: this)
- Input the proper base URL ("http://127.0.0.1:18181/v1") and a model name (i tried the one from the example python script: "unsloth/Qwen3-4B-GGUF:Q4_0"), and provide a prompt and system prompt
- See error when you send a request
Expected behavior
A response to the prompt
Screenshots
(from a different test website)
(from the terminal after trying the test website linked before)
Desktop (please complete the following information):
- OS: Windows 11 25H2
- Browser Zen (Firefox) [Also tested on Edge (Chromium), same result]
- Version Latest (v0.3.14)
Additional context
The example Python script provided in the docs seems to work perfectly. I also tested just llama.cpp and the website was able to access that correctly. Let me know if there's any more info I need to send, I'm unfamiliar with this kind of thing so this could also be user error on my part.
Describe the bug
When using the "geniex serve" command to start a server, it seems to be inaccessible through any website in a web browser other than the in-built "Swagger UI"
To Reproduce
Steps to reproduce the behavior:
Expected behavior
A response to the prompt
Screenshots
(from a different test website)
(from the terminal after trying the test website linked before)
Desktop (please complete the following information):
Additional context
The example Python script provided in the docs seems to work perfectly. I also tested just llama.cpp and the website was able to access that correctly. Let me know if there's any more info I need to send, I'm unfamiliar with this kind of thing so this could also be user error on my part.