Skip to content

OpenAI-Compatible API doesn't function through websites #1168

Description

@Mistashio

Describe the bug
When using the "geniex serve" command to start a server, it seems to be inaccessible through any website in a web browser other than the in-built "Swagger UI"

To Reproduce
Steps to reproduce the behavior:

  1. Start the server ("geniex serve")
  2. Go to any website that accepts OpenAI-Compatible APIs (for instance: this)
  3. Input the proper base URL ("http://127.0.0.1:18181/v1") and a model name (i tried the one from the example python script: "unsloth/Qwen3-4B-GGUF:Q4_0"), and provide a prompt and system prompt
  4. See error when you send a request

Expected behavior
A response to the prompt

Screenshots
(from a different test website)

Image

(from the terminal after trying the test website linked before)

Image

Desktop (please complete the following information):

  • OS: Windows 11 25H2
  • Browser Zen (Firefox) [Also tested on Edge (Chromium), same result]
  • Version Latest (v0.3.14)

Additional context
The example Python script provided in the docs seems to work perfectly. I also tested just llama.cpp and the website was able to access that correctly. Let me know if there's any more info I need to send, I'm unfamiliar with this kind of thing so this could also be user error on my part.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions