Skip to content

Allowing /v1/model/info requests that take longer than 15 seconds #20

Description

@catarinacps

What happened?

In my LiteLLM proxy, the model/info call takes more than 15 seconds, making it fail to get accurate model info, like reasoning variants, cost and such.

Expected behavior

I expected to have some way to control the timeout for that request, like through an environment variable. As I know this is the normal behavior for my proxy, I don't mind waiting more than 15 seconds.

Steps to reproduce

As this is specific to the proxy I'm using, there's no way to reproduce the issue.

Plugin version

0.8.0

LiteLLM version

1.86.2

OpenCode version

1.18.18

Node.js / Bun version & OS

Node 26.7.0, MacOS 26.5.1

Relevant logs

v1/models response:

{
  "data": [
    {
      "id": "gpt-4",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt41",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt4-mini",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt5-mini",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt5-nano",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt51",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt5.1",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5.1",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt52",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt5.2",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5.2",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt54",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt5.4",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5.4",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5.4-mini",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt55",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt5.5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5.5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt56sol",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt5.6-sol",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5.6-sol",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt56terra",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt5.6-terra",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5.6-terra",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt56luna",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt5.6-luna",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5.6-luna",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "claude-45",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "claude-4.5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "claude-4-5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "claude-sonnet-4-6",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "claude-sonnet-4-5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "claude-opus-4-6",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "claude-opus-4-8",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "claude-fable-5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "claude-sonnet-5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "claude-opus-5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gemini-25-flash",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gemini-25-pro",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gemini-31-pro",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gemini-20-flash",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gemini-3.1-pro[1m]",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gemini-3.1-pro",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "DeepSeek-R1",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "DeepSeek-V4-Pro",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "grok3",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "kimi-k3",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "glm-5.2",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-4o",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-4o-mini",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-4.1",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "o3-mini",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "o1",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5-mini",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5-nano",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5-1",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5-codex",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5.1-codex",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5-2",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5-4",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5-4-mini",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5-5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5-6-sol",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5-6-terra",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gpt-5-6-luna",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "deepseek-r1",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "deepseek-v4-pro",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "grok-3",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "mistral-small-2503",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "FW-Kimi-K3",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "FW-GLM-5.2",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gemini-2.5-flash",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gemini-2.0-flash",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gemini-2.5-pro",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "gemini-3.1-pro-preview",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "anthropic.claude-4-5-sonnet",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "anthropic.claude-4-6-sonnet",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "anthropic.claude-5-sonnet",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "anthropic.claude-4-5-haiku",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "anthropic.claude-4-6-opus",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "bedrock/anthropic.claude-4-8-opus",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "anthropic.claude-4-8-opus",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "anthropic.claude-fable-5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "bedrock/anthropic.claude-opus-5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "anthropic.claude-opus-5",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    },
    {
      "id": "amazon-bedrock",
      "object": "model",
      "created": 1786960831,
      "owned_by": "openai"
    }
  ],
  "object": "list"
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions