High latency

[deathline94]

Hey so i deployed on my personal VPS (ubuntu 22 , plenty of resources) then used the aggregated api on my local system in opencode.
the problem is i have high latency . according to the panel its around 13000ms (13 full seconds!!) and beside that its very slow overall.
i was wondering did i do something wrong or it is what it is and i should live with it ...

[tashfeenahmed]

That 13 seconds is upstream free-tier latency, not overhead from the gateway. There's no artificial delay anywhere in the request path. It adds up because failover is sequential: when a provider is rate-limited or returns a 5xx, the router moves to the next one in your chain, and each attempt is a full round trip.

A few ways to speed it up:

• Put a fast provider first (Groq or Cerebras are good picks).
• Set the routing strategy to Fastest, or to Manual so you control the order.
• Pin a single model when you don't need failover.
• Keep only the providers that still have quota.

Closing this out, but if one specific single-provider call is slow, let me know and I'll take a look.

[deathline94]

youre 100% correct . its the OG provider latency . some other better some worse. i guess i have to live with it . thanks