Help with passthrough endpoints? #7916
Dima-Mediator
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, the documentation to pass-through endpoints is rather scarce. Can someone help?
Is there a way to enable load-balancing (with different back-end provider api keys) for "built-in" pass-through endpoints (ex: /anthropic/v1/messages)? As per the documentation examples it seems to rely on $ANTHROPIC_API_KEY and that's it?
Can Custom Pass-Through Endpoints completely replace built-in endpoints, and is load balancing possible with custom endpoints?
Built-in passthrough endpoints (/anthripic, /gemini etc) support LiteLLM virtual keys auth by default, but the same for Custom Pass-Through Endpoints requires setting " auth: true " and is an Enterprise feature - is this correct?
What exactly is the "use_client_credentials_pass_through_routes" setting doing? Is it for custom pass-through endpoint or all (including built-in)? Is it entperise-only?
Thanks!
Beta Was this translation helpful? Give feedback.
All reactions