Skip to content

support anthropic's error code #271

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
daviddkkim wants to merge 1 commit into
base: main
Choose a base branch
from
Open

support anthropic's error code #271

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions packages/proxy/src/proxy.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -899,7 +899,8 @@ export async function proxyV1({
}

const RATE_LIMIT_ERROR_CODE = 429;
const OVERLOADED_ERROR_CODE = 503;
// Anthropic uses 529 for overloaded errors, while many providers use 503.
const OVERLOADED_ERROR_CODES = [503, 529];
const RATE_LIMIT_MAX_WAIT_MS = 45 * 1000; // Wait up to 45 seconds while retrying
const BACKOFF_EXPONENT = 2;

Expand All @@ -912,14 +913,14 @@ const TRY_ANOTHER_ENDPOINT_ERROR_CODES = [
// intelligently, eg if all APIs are rate limited, back off and try something else.
RATE_LIMIT_ERROR_CODE,

// 503 is overloaded. We may want to track stats about this and potentially handle more
// 503 and 529 is overloaded. We may want to track stats about this and potentially handle more
// intelligently, eg if all APIs are overloaded, back off and try something else.
OVERLOADED_ERROR_CODE,
...OVERLOADED_ERROR_CODES,
];

const RATE_LIMITING_ERROR_CODES = [
RATE_LIMIT_ERROR_CODE,
OVERLOADED_ERROR_CODE,
...OVERLOADED_ERROR_CODES,
];

const GOOGLE_URL_REGEX =
Expand Down
Loading