Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to enable anthropic.claude-3-5-sonnet-20241022-v2:0 #13

Open
Sandy4321 opened this issue Feb 10, 2025 · 7 comments
Open

how to enable anthropic.claude-3-5-sonnet-20241022-v2:0 #13

Sandy4321 opened this issue Feb 10, 2025 · 7 comments

Comments

@Sandy4321
Copy link

great code thanks
but I have error
ValidationException: An error occurred (ValidationException) when calling the InvokeModel operation: Invocation of model ID anthropic.claude-3-5-sonnet-20241022-v2:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model

then how to enable anthropic.claude-3-5-sonnet-20241022-v2:0 for
https://github.com/aws-samples/generative-ai-financial-services-samples/tree/main/intelligent-retrieval-augmented-generation-for-proxy-documents-proxybot

for old anthropic.claude-3-5-sonnet version it works

Image

and

Image
@djoguns
Copy link
Collaborator

djoguns commented Feb 11, 2025

Hi @Sandy4321

Will look into this.

But as an immediate step, upgrade the boto3 and botocore packages.

You might want to try this in a different environment due to other package dependencies.

Cheers.

@Sandy4321
Copy link
Author

upgrade the boto3 and botocore packages -> these are up to date

also I have needed profile
Image

@Sandy4321
Copy link
Author

and

Image

@Sandy4321
Copy link
Author

do you use right sonet version in your code , you need to use V2?

Image

@Sandy4321
Copy link
Author

it is what you use in code

Image and Image

@Sandy4321
Copy link
Author

seems to be you have bug in AWS - profile can not be updated or changed
i created profile some time ago when only 02 version was available but now it want to use version from October -> version 10

Image

@Sandy4321
Copy link
Author

also is it possible to use multiple versions in inference profile , so it will be possible to use many sonet versions on fly?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants