Calling Bedrock Models via API Gateway

[sterankin]

A common pattern is exposing the various bedrock models (Nova, Claude, Lllama3 etc) via API Gateway and Lambda.

Client -> AWS Api Gateway -> AWS Lambda -> Bedrock Model

I noticed this PR: #7828
It mentioned http(s) for Bedrock. Is there a way to call the Bedrock models this way using LiteLLM?

e.g.

from litellm import completion

response = completion(
            model="claude-3-5-sonnet-20241022",
            messages = [{ "content": "Tell me a joke","role": "user"}],
            api_base="https://some-aws-apigateway-url/bedrock",
            stream=False,
            api_key="Bearer Token",
)

The above will fail with a 404 as LiteLLM seems to add to the url:

https://some-aws-apigateway-url/bedrock/**v1/messages** when I really want it to be like:

https://some-aws-apigateway-url/bedrock/claude-3-5-sonnet-20241022

It would be great if this supported the converse format.