[FEAT]: VertexAI Support as LLM

[timothycarambat]

What would you like to see?

Add support for GCP's VertexAI provider.
Docs: https://cloud.google.com/vertex-ai/docs/generative-ai/learn/overview#gen-ai-studio

This may be quite complex to support given the nature of Vertex and how it can run multiple models. Functionally, this is probably quite similar to AWS BedRock models

[SeaDude]

This would be lovely.

Example: I'm still waiting for Claude access in my AWS account (because AWS makes you contact support ((boooo!)) ), but I was immediately granted access in my Google Vertex account.

I mean I could just pipe in my Anthropic API key but... the data privacy and security are not guaranteed by the cloud provider (important to me).

[chronometer]

This would be amazing.
Especially as you can launch models from huggingface models via VertexAI.

[Divyanshu9822]

I came to AnythingLLM looking for this because I also want to run Claude Sonnet via APIs but I prefer to use this via Vertex AI