Support Azure OpenAI models

[yuzisun]

Description:
Support Azure OpenAI Service for GPT-4o, o1 series models.

Authentication

https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#authentication

• API Key using the api-key HTTP header
• Microsoft Entra Token: Authentication tokens are included in a request as the Authorization header, the token can be retrieved using the following environment variables by callingget_bearer_token_provider from azure sdk
  • AZURE_CLIENT_ID=xxx
  • AZURE_TENANT_ID=xxx
  • AZURE_CLIENT_SECRET=xxx

Data Plane API

• Azure OpenAI Service supports the OpenAI protocol
  https://github.com/Azure/azure-rest-api-specs/blob/main/specification/cognitiveservices/data-plane/AzureOpenAI/inference/stable/2024-10-21/inference.json#L287
  • Endpoint path: /deployments/{deployment-id}/chat/completions
  • Azure has region specific endpoints like xxx-openai-azure-{region}-{tier}
    • https://xxx-openai-azure.openai.azure.com/openai/deployments/o1-mini/chat/completions?api-version=2024-08-01-preview
    • https://xxx-openai-azure-eastus2-dev.openai.azure.com/openai/deployments/o3-mini/chat/completions?api-version=2024-12-01-preview

Control Plane API

// BackendSecurityPolicyAzureCredentials contains the supported authentication mechanisms to access azure AI services
type BackendSecurityPolicyAzureCredentials struct {
	// Region specifies the Azure region associated with the policy.
	//
	// +kubebuilder:validation:MinLength=1
	Region string `json:"region"`

	// ClientId is a unique identifier assigned to a registered application
	// +optional
	ClientId string `json:"clientId"`

        // TenantId is a unique identifier for an Azure Active Directory tenant
	//
	// +optional
	TenantId string `json:"tenantId"`

        // ClientSecret is a confidential secret generated for the application
	//
	// +optional
	ClientSecret gwapiv1.SecretObjectReference `json:"clientSecret"`
}

[optional Relevant Links:]
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models?tabs=global-standard%2Cstandard-chat-completions