Skip to content

Commit 2ffcfd1

Browse files
document provider specific configurations
Signed-off-by: greg pereira <[email protected]>
1 parent c8c3902 commit 2ffcfd1

File tree

2 files changed

+27
-2
lines changed

2 files changed

+27
-2
lines changed

config/charts/inferencepool/README.md

Lines changed: 26 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -148,7 +148,32 @@ The following table list the configurable parameters of the chart.
148148
| `inferenceExtension.tolerations` | Tolerations for the endpoint picker. Defaults to `[]`. |
149149
| `inferenceExtension.flags.has-enable-leader-election` | Enable leader election for high availability. When enabled, only one EPP pod (the leader) will be ready to serve traffic. |
150150
| `inferenceExtension.pluginsCustomConfig` | Custom config that is passed to EPP as inline yaml. |
151-
| `provider.name` | Name of the Inference Gateway implementation being used. Possible values: `gke`. Defaults to `none`. |
151+
| `provider.name` | Name of the Inference Gateway implementation being used. Possible values: [`none`, `gke`, or `istio`]. Defaults to `none`. |
152+
153+
### Provider Specific Configuration
154+
155+
This section should document any Gateway provider specific values configurations.
156+
157+
#### GKE
158+
159+
These are the options available to you with `provider.name` set to `gke`:
160+
161+
| **Parameter Name** | **Description** |
162+
|---------------------------------------------|------------------------------------------------------------------------------------------------------------------------|
163+
| `gke.monitoringSecret.name` | The name of the monitoring secret to be used. Defaults to `inference-gateway-sa-metrics-reader-secret`. |
164+
| `gke.monitoringSecret.namespace` | The namespace that the monitoring secret lives in. Defaults to `default`. |
165+
166+
167+
#### Istio
168+
169+
These are the options available to you with `provider.name` set to `istio`:
170+
171+
| **Parameter Name** | **Description** |
172+
|---------------------------------------------|------------------------------------------------------------------------------------------------------------------------|
173+
| `istio.destinationRule.enabled` | Enable creation of an Istio DestinationRule to configure traffic routing. |
174+
| `istio.destinationRule.host` | Custom host value for the destination rule. If not set this will use the default value which is derrived from the epp service name and release namespace to gerenate a valid service address. |
175+
| `istio.destinationRule.trafficPolicy.connectionPool` | Configure the connectionPool level settings of the traffic policy |
176+
152177

153178
## Notes
154179

config/charts/inferencepool/templates/istio.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
{{- if eq .Values.provider.name "istio" }}
2-
---
32
{{- if .Values.istio.destinationRule.enabled }}
3+
---
44
apiVersion: networking.istio.io/v1beta1
55
kind: DestinationRule
66
metadata:

0 commit comments

Comments
 (0)