Skip to content

Commit ce3627c

Browse files
document provider specific configurations
Signed-off-by: greg pereira <[email protected]>
1 parent dc1864e commit ce3627c

File tree

2 files changed

+28
-3
lines changed

2 files changed

+28
-3
lines changed

config/charts/inferencepool/README.md

Lines changed: 27 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -123,8 +123,33 @@ The following table list the configurable parameters of the chart.
123123
| `inferenceExtension.extraContainerPorts` | List of additional container ports to expose. Defaults to `[]`. |
124124
| `inferenceExtension.extraServicePorts` | List of additional service ports to expose. Defaults to `[]`. |
125125
| `inferenceExtension.flags` | List of flags which are passed through to endpoint picker. Example flags, enable-pprof, grpc-port etc. Refer [runner.go](https://github.com/kubernetes-sigs/gateway-api-inference-extension/blob/main/cmd/epp/runner/runner.go) for complete list. |
126-
| `inferenceExtension.flags.has-enable-leader-election` | Enable leader election for high availability. When enabled, only one EPP pod (the leader) will be ready to serve traffic. |
127-
| `provider.name` | Name of the Inference Gateway implementation being used. Possible values: `gke`. Defaults to `none`. |
126+
| `inferenceExtension.flags.has-enable-leader-election` | Enable leader election for high availability. When enabled, only one EPP pod (the leader) will be ready to serve traffic. | |
127+
| `provider.name` | Name of the Inference Gateway implementation being used. Possible values: [`none`, `gke`, or `istio`]. Defaults to `none`. |
128+
129+
### Provider Specific Configuration
130+
131+
This section should document any Gateway provider specific values configurations.
132+
133+
#### GKE
134+
135+
These are the options available to you with `provider.name` set to `gke`:
136+
137+
| **Parameter Name** | **Description** |
138+
|---------------------------------------------|------------------------------------------------------------------------------------------------------------------------|
139+
| `gke.monitoringSecret.name` | The name of the monitoring secret to be used. Defaults to `inference-gateway-sa-metrics-reader-secret`. |
140+
| `gke.monitoringSecret.namespace` | The namespace that the monitoring secret lives in. Defaults to `default`. |
141+
142+
143+
#### Istio
144+
145+
These are the options available to you with `provider.name` set to `istio`:
146+
147+
| **Parameter Name** | **Description** |
148+
|---------------------------------------------|------------------------------------------------------------------------------------------------------------------------|
149+
| `istio.destinationRule.enabled` | Enable creation of an Istio DestinationRule to configure traffic routing. |
150+
| `istio.destinationRule.host` | Custom host value for the destination rule. If not set this will use the default value which is derrived from the epp service name and release namespace to gerenate a valid service address. |
151+
| `istio.destinationRule.trafficPolicy.connectionPool` | Configure the connectionPool level settings of the traffic policy |
152+
128153

129154
## Notes
130155

config/charts/inferencepool/templates/istio.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
{{- if eq .Values.provider.name "istio" }}
2-
---
32
{{- if .Values.istio.destinationRule.enabled }}
3+
---
44
apiVersion: networking.istio.io/v1beta1
55
kind: DestinationRule
66
metadata:

0 commit comments

Comments
 (0)