You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: config/charts/inferencepool/README.md
+26-1Lines changed: 26 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -148,7 +148,32 @@ The following table list the configurable parameters of the chart.
148
148
| `inferenceExtension.tolerations` | Tolerations for the endpoint picker. Defaults to `[]`. |
149
149
| `inferenceExtension.flags.has-enable-leader-election` | Enable leader election for high availability. When enabled, only one EPP pod (the leader) will be ready to serve traffic. |
150
150
| `inferenceExtension.pluginsCustomConfig` | Custom config that is passed to EPP as inline yaml. |
151
-
| `provider.name` | Name of the Inference Gateway implementation being used. Possible values: `gke`. Defaults to `none`. |
151
+
| `provider.name` | Name of the Inference Gateway implementation being used. Possible values: [`none`, `gke`, or `istio`]. Defaults to `none`. |
152
+
153
+
### Provider Specific Configuration
154
+
155
+
This section should document any Gateway provider specific values configurations.
156
+
157
+
#### GKE
158
+
159
+
These are the options available to you with `provider.name` set to `gke`:
| `istio.destinationRule.enabled` | Enable creation of an Istio DestinationRule to configure traffic routing. |
174
+
| `istio.destinationRule.host` | Custom host value for the destination rule. If not set this will use the default value which is derrived from the epp service name and release namespace to gerenate a valid service address. |
175
+
| `istio.destinationRule.trafficPolicy.connectionPool` | Configure the connectionPool level settings of the traffic policy |
0 commit comments