v1.0.1 patch release

[kfswain]

Target Date

Monday Sept 22nd

Issues

This issue is to capture any commits/bug-fixes we may want to include in a patch release so that they can be batched

Helm

Cherry-picked

• fix helm chart support for gke v1alpha2. #1551: a small bug-fix for GKE to support the v1a2 inferencePool API version. Other implementations continue to work as-is, as the --pool-group flag can be included into the set of flags in the helm chart as normal.
• Main uniquely name crbac #1564
• epp servicemonitor #1425
• add gke monitoring helm support. #1600
• Consolidate ha config into a single enableLeaderElection, also fix rolling update stuck bug #1620
• fix missing GCPBakendPolicy. #1623
• use replicas field in helm to decide if EPP should run in HA mode #1628
• Bug fix - error calling gt: incompatible types for comparison: float64 and int #1630
• enable istio as a provider + configuring destinationRule #1381

[Gregory-Pereira]

Including #1564 here

[zetxqx]

it will be really nice if we can get this in as well #1600 for GKE monitoring, no LG yet, but I'll chase for it.

[liu-cong]

Add bug fix for GKE gateway. Without this deploying on GKE fails so this is important.

#1618

[liu-cong]

Requesting another bug fix for stuck rollout in leader election mode.

#1620

[zetxqx]

This is also needed: #1425 as a dependency for the above several commits for monitoring

[nirrozenbaum]

@kfswain what is the timeline for this patch release?

[kfswain]

I'll edit the comment, but I discussed with Greg and we were shooting for Monday.

So far all the changes seem to be helm related, so its a very low risk patch, and should have little-to-zero impact on llm-d sched because of that.

[zetxqx]

This is needed: #1623 as well...

[LukeAVanDrie]

bugs: #1624 , #1625 , and #1626

two of which are addressed in PR #1627

[kfswain]

bugs: #1624 , #1625 , and #1626

two of which are addressed in PR #1627

Discussed this outside of github, these are great proactive fixes, but the current state is WAI, and so to prevent any unforseen instability, we will not include the EPP PRs in this patch.