Search results

Add a set of configuration defaults

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

ok-to-testIndicates a non-member PR verified by an org member that is safe to test.Indicates a non-member PR verified by an org member that is safe to test.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Open (in progress).

kubernetes-sigs/gateway-api-inference-extensionnumber 1223

#1223 In kubernetes-sigs/gateway-api-inference-extension;

· shmuelk opened on Jul 23, 2025

Proposing the successor to the InferenceModel API

approvedIndicates a PR has been approved by an approver from all required OWNERS files.Indicates a PR has been approved by an approver from all required OWNERS files.

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Open (in progress).

kubernetes-sigs/gateway-api-inference-extensionnumber 1199

#1199 In kubernetes-sigs/gateway-api-inference-extension;

· kfswain opened on Jul 21, 2025

Add unit tests

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

ok-to-testIndicates a non-member PR verified by an org member that is safe to test.Indicates a non-member PR verified by an org member that is safe to test.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Open (in progress).

kubernetes-sigs/gateway-api-inference-extensionnumber 1195

#1195 In kubernetes-sigs/gateway-api-inference-extension;

· elevran opened on Jul 21, 2025

feat: support envFrom and envVars

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

needs-rebaseIndicates a PR cannot be merged because it has merge conflicts with HEAD.Indicates a PR cannot be merged because it has merge conflicts with HEAD.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Open (in progress).

kubernetes-sigs/gateway-api-inference-extensionnumber 1183

#1183 In kubernetes-sigs/gateway-api-inference-extension;

· Xunzhuo opened on Jul 17, 2025

feat: improve logging for plugin selection and scoring

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Open (in progress).

kubernetes-sigs/gateway-api-inference-extensionnumber 1178

#1178 In kubernetes-sigs/gateway-api-inference-extension;

· Xunzhuo opened on Jul 17, 2025

feat(prefix-cache): use post response instead of postCycle

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

do-not-merge/holdIndicates that a PR should not merge because someone has issued a /hold command.Indicates that a PR should not merge because someone has issued a /hold command.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Open (in progress).

kubernetes-sigs/gateway-api-inference-extensionnumber 1176

#1176 In kubernetes-sigs/gateway-api-inference-extension;

· Xunzhuo opened on Jul 17, 2025

Add opentelemetry tracing instrumentation

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

do-not-merge/work-in-progressIndicates that a PR should not merge because it is a work in progress.Indicates that a PR should not merge because it is a work in progress.

needs-rebaseIndicates a PR cannot be merged because it has merge conflicts with HEAD.Indicates a PR cannot be merged because it has merge conflicts with HEAD.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Draft (not ready).

kubernetes-sigs/gateway-api-inference-extensionnumber 1125

#1125 In kubernetes-sigs/gateway-api-inference-extension;

· sallyom opened on Jul 9, 2025

Add fallback logic to support multiple endpoints

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

do-not-merge/holdIndicates that a PR should not merge because someone has issued a /hold command.Indicates that a PR should not merge because someone has issued a /hold command.

ok-to-testIndicates a non-member PR verified by an org member that is safe to test.Indicates a non-member PR verified by an org member that is safe to test.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Open (in progress).

kubernetes-sigs/gateway-api-inference-extensionnumber 1122

#1122 In kubernetes-sigs/gateway-api-inference-extension;

· rlakhtakia opened on Jul 8, 2025

Update lora affinity to be a scorer.

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

ok-to-testIndicates a non-member PR verified by an org member that is safe to test.Indicates a non-member PR verified by an org member that is safe to test.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Open (in progress).

kubernetes-sigs/gateway-api-inference-extensionnumber 1121

#1121 In kubernetes-sigs/gateway-api-inference-extension;

· rlakhtakia opened on Jul 8, 2025

fix: split EPP RBAC into cluster and namespaced scoped permission

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

needs-rebaseIndicates a PR cannot be merged because it has merge conflicts with HEAD.Indicates a PR cannot be merged because it has merge conflicts with HEAD.

release-note-action-requiredDenotes a PR that introduces potentially breaking changes that require user action.Denotes a PR that introduces potentially breaking changes that require user action.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Open (in progress).

kubernetes-sigs/gateway-api-inference-extensionnumber 1071

#1071 In kubernetes-sigs/gateway-api-inference-extension;

· chewong opened on Jun 26, 2025

Expand schduling.CycleState to the request lifecycle

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

needs-rebaseIndicates a PR cannot be merged because it has merge conflicts with HEAD.Indicates a PR cannot be merged because it has merge conflicts with HEAD.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Open (in progress).

kubernetes-sigs/gateway-api-inference-extensionnumber 1062

#1062 In kubernetes-sigs/gateway-api-inference-extension;

· liu-cong opened on Jun 25, 2025

feat: Make metrics stale time configurable

cncf-cla: yesIndicates the PR's author has signed the CNCF CLA.Indicates the PR's author has signed the CNCF CLA.

needs-rebaseIndicates a PR cannot be merged because it has merge conflicts with HEAD.Indicates a PR cannot be merged because it has merge conflicts with HEAD.

size/LDenotes a PR that changes 100-499 lines, ignoring generated files.Denotes a PR that changes 100-499 lines, ignoring generated files.

Status: Open (in progress).

kubernetes-sigs/gateway-api-inference-extensionnumber 1046

#1046 In kubernetes-sigs/gateway-api-inference-extension;

· nayihz opened on Jun 23, 2025