Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -355,6 +355,73 @@ spec:
rule: self.modelName != "" || size(self.loraAdapters) > 0
status:
description: ModelRouteStatus defines the observed state of ModelRoute.
properties:
conditions:
description: |-
Conditions track the lifecycle of this ModelRoute.
Types:
- "Ready": true when the route has been registered with the router store
and is available for request matching.
items:
description: Condition contains details for one aspect of the current
state of this API Resource.
properties:
lastTransitionTime:
description: |-
lastTransitionTime is the last time the condition transitioned from one status to another.
This should be when the underlying condition changed. If that is not known, then using the time when the API field changed is acceptable.
format: date-time
type: string
message:
description: |-
message is a human readable message indicating details about the transition.
This may be an empty string.
maxLength: 32768
type: string
observedGeneration:
description: |-
observedGeneration represents the .metadata.generation that the condition was set based upon.
For instance, if .metadata.generation is currently 12, but the .status.conditions[x].observedGeneration is 9, the condition is out of date
with respect to the current state of the instance.
format: int64
minimum: 0
type: integer
reason:
description: |-
reason contains a programmatic identifier indicating the reason for the condition's last transition.
Producers of specific condition types may define expected values and meanings for this field,
and whether the values are considered a guaranteed API.
The value should be a CamelCase string.
This field may not be empty.
maxLength: 1024
minLength: 1
pattern: ^[A-Za-z]([A-Za-z0-9_,:]*[A-Za-z0-9_])?$
type: string
status:
description: status of the condition, one of True, False, Unknown.
enum:
- "True"
- "False"
- Unknown
type: string
type:
description: type of condition in CamelCase or in foo.example.com/CamelCase.
maxLength: 316
pattern: ^([a-z0-9]([-a-z0-9]*[a-z0-9])?(\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*/)?(([A-Za-z0-9][-A-Za-z0-9_.]*)?[A-Za-z0-9])$
type: string
required:
- lastTransitionTime
- message
- reason
- status
- type
type: object
type: array
observedGeneration:
description: observedGeneration is the most recent generation observed
for this ModelRoute.
format: int64
type: integer
type: object
required:
- spec
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -159,6 +159,87 @@ spec:
type: object
status:
description: ModelServerStatus defines the observed state of ModelServer.
properties:
conditions:
description: |-
Conditions track the lifecycle of this ModelServer.
Types:
- "Ready": true when at least one ready pod is matched and the ModelServer has been
registered with the router store. Signals that the ModelServer can serve traffic.
- "AllPodsReady": true when at least one pod is matched and every matched pod is ready
and registered with the router store.
items:
description: Condition contains details for one aspect of the current
state of this API Resource.
properties:
lastTransitionTime:
description: |-
lastTransitionTime is the last time the condition transitioned from one status to another.
This should be when the underlying condition changed. If that is not known, then using the time when the API field changed is acceptable.
format: date-time
type: string
message:
description: |-
message is a human readable message indicating details about the transition.
This may be an empty string.
maxLength: 32768
type: string
observedGeneration:
description: |-
observedGeneration represents the .metadata.generation that the condition was set based upon.
For instance, if .metadata.generation is currently 12, but the .status.conditions[x].observedGeneration is 9, the condition is out of date
with respect to the current state of the instance.
format: int64
minimum: 0
type: integer
reason:
description: |-
reason contains a programmatic identifier indicating the reason for the condition's last transition.
Producers of specific condition types may define expected values and meanings for this field,
and whether the values are considered a guaranteed API.
The value should be a CamelCase string.
This field may not be empty.
maxLength: 1024
minLength: 1
pattern: ^[A-Za-z]([A-Za-z0-9_,:]*[A-Za-z0-9_])?$
type: string
status:
description: status of the condition, one of True, False, Unknown.
enum:
- "True"
- "False"
- Unknown
type: string
type:
description: type of condition in CamelCase or in foo.example.com/CamelCase.
maxLength: 316
pattern: ^([a-z0-9]([-a-z0-9]*[a-z0-9])?(\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*/)?(([A-Za-z0-9][-A-Za-z0-9_.]*)?[A-Za-z0-9])$
type: string
required:
- lastTransitionTime
- message
- reason
- status
- type
type: object
type: array
matchedReplicas:
description: |-
matchedReplicas is the total number of pods (ready or not) that match the
workloadSelector.
format: int32
type: integer
observedGeneration:
description: observedGeneration is the most recent generation observed
for this ModelServer.
format: int64
type: integer
readyReplicas:
description: |-
readyReplicas is the number of ready pods that are currently matched by the
workloadSelector and have been successfully registered in the router's store.
format: int32
type: integer
type: object
type: object
served: true
Expand Down

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 4 additions & 0 deletions client-go/applyconfiguration/utils.go

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 2 additions & 2 deletions cmd/kthena-router/app/controller.go
Original file line number Diff line number Diff line change
Expand Up @@ -77,11 +77,11 @@ func startControllers(store datastore.Store, stop <-chan struct{}, enableGateway

kubeInformerFactory := informers.NewSharedInformerFactory(kubeClient, 0)
kthenaInformerFactory := kthenaInformers.NewSharedInformerFactory(kthenaClient, 0)
modelRouteController, err := controller.NewModelRouteController(kthenaInformerFactory, store)
modelRouteController, err := controller.NewModelRouteController(kthenaClient, kthenaInformerFactory, store)
if err != nil {
klog.Fatalf("Error creating model route controller: %s", err.Error())
}
modelServerController, err := controller.NewModelServerController(kthenaInformerFactory, kubeInformerFactory, store)
modelServerController, err := controller.NewModelServerController(kthenaClient, kthenaInformerFactory, kubeInformerFactory, store)
if err != nil {
klog.Fatalf("Error creating model server controller: %s", err.Error())
}
Expand Down
Loading
Loading