Skip to content

Commit f40a844

Browse files
authored
fix: Atchernych/bug 5662109 wrong model (#4484)
Signed-off-by: Anna Tchernych <[email protected]>
1 parent 16239ad commit f40a844

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

recipes/llama-3-70b/vllm/agg/gaie/k8s-manifests/epp/deployment.yaml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -75,6 +75,8 @@ spec:
7575
value: "nats://dynamo-platform-nats.$(PLATFORM_NAMESPACE):4222" # update dynamo-platform to appropriate namespace
7676
- name: DYNAMO_NAMESPACE
7777
value: "$(POD_NAMESPACE)-llama3-70b-agg"
78+
- name: DYNAMO_MODEL
79+
value: "llama3-70b-agg"
7880
- name: DYNAMO_KV_BLOCK_SIZE
7981
value: "128" # UPDATE to match the --block-size in your deploy.yaml engine command
8082
- name: USE_STREAMING

0 commit comments

Comments
 (0)