Skip to content

Commit 7d31b4c

Browse files
authored
bugfix: disable enable_schedule_overlap when enable VLM backend. (#115)
1 parent 3f79f3a commit 7d31b4c

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

xllm/core/runtime/vlm_master.cpp

100644100755
Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -75,7 +75,9 @@ VLMMaster::VLMMaster(const Options& options)
7575
.instance_role(options_.instance_role())
7676
.kv_cache_transfer_mode(options_.kv_cache_transfer_mode())
7777
.enable_service_routing(options_.enable_service_routing())
78-
.enable_decode_response_to_service(enable_decode_response_to_service);
78+
.enable_decode_response_to_service(enable_decode_response_to_service)
79+
// TODO: support later for VLM.
80+
.enable_schedule_overlap(false);
7981
scheduler_ = create_continuous_scheduler(engine_.get(), scheduler_options);
8082

8183
if (options_.enable_service_routing()) {

0 commit comments

Comments
 (0)