Stopping/Cancelling While Streaming

[Koesn]

Thank's for such a great works of litellm. I'm new to litellm, already setup and everything works smooth for my local LLM setup except stopping/cancelling streaming. I can't make litellm stop/cancel streaming process of my local endpoint. Seems GPU still running. I'm using Open WebUI for frontend. The cancelling works if I set connection directly to vLLM/tabbyAPI, but doesn't works if connection is going through litellm. What setting I'm missing here? Thank's for help.