Version: v2.0.0
Describe the Bug
Running Local AI with Lllama-cpp turboquant, after some time the task stops and the error timeout: llama-server completion exceeded the 180-second deadline triggers. Even increasing Timeout for llamacpp to 2400 I still getting the error same way. This error happens more or less after 500s
Steps to Reproduce
- Just run something
Screenshots / Logs
app.log
Operating System
Version: v2.0.0
Describe the Bug
Running Local AI with Lllama-cpp turboquant, after some time the task stops and the error
timeout: llama-server completion exceeded the 180-second deadlinetriggers. Even increasingTimeout for llamacppto 2400 I still getting the error same way. This error happens more or less after 500sSteps to Reproduce
Screenshots / Logs
app.log
Operating System