Description
Deep Research is hard coded to use Ollama. If your main inference engine is your own trained model being served from LM Studio, vLLM or LlamaServer, Research will still try to be done using Ollama
Steps to Reproduce
- Run a Deep Research prompt without Ollama gemma4:31b running locally
- Observe the 404 failure response
Expected Behavior
I would expect the model that I'm already using for Chat to also be used for Deep Resarch as selected in the upper left
Actual Behavior
Fails with a 404 stating the model cannot be found.
Operating System
macOS
Python Version
3.12
Hardware
Apple Silicon
Engine
Other
Logs / Traceback
Research failed: RuntimeError: Ollama returned 404: {"error":"model 'gemma4:31b' not found"}
Description
Deep Research is hard coded to use Ollama. If your main inference engine is your own trained model being served from LM Studio, vLLM or LlamaServer, Research will still try to be done using Ollama
Steps to Reproduce
Expected Behavior
I would expect the model that I'm already using for Chat to also be used for Deep Resarch as selected in the upper left
Actual Behavior
Fails with a 404 stating the model cannot be found.
Operating System
macOS
Python Version
3.12
Hardware
Apple Silicon
Engine
Other
Logs / Traceback
Research failed: RuntimeError: Ollama returned 404: {"error":"model 'gemma4:31b' not found"}