Skip to content

Deep Research ignores configured engine; hardcodes Ollama #575

Description

@chip902

Description

Deep Research is hard coded to use Ollama. If your main inference engine is your own trained model being served from LM Studio, vLLM or LlamaServer, Research will still try to be done using Ollama

Steps to Reproduce

  1. Run a Deep Research prompt without Ollama gemma4:31b running locally
  2. Observe the 404 failure response

Expected Behavior

I would expect the model that I'm already using for Chat to also be used for Deep Resarch as selected in the upper left

Actual Behavior

Fails with a 404 stating the model cannot be found.

Image

Operating System

macOS

Python Version

3.12

Hardware

Apple Silicon

Engine

Other

Logs / Traceback

Research failed: RuntimeError: Ollama returned 404: {"error":"model 'gemma4:31b' not found"}

Metadata

Metadata

Assignees

No one assigned

    Type

    Fields

    Priority

    None yet

    Effort

    None yet

    Projects

    Status
    Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions