Skip to content

Predefined System Prompt for Instinct (Next Edit) is not used by default #8590

@simonschoe

Description

@simonschoe

Before submitting your bug report

Relevant environment info

Continue version: v1.2.8
Model: Instinct

Description

In constants.ts you have defined a custom system prompt for Instinct.

However, the system prompt is not automatically injected by Continue (see NextEditProvider.ts).

I would argue the lines in NextEditProvider.ts might be adjusted like this?

    const userPrompt = prompts.find((p) => p.role === "user");
    if (!userPrompt) {
      return undefined;
    }
    const messagesToSend =
      this.endpointType === "fineTuned" || !prompts.some((p) => p.role === "system")
        ? [userPrompt as unknown as ChatMessage]
        : (prompts as unknown as ChatMessage[]);

    const msg: ChatMessage = await llm.chat(messagesToSend, token, {
      stream: false,
    });

To reproduce

Activate Next Edit Autocomplete and check the request body that is sent for each next edit completion. The predefined system prompt is not part of the body.

Log output

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:inline-editRelates to the auto refactor featurekind:bugIndicates an unexpected problem or unintended behavior

    Type

    No type

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions