Skip to content

Feature: Apply profile settings on the fly#1616

Draft
ilukashin wants to merge 2 commits into
jundot:mainfrom
ilukashin:feature/model_profiles_apply_on_the_fly
Draft

Feature: Apply profile settings on the fly#1616
ilukashin wants to merge 2 commits into
jundot:mainfrom
ilukashin:feature/model_profiles_apply_on_the_fly

Conversation

@ilukashin
Copy link
Copy Markdown
Contributor

Concept

Allow user to send requests to specific model-profile setup without reloading model.

How it works

Given:
qwen3 - original model name, installed with oMLX.

In model settings it have two profiles with specific settings:

  • code profile with thinking=off, temperature = 0.1
  • chat profile with thinking=on
  • alias = my_favorite_model

Then:
When i write client config, in model name i can provide values like:

qwen3:code
qwen3:chat
my_favorite_model:code
my_favorite_model:chat

UI changes

Added dropdown if model have profiles. Inspired by #341.

Снимок экрана — 2026-06-01 в 20 08 06

TODO

  • Check test coverage for future regression
  • Update README for different languages
  • Add settings specified for each profile on its row (UI)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant