Add Qwen 3.8 Max (2.4T) as a verifiable teacher via yunwu - #58
Merged
Conversation
Adds the `qwen` provider pinned to the yunwu slug `qwen3.8-max`, so datasets distilled from Qwen 3.8 Max verify like any other production teacher: the slug is committed into request_sha256 and the gateway's response model is re-checked against it. The pin is enforced in both directions, which is the part that matters. A qwen bundle claiming `claude-fable-5`, and an anthropic bundle claiming `qwen3.8-max`, are both rejected -- without the cross-provider check the allowlist would only prove that *some* pinned teacher was used, not which one. gpt-5.6-sol stays in ALLOWED_MODELS on purpose. SparkDistill has retired it as a *generation* teacher, but 23 already-merged registry entries were proved with it and mix_registry --all re-reads every one when rebuilding the canonical mining dataset. Removing it here would retroactively invalidate the data behind the current frontier -- retiring generation and revoking verification are different actions, and only the first was asked for. The slug must match SparkDistill `teacher/providers.py: QWEN_TEACHER_MODEL` exactly. Drift does not fail at generation time; it fails at verification, after the GPU hours are spent. Confirm against yunwu /v1/models before a production run.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds the
qwenprovider pinned to the yunwu slugqwen3.8-max, so datasets distilled from Qwen 3.8 Max verify like any other production teacher — the slug is committed intorequest_sha256and the gateway's response model is re-checked against it.The pin is enforced in both directions
This is the part that matters. A one-way check only proves that some pinned teacher was used, not which one:
qwen/qwen3.8-maxqwenclaimingclaude-fable-5anthropicclaimingqwen3.8-maxqwen/qwen-turbogpt-5.6-sol stays in ALLOWED_MODELS on purpose
SparkDistill has retired it as a generation teacher — no new trajectory will be built with it. It is deliberately not removed here, because 23 already-merged registry entries were proved with it and
mix_registry --allre-reads every one when rebuilding the canonical mining dataset.Removing it would retroactively invalidate the data behind the current frontier. Retiring generation and revoking verification are different actions, and only the first was asked for. There's a test pinning that behavior.
qwen3.8-maxmust match what yunwu actually serves, and must stay identical to SparkDistill'steacher/providers.py: QWEN_TEACHER_MODEL.Drift does not fail at generation time — it fails at verification, after the GPU hours are spent. Please confirm against yunwu's
/v1/modelsbefore any production run.Verification
gpt-5.6-sol→gpt-5.6normalization confirmed unchangedSequencing
This needs a release + pin bump before Qwen data can merge in SparkDistill:
dataset_registry.ymlpins SparkProof at3104e28(v0.3.0), which has noqwenprovider. Until that pin moves, a Qwen bundle generates fine and is rejected by the gate.