Swap the second teacher from GPT 5.6 Sol to Moonshot Kimi K3 - #50
Open
ai-hpc wants to merge 1 commit into
Open
Conversation
Kimi K3 (moonshotai/kimi-k3) leads GPT 5.6 Sol at GPU-kernel optimization on the vendor benchmark (competitive with Fable 5, substantially ahead of Sol; ships its own Triton-like compiler, MiniTriton), which is exactly what a Triton-kernel dataset generator wants. Replace the OpenAI Sol teacher with a real "moonshot" provider so the pinned teacher pair is Fable 5 + Kimi K3, and provenance records the true teacher. - policy.py / gateways.py: provider key openai -> moonshot; MOONSHOT_TEACHER_MODEL = kimi-k3; OpenRouter moonshotai/kimi-k3, yunwu kimi-k3. Kimi has no -sol-style variant so the logical/routed distinction collapses to a single slug; dated OpenRouter build suffixes still stripped. - env YUNWU_MODEL_OPENAI -> YUNWU_MODEL_MOONSHOT; yunwu_probe pins kimi-k3. - training_cot: recover_openai_winner_cot -> recover_moonshot_winner_cot; the Kimi winner usually returns plaintext reasoning, so Fable CoT recovery is now a rare fallback (docstrings/metadata de-Sol'd; sol_winner_provider -> winner_provider). - Default providers ["anthropic","openai"] -> ["anthropic","moonshot"] across CLIs and multi_candidate. - Docs (README, CONTRIBUTING, .env.example) updated; historical CHANGELOG entries left intact as an accurate record. Breaking: gpt-5.6 / gpt-5.6-sol are no longer accepted teachers — bundles must be regenerated, and SparkDistill's teacher/providers.py must mirror the moonshot key. Tests: 355 pass; new test_kimi_k3_replaces_gpt_sol_as_second_teacher locks the swap.
This was referenced Jul 25, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Replaces the OpenAI GPT 5.6 Sol teacher with Moonshot Kimi K3 (
moonshotai/kimi-k3on OpenRouter,kimi-k3on yunwu). The pinned teacher pair is now Claude Fable 5 + Kimi K3.Why Kimi K3 (research)
On the published GPU-kernel-optimization benchmark, Kimi K3 performed competitively with Fable 5 and substantially outperformed GPT 5.6 Sol (and Opus 4.8 / GPT 5.5) at profiling, rewriting, and benchmarking CUDA/Triton kernels — it even ships its own Triton-like compiler, MiniTriton, and produced a kernel ~14.8× faster than optimized PyTorch on H200. For a Triton-kernel dataset generator, that kernel-optimization strength is exactly the axis that matters.
Sources: Tom's Hardware, Windows News (14× kernels), OpenRouter model page, Kimi K3 tech blog.
What changed (provenance-correct)
moonshotprovider (not Kimi masquerading asopenai), so the manifest's pinnedallowed_teachersrecords the true teacher.MOONSHOT_TEACHER_MODEL = kimi-k3.policy.py/gateways.py: model maps,SUPPORTED_PROVIDERS = {anthropic, moonshot}, yunwu/OpenRouter slugs. Kimi has no-sol-style variant, so the logical/routed slug distinction collapses to one slug; dated OpenRouter build suffixes are still stripped.YUNWU_MODEL_OPENAI→YUNWU_MODEL_MOONSHOT;sparkproof-yunwu-probepinskimi-k3.training_cot:recover_openai_winner_cot→recover_moonshot_winner_cot. Kimi returns plaintext reasoning, so the Fable CoT-recovery path is now a rare fallback (docstrings/metadata de-Sol'd;sol_winner_provider→winner_provider).["anthropic","openai"]→["anthropic","moonshot"]across the CLIs andmulti_candidate..env.exampleupdated. Historical CHANGELOG entries left intact as an accurate record of past releases.gpt-5.6/gpt-5.6-solare no longer accepted teacher models — existing Sol bundles will fail verification against the new policy and must be regenerated with the new pair.teacher/providers.pymust be updated to themoonshotprovider key to stay in sync (the policy comment references it).Tests
355 pass, ruff clean. New
test_kimi_k3_replaces_gpt_sol_as_second_teacherlocks the swap (Kimi pinned,openai/gpt-5.6-solrejected). ~24 files re-pointed to the new provider/model.