Skip to content

feat(model-ports): add smollm3_3b, nemotron_mini_4b, apertus_8b, glm4_9b - #206

Open
DarthCeltic wants to merge 3 commits into
aifoundry-org:mainfrom
DarthCeltic:port-smollm3-nemotron-apertus-glm4-v2
Open

feat(model-ports): add smollm3_3b, nemotron_mini_4b, apertus_8b, glm4_9b#206
DarthCeltic wants to merge 3 commits into
aifoundry-org:mainfrom
DarthCeltic:port-smollm3-nemotron-apertus-glm4-v2

Conversation

@DarthCeltic

Copy link
Copy Markdown
Contributor

Adds smollm3_3b, nemotron_mini_4b, apertus_8b, and glm4_9b causal-LM ports to llama.cpp-et, with model-ports claims for each.

Full compliant shape from the start: model-ports claim (new standalone
root + submissions/model_ports/<model>.json), ordinary framework
registration (artifacts.json, benchmarks/<model>.json,
benchmark_config.json entry), and real host-CPU perplexity for all 4.

Built a plain CPU-only (GGML_ET=OFF) llama-perplexity from the same
vendored llama.cpp-et source (the ET-linked build hard-depends on
/opt/et/lib/esperanto-fw sysemu firmware not present outside the real
hackathon runner) and ran each GGUF against the board-pinned WikiText-2
corpus with the board's own ctx/batch/chunks params. All 4 load and
score cleanly: smollm3 12.3653, nemotron 10.5717, apertus 7.8747,
glm4 12.2894. All 4 confirmed as genuinely distinct GGUF-reported
execution families (arch=smollm3/nemotron/apertus/glm4), none seed,
none colliding with each other or prior claims in this campaign.

glm4_9b's GGUF was quantized under the source's former THUDM
namespace (now zai-org); the pinned revision is re-fetched from the
current zai-org repo, not guessed.
@DarthCeltic
DarthCeltic requested a review from AFOliveira as a code owner July 25, 2026 14:30
@github-actions github-actions Bot added track: model-ports Global approved model ports prize track: community Community support and ecosystem contributions labels Jul 25, 2026
DarthCeltic added a commit to DarthCeltic/hf-hackathon that referenced this pull request Jul 25, 2026
…, glm4_9b, nemotron_mini_4b, smollm3_3b

Each claim's benchmark_config must exactly match the model's "config"
pointer in .github/ci/benchmark_config.json per effective_model_config()
in model_port_claim.py, not the top-level benchmark_config.json path
itself. Fixes a mismatch that would fail eligibility validation.
@AFOliveira

Copy link
Copy Markdown
Member

For SmolLM3, Nemotron-mini, Apertus and GLM4 model-port credit, please add committed deterministic oracle evidence and successful full-offload ET-SoC1 runs for each claimed model. Host loading/PPL alone is insufficient. The protected tracker still needs maintainer-owned identities/contracts and approval of the llama_server validation path.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

track: community Community support and ecosystem contributions track: model-ports Global approved model ports prize

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants