Skip to content

Port Trinity-Nano-Base (afmoe) - #222

Open
DarthCeltic wants to merge 2 commits into
aifoundry-org:mainfrom
DarthCeltic:port-trinity-nano
Open

Port Trinity-Nano-Base (afmoe)#222
DarthCeltic wants to merge 2 commits into
aifoundry-org:mainfrom
DarthCeltic:port-trinity-nano

Conversation

@DarthCeltic

Copy link
Copy Markdown
Contributor

Summary

  • Adds arcee-ai/Trinity-Nano-Base to the most_models_ported track (identity afmoe), introducing the Afmoe execution family to the board — Arcee AI's Trinity model line (fine-grained MoE, 56 layers, 128 experts / 8 active + 1 shared, 131K context via sliding-window + full attention mix, 6.12B total params).
  • No converter fix was needed: AfmoeForCausalLM is already a correctly-registered architecture class in this repo's convert_hf_to_gguf.py, so this converted cleanly on the first attempt with the stock, unmodified converter — same clean-conversion category as the earlier smallthinker port.
  • Self-converted to Q8_0 GGUF (1057 tensors, 6.52 GB, sha256=a52296d493fbdb810008a638eda4ce7f59717ddd4282ba2750518c7cefd36872), hosted on Hugging Face (darthceltic85/trinity-nano-base-gguf) since it exceeds GitHub's 2 GB release-asset limit.
  • License is OpenMDW-1.1, a genuinely permissive open license — confirmed by reading the actual LICENSE file in the source repo rather than assumed from the license: other tag.
  • Verified live: model loads cleanly on the CPU backend (arch = afmoe, 128 experts / 8 used, sliding-window + full attention layer mix, fused Gated Delta Net enabled, 4223-node compute graph, 1 split) and real llama-perplexity against WikiText-2 raw gives PPL = 10.5908 +/- 1.92727 — a good, in-range result.

Test plan

  • benchmark_config in the claim JSON exactly matches .github/ci/benchmark_config.json's new trinity_nano_base entry
  • Source revision is a valid 40-char hex commit SHA
  • RECIPE.md exists and honestly documents that no converter fix was required
  • All new/modified JSON files are valid JSON
  • Model loads and produces a real, in-range perplexity result (not fabricated)

Adds arcee-ai/Trinity-Nano-Base to the most_models_ported track,
introducing the Afmoe execution family to the board (Arcee AIs Trinity
model line, fine-grained MoE, 128 experts / 8 active + 1 shared, 6.12B
total params).

No converter fix was needed -- AfmoeForCausalLM is already a correctly
registered architecture class, so this converted cleanly on the first
attempt with the stock, unmodified convert_hf_to_gguf.py.

PPL = 10.5908 +/- 1.92727 on WikiText-2 raw, confirmed via a real
llama-perplexity run on CPU backend. GGUF (6.52 GB) hosted on Hugging
Face (darthceltic85/trinity-nano-base-gguf) since it exceeds GitHubs
2GB release-asset limit. License is OpenMDW-1.1, a genuinely permissive
open license confirmed by reading the actual LICENSE file.
@DarthCeltic
DarthCeltic requested a review from AFOliveira as a code owner July 26, 2026 07:55
@github-actions github-actions Bot added track: model-ports Global approved model ports prize track: community Community support and ecosystem contributions labels Jul 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

track: community Community support and ecosystem contributions track: model-ports Global approved model ports prize

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant