Skip to content

feat(model-ports): add jamba_tiny_dev - #216

Open
DarthCeltic wants to merge 2 commits into
aifoundry-org:mainfrom
DarthCeltic:port-jamba-tiny-dev
Open

feat(model-ports): add jamba_tiny_dev#216
DarthCeltic wants to merge 2 commits into
aifoundry-org:mainfrom
DarthCeltic:port-jamba-tiny-dev

Conversation

@DarthCeltic

Copy link
Copy Markdown
Contributor

Adds ai21labs/Jamba-tiny-dev (319M, Apache-2.0) as a new model-port claim, introducing the Jamba execution family (hybrid Mamba+Transformer MoE, distinct from other hybrid families already on the board).

Self-converted GGUF (no pre-made quant exists for this checkpoint), published as a GitHub Release since no HF upload token is available. Locally verified: arch=jamba loads cleanly (16 layers, both recurrent-state and KV caches allocated as expected for the hybrid architecture), clean 1009-node compute graph, real PPL = 18.4574 +/- 3.82 against WikiText-2 (within this campaign's normal range).

Full provenance, conversion steps, and an honest note on verification tier (CPU-backend, not full ET-SoC1 sysemu — see recipe for why) in ported_models/jamba_tiny_dev/docs/RECIPE.md.

@DarthCeltic
DarthCeltic requested a review from AFOliveira as a code owner July 26, 2026 01:14
@github-actions github-actions Bot added track: model-ports Global approved model ports prize track: community Community support and ecosystem contributions labels Jul 26, 2026
@AFOliveira

Copy link
Copy Markdown
Member

The recipe honestly reports CPU-only verification. To receive model-port credit, Jamba still needs a real full-offload ET-SoC1 execution, a committed deterministic oracle/expected output with an explicit comparison threshold, and immutable release provenance. Host loading and CPU PPL alone are insufficient. Maintainers will then review/adopt the Jamba identity/contract and runner policy.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

track: community Community support and ecosystem contributions track: model-ports Global approved model ports prize

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants