feat(model-ports): add jamba_tiny_dev - #216
Open
DarthCeltic wants to merge 2 commits into
Open
Conversation
Member
|
The recipe honestly reports CPU-only verification. To receive model-port credit, Jamba still needs a real full-offload ET-SoC1 execution, a committed deterministic oracle/expected output with an explicit comparison threshold, and immutable release provenance. Host loading and CPU PPL alone are insufficient. Maintainers will then review/adopt the Jamba identity/contract and runner policy. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
ai21labs/Jamba-tiny-dev(319M, Apache-2.0) as a new model-port claim, introducing the Jamba execution family (hybrid Mamba+Transformer MoE, distinct from other hybrid families already on the board).Self-converted GGUF (no pre-made quant exists for this checkpoint), published as a GitHub Release since no HF upload token is available. Locally verified: arch=jamba loads cleanly (16 layers, both recurrent-state and KV caches allocated as expected for the hybrid architecture), clean 1009-node compute graph, real PPL = 18.4574 +/- 3.82 against WikiText-2 (within this campaign's normal range).
Full provenance, conversion steps, and an honest note on verification tier (CPU-backend, not full ET-SoC1 sysemu — see recipe for why) in
ported_models/jamba_tiny_dev/docs/RECIPE.md.