Skip to content

feat(model-ports): add granite4_h_micro - #209

Open
DarthCeltic wants to merge 3 commits into
aifoundry-org:mainfrom
DarthCeltic:port-granite4-h-micro
Open

feat(model-ports): add granite4_h_micro#209
DarthCeltic wants to merge 3 commits into
aifoundry-org:mainfrom
DarthCeltic:port-granite4-h-micro

Conversation

@DarthCeltic

Copy link
Copy Markdown
Contributor

Adds granite4_h_micro causal-LM port to llama.cpp-et, with a model-ports claim.

Full compliant shape (claim + framework registration + real host-CPU
perplexity). Built a plain CPU-only (GGML_ET=OFF) llama-perplexity
from the vendored source, ran against the board-pinned WikiText-2
corpus. Loads and scores cleanly (PPL 13.2058), allocating both a
small transformer KV cache (4 layers) and a larger recurrent SSM
state cache (40 layers) -- IBM's fourth-gen Granite hybrid
architecture, arch=granitehybrid, distinct from both dense granite
and granitemoe already on this board. Third SSM/hybrid data point
this campaign (after mamba_1_4b, falcon_h1_1_5b).

Also checked falcon-mamba-7b-instruct: resolves to plain arch=mamba,
not a distinct family -- same execution family as mamba_1_4b already
claimed, so no additional claim filed for it (same pattern as
baichuan2/internlm3 resolving to llama earlier in this campaign).
@DarthCeltic
DarthCeltic requested a review from AFOliveira as a code owner July 25, 2026 15:59
@github-actions github-actions Bot added track: model-ports Global approved model ports prize track: community Community support and ecosystem contributions labels Jul 25, 2026
DarthCeltic added a commit to DarthCeltic/hf-hackathon that referenced this pull request Jul 25, 2026
…_micro

Each claim's benchmark_config must exactly match the model's "config"
pointer in .github/ci/benchmark_config.json per effective_model_config()
in model_port_claim.py, not the top-level benchmark_config.json path
itself. Fixes a mismatch that would fail eligibility validation.
@AFOliveira

Copy link
Copy Markdown
Member

For Granite4-H model-port credit, please add a committed deterministic oracle/expected output and a successful full-offload ET-SoC1 run, not only host loading/PPL. After that evidence passes review, maintainers still need to adopt the execution-family identity/contract and approve the llama_server validation path.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

track: community Community support and ecosystem contributions track: model-ports Global approved model ports prize

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants