Skip to content

chore(llm): update Burn and Cube accelerator stack - #129

Merged
ppodolsky merged 3 commits into
mainfrom
audit-llm-code-and-repos
Aug 1, 2026
Merged

chore(llm): update Burn and Cube accelerator stack#129
ppodolsky merged 3 commits into
mainfrom
audit-llm-code-and-repos

Conversation

@ppodolsky

Copy link
Copy Markdown
Contributor

Summary

The legality split fixes a reproducible A100 failure where an async-copy matmul selected for an aligned tensor was cached and reused for an incompatible unaligned tensor. The later Burn fusion-ordering panic was a consequence of that first failed launch.

All Cargo files submitted to the upstream dependency PRs reference only tracel-ai/* repositories. This repository's root patch table temporarily resolves the fork PR heads and can be removed as each upstream PR merges.

Validation

  • cargo check -p hermes-train --features cuda
  • CubeCL runtime and CUDA-example checks
  • CubeK matmul-key regression tests plus attention checks
  • Burn CUDA check plus accelerated-GEMM contract tests
  • A100 exact-head smoke on the 299,929,088-parameter MoE model: five optimizer steps completed, loss 10.923190 → 10.607383, final throughput 41,997 tokens/s
  • two order-reversed 130-step A/B pairs showed that explicitly flushing CubeCL's client dispatch queue regressed throughput by 0.254% (42,104.8 → 41,998.0 tokens/s), so that candidate and its API were removed

No model architecture, training data, curriculum, or checkpoint format changes are included.

@ppodolsky
ppodolsky merged commit e88bf1d into main Aug 1, 2026
9 checks passed
@ppodolsky
ppodolsky deleted the audit-llm-code-and-repos branch August 1, 2026 09:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant