Skip to content

Investigate and surface status of PR #5 (M4 training script)#6

Draft
Copilot wants to merge 1 commit intocopilot/implement-smoke-test-upgradesfrom
copilot/check-pull-request-status
Draft

Investigate and surface status of PR #5 (M4 training script)#6
Copilot wants to merge 1 commit intocopilot/implement-smoke-test-upgradesfrom
copilot/check-pull-request-status

Conversation

Copy link
Copy Markdown

Copilot AI commented Apr 3, 2026

PR #5 ("Update training script for local development on M4 MacBook Air") was opened with only a plan commit — zero code changes merged. All 11 checklist items remain unimplemented.

Findings

PR #5 state:

  • Branch: copilot/implement-smoke-test-upgrades
  • Commits: 1 ("Initial plan") — no files changed
  • All checklist items unchecked

Outstanding work in PR #5

  • Section 0 — M4/MPS device detection, DDP bypass, MPS-safe autocast, drop fused=True on AdamW
  • Section 1SparseMoEMLP (top-k gating, aux load-balance loss) + Block integration
  • Section 2CurriculumTokenLoader (easy-to-hard shard ordering, CURRICULUM_FRAC)
  • Section 3ValueEmbedding (token identity reinjection into late-layer V, VALUE_EMBED_LAYERS)
  • Section 4IBPhaseMonitor (gradient-norm ratio fitting/compression phase detector)
  • Section 5check_router_health watchdog (MoE load-collapse detection)
  • Section 6fake_quant_ternary + pack_ternary_np/unpack_ternary_np (base-3 packing, ~1.58 bits/weight)
  • Section 7artifact_size_guard (hard budget check + 500KB warning threshold)
  • Optimizer split updates for new param groups (router, value_embedding.*)
  • Smoke-test summary line at startup

No changes have been committed to the repository as part of this investigation.

@kailean
Copy link
Copy Markdown
Owner

kailean commented Apr 3, 2026

continue

Copilot AI changed the title [WIP] Check status of pull request #5 Investigate and surface status of PR #5 (M4 training script) Apr 3, 2026
Copilot AI requested a review from kailean April 3, 2026 20:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants