feat(cuda): add resilient native and grouped GEMM dispatch - #1440

Open

ppodolsky wants to merge 8 commits into

tracel-ai:mainfrom

ppodolsky:feat/cublaslt-gemm-dispatch

Commits on Aug 1, 2026

Add asynchronous cuBLAS BF16 GEMM dispatch
ppodolsky
committed
55acb45
Harden accelerated GEMM contracts
ppodolsky
committed
1e62e7e
Route the accelerated GEMM dispatch through cublasLt
ppodolsky
committed
bb7961e
Fix allocation retry after cached-page OOM
ppodolsky
committed
d840eb7
feat(cuda): add native grouped GEMM dispatch
ppodolsky
committed
43eef09
feat(runtime): expose nonblocking dispatch queue flush
ppodolsky
committed
dcdb2b7
fix(cuda): follow environment module migration
ppodolsky
committed
45ed466
Revert "feat(runtime): expose nonblocking dispatch queue flush"
ppodolsky
committed
c0efe74