-
Notifications
You must be signed in to change notification settings - Fork 28
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
[feature] causal prefill: offer the cuDNN fused attention backend ahead of flash for head_dim=128 fp16
area:attentionExact and experimental attention implementations (attention/)Exact and experimental attention implementations (attention/)status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:featureMeasurable feature for the currently active benchmark phaseMeasurable feature for the currently active benchmark phaseStatus: Open.#344 In zeokin/Cuda-Compute-OSS;[feature] one-token decode fast path: skip FlashAttention's prefill-tuned tiling for q_len=1
area:attentionExact and experimental attention implementations (attention/)Exact and experimental attention implementations (attention/)status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:featureMeasurable feature for the currently active benchmark phaseMeasurable feature for the currently active benchmark phaseStatus: Open.#343 In zeokin/Cuda-Compute-OSS;[bug] local_window_attention: default query block grows with window — wide-window OOM
area:evalProtected evaluator, metrics, artifacts, and policy (eval/, benchmarks/)Protected evaluator, metrics, artifacts, and policy (eval/, benchmarks/)status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:bugBug report/fix; not an accepted miner PR laneBug report/fix; not an accepted miner PR laneStatus: Open.#317 In zeokin/Cuda-Compute-OSS;[bug] nystrom.basis: concatenate-all-parts doubles (n,m) VRAM — same assembly spike #308 fixed for rsvd
area:strategySmart strategies / transforms (strategy/)Smart strategies / transforms (strategy/)status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:bugBug report/fix; not an accepted miner PR laneBug report/fix; not an accepted miner PR lanetype:strategyNew smart strategy / transform proposalNew smart strategy / transform proposalStatus: Open.#315 In zeokin/Cuda-Compute-OSS;[docs] Config.transform docstring calls rsvd the only built-in, but nystrom is a built-in too
area:strategySmart strategies / transforms (strategy/)Smart strategies / transforms (strategy/)status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:docsDocumentation-only change; not an accepted miner PR laneDocumentation-only change; not an accepted miner PR lanetype:strategyNew smart strategy / transform proposalNew smart strategy / transform proposalStatus: Open.#312 In zeokin/Cuda-Compute-OSS;[bug] nystrom wastes M/4 of its budget on the redundant col(B) landmark block (3 spaces suffice, as rsvd/#91)
area:strategySmart strategies / transforms (strategy/)Smart strategies / transforms (strategy/)status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:bugBug report/fix; not an accepted miner PR laneBug report/fix; not an accepted miner PR lanetype:strategyNew smart strategy / transform proposalNew smart strategy / transform proposalStatus: Open.#269 In zeokin/Cuda-Compute-OSS;[strategy] power-iteration range finder: q subspace-iteration steps to beat rsvd on decaying spectra
area:evalProtected evaluator, metrics, artifacts, and policy (eval/, benchmarks/)Protected evaluator, metrics, artifacts, and policy (eval/, benchmarks/)area:strategySmart strategies / transforms (strategy/)Smart strategies / transforms (strategy/)status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:docsDocumentation-only change; not an accepted miner PR laneDocumentation-only change; not an accepted miner PR lanetype:strategyNew smart strategy / transform proposalNew smart strategy / transform proposalStatus: Open.#263 In zeokin/Cuda-Compute-OSS;[bug] eval CLI catches only RuntimeError, so unknown --transforms / bad --rank-m / --sweep dump an uncaught traceback (the #199/#201 gap, in
python -m eval)area:evalProtected evaluator, metrics, artifacts, and policy (eval/, benchmarks/)Protected evaluator, metrics, artifacts, and policy (eval/, benchmarks/)area:matmulExact engine and tile schedules (matmul/)Exact engine and tile schedules (matmul/)area:strategySmart strategies / transforms (strategy/)Smart strategies / transforms (strategy/)status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:bugBug report/fix; not an accepted miner PR laneBug report/fix; not an accepted miner PR lanetype:strategyNew smart strategy / transform proposalNew smart strategy / transform proposalStatus: Open.#258 In zeokin/Cuda-Compute-OSS;[strategy] sparse-sign (OSNAP) sketch transform: mix s columns/rows per basis vector for rsvd-level accuracy at near-nystrom cost
area:evalProtected evaluator, metrics, artifacts, and policy (eval/, benchmarks/)Protected evaluator, metrics, artifacts, and policy (eval/, benchmarks/)area:strategySmart strategies / transforms (strategy/)Smart strategies / transforms (strategy/)status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:strategyNew smart strategy / transform proposalNew smart strategy / transform proposalStatus: Open.#256 In zeokin/Cuda-Compute-OSS;[strategy] dct transform: fixed DCT-II basis for smooth / decaying-spectrum data
area:strategySmart strategies / transforms (strategy/)Smart strategies / transforms (strategy/)status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:bugBug report/fix; not an accepted miner PR laneBug report/fix; not an accepted miner PR lanetype:strategyNew smart strategy / transform proposalNew smart strategy / transform proposalStatus: Open.#191 In zeokin/Cuda-Compute-OSS;[strategy] subspace-iteration transform: power iterations for decaying (not low-rank) spectra
area:evalProtected evaluator, metrics, artifacts, and policy (eval/, benchmarks/)Protected evaluator, metrics, artifacts, and policy (eval/, benchmarks/)area:strategySmart strategies / transforms (strategy/)Smart strategies / transforms (strategy/)status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:strategyNew smart strategy / transform proposalNew smart strategy / transform proposalStatus: Open.#184 In zeokin/Cuda-Compute-OSS;[bug] adaptive_hybrid_attention leaks the future in causal mode: adaptive global branch has no causal path
status:triageNewly opened, not yet triagedNewly opened, not yet triagedtype:bugBug report/fix; not an accepted miner PR laneBug report/fix; not an accepted miner PR laneStatus: Open.#181 In zeokin/Cuda-Compute-OSS;