Skip to content

sparse V: skip negligible attention weights across all backends #98

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
TheTom wants to merge 1 commit into
base: feature/turboquant-kv-cache
Choose a base branch
from
+10 −7

sparse V: skip negligible attention weights across all backends

70d3e95
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

sparse V: skip negligible attention weights across all backends #98

sparse V: skip negligible attention weights across all backends
70d3e95
Select commit
Loading
Failed to load commit list.
ubuntu-24-vulkan-llvmpipe
succeeded Apr 21, 2026 in 15m 37s