Skip to content
Server

fix: allow mixed turbo/q8_0 KV cache types in CUDA flash-attention selection #12

Sign in to view logs

fix: allow mixed turbo/q8_0 KV cache types in CUDA flash-attention selection

fix: allow mixed turbo/q8_0 KV cache types in CUDA flash-attention selection #12

Run time

Learn about OS pricing on GitHub Actions
Job Run time
windows
20m 18s
ubuntu
17m 9s
37m 27s