Skip to content
CI (CUDA, ubuntu)

fix: allow mixed turbo/q8_0 KV cache types in CUDA flash-attention selection #12

Sign in to view logs

fix: allow mixed turbo/q8_0 KV cache types in CUDA flash-attention selection

fix: allow mixed turbo/q8_0 KV cache types in CUDA flash-attention selection #12

Run time

Learn about OS pricing on GitHub Actions
Job Run time
hip
20m 27s
cuda
18m 38s
musa
32m 5s
1h 11m 10s