Permute Q/K at conversion, use ggml_rope_ext #8

Job	Run time
windows (x64-vulkan, x64, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN_FILE=cmake/x64-windows-llvm....	8m 41s
ubuntu (arm64, ubuntu-24.04-arm)	3m 8s
windows (x64-cpu-static, x64, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN_FILE=cmake/x64-windows-l...	8m 30s
windows (x64-openblas, x64, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN_FILE=cmake/x64-windows-llv...	8m 36s
windows (arm64, arm64, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN_FILE=cmake/arm64-windows-llvm.c...	5m 43s
ubuntu (x64, ubuntu-22.04)	3m 26s
build-cmake-pkg / linux	13m 51s
	51m 55s

Navigation Menu