What about RotorQuant

[fire17]

Hi there!
Looks really awesome,
But I'm wondering why this is based on TurboQuant when
RotorQuant was outperforming it by a lot, as far as I'm aware

So basically we should do RotorVec

Have you seen RotorQuant?
Let me know

Thanks and all the best!

[RyanCodrai]

@fire17

Hi! Thanks for opening an issue :)

RotorQuant claims to outperform TurboQuant only on speed. Compression and recall are actually the same.

TheTom/turboquant_plus#34 (comment)

Here is a good discussion of why RotorQuant is not as efficient overall as other methods for optimising TurboQuant.

In this project we have hand-tuned operations written in rust that perform extremely well on CPU.

This has made me wonder if we can squeeze additional performance by implementing the Walsh–Hadamard Transform though.