We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 980c623 commit 085dd96Copy full SHA for 085dd96
Readme.md
@@ -51,6 +51,7 @@ HQQLinear.set_backend(HQQBackend.PYTORCH_COMPILE) #Compiled Pytorch via dynamo
51
HQQLinear.set_backend(HQQBackend.ATEN) #C++ Aten/CUDA backend (set automatically by default if available)
52
```
53
The ```HQQBackend.ATEN``` backend is automatically installed and used by default when available.
54
+Note that ```HQQBackend.ATEN``` only supports `axis=0`. For `axis=1` you ned to use ```HQQBackend.PYTORCH``` or ```HQQBackend.PYTORCH_COMPILE```.
55
56
Below you can find the speed-up benchmark with various backends, ```HQQBackend.PYTORCH``` being the baseline:
57
0 commit comments