feat: Arbitrary-Rank Ablation (ARA) - #211

Draft

p-e-w wants to merge 19 commits into

Commits on Feb 25, 2026

feat(ara): add methods for obtaining module I/O
p-e-w
committed
ea7c59a

Commits on Feb 27, 2026

feat(ara): implement matrix optimization
p-e-w
committed
154241f

Commits on Mar 2, 2026

feat(ara): implement optimization for ARA parameters
p-e-w
committed
b8f4a9c
feat(ara): fix memory leak
p-e-w
committed
3c5d692

Commits on Mar 4, 2026

Commits on Mar 5, 2026

feat(ara): optimize all parameters
p-e-w
committed
0bb9521

Commits on Mar 7, 2026

feat(ara): fix issues on some multi-GPU setups

p-e-w
and
kabachuha
committed
d79a443
fix(ara): store captured I/O tensors on CPU for multi-GPU robustness (#214)
joninco
authored
2bb203e

Commits on Mar 10, 2026

feat(ara): expand parameter ranges
p-e-w
committed
c76416f
feat(ara): add abliteration method to model card
p-e-w
committed
4a6304c

Commits on Mar 21, 2026

feat(ara): add option to optimize for PIQA instead of KLD
p-e-w
committed
c925f5e

Commits on Mar 30, 2026

Merge branch 'master' into ara
p-e-w
committed
988c6bd

Commits on Mar 31, 2026

feat(ara): add optional row-norm preservation
p-e-w
committed
f7a456b

Commits on Apr 1, 2026

fix(ara): set batch size on HFLM object
p-e-w
committed
3b70fe5

Commits on Jul 5, 2026

feat: ARA, but it's LoRA (#332)
kabachuha
authored
25979ad

Commits on Aug 17, 2026

fix(ara): free gradient buffers after optimization (#426)
coder3101
authored
edc3b12