feat(trainer): KL penalty over unmasked tokens only#2458

samsja wants to merge 1 commit into

feat/dppo-diff-default-lossPrimeIntellect-ai/prime-rl:feat/dppo-diff-default-lossfrom

feat/dppo-kl-on-unmaskedPrimeIntellect-ai/prime-rl:feat/dppo-kl-on-unmaskedCopy head branch name to clipboard