Alternate simpler fix for jailbreak model loading issue - #75
Conversation
|
This fix also includes a self-test that ensures the correct model parameters are saved. This was verified by fine tuning a model and verifying that the model parameters saved are the same as the original ones without the torch compile prefixes as seen in the output of training below. {'train_runtime': 131505.762, 'train_samples_per_second': 81.284, 'train_steps_per_second': 3.695, 'train_loss': 0.0005007739498931483, 'epoch': 10.0} ==================================================
|
2af71d6 to
97d8985
Compare
|
Someone with admin privileges needs to address the workflow permissions error (Owner Notification ...), I believe. |
/cc @rootfs |
Strip _orig_mod when saving instead of during retrieval as done in prior fix attempt
Alternate fix for #54