Looking forward to these results!
#1
by
sometimesanotion
- opened
I have been eager to see what expert mergers who use layer analysis and careful methods could make of a recipe including Lamarck v0.6. I re-added Lamarck v0.3's weights to some of the layers of v0.6, and your EvolMerge was a big part of v0.3's recipe. It's very cool how you, Sthenno, and I are recombining the finetunes.
Your Wernicke-SFT is second for MATH only to Krystalan/DRT-o1-14B in this parameter class, which I included in my merge. I suspect there'll be synergy if their influences combine.