Skip to content

v1.2.9 BPE speed boost & small improvements

Compare
Choose a tag to compare
@Natooz Natooz released this 06 Oct 15:06
· 364 commits to main since this release

Changes

  • 212a943 BPE: Speed boost in apply_bpe method, about 1.5 times faster 🚀
  • 4b8ccb9 BPE: tokens_to_events method is not longer inplace
  • be3e244 save_tokens method now takes **kwargs arguments to save additional information in json files
  • b690cab fix when computing max_tick attribute of a MIDI, when it have tracks with no notes
  • f1855b6 MidiTok package version is now saved with tokenizer parameters. It allows to keep track of the version used.
  • Lint and coverage improvements ✨

Compatibility

  • If you explicitly used tokens_to_events, you might need to do an adaptation as it is no longer inplace.