-
Notifications
You must be signed in to change notification settings - Fork 13
Timestamp aware RoPE #62
Copy link
Copy link
Open
Labels
Description
shahbuland
opened on Sep 8, 2025
Issue body actions
- Make RoPE frequencies that represent temporal position based on framerate/timestamps
- Should allow framerate agnostic training
- Add mixed framerate training with this (i.e. if we have 60fps training footage, it should be resampled to 10fps,20fps,30fps,etc. with frame-skipping (not with keeping all frames and "slowing" or "speedup"
Reactions are currently unavailable