Self-distillation for video

[isacciobota]

Is self-distillation only implemented for image processing model? videomamba_distill.py is only in the image_sm/models folder. I would like to use videoMamba as a backbone for video 3D pose estimation but not sure if self-distillation works for video.

[Andy1621]

Hi! I only use self-distillation for image classification to avoid the overfitting issues, since it runs normal for video tasks.

[YCHYZW]

Can you provide pre-training weights for clip in single-modal video training?