https://arxiv.org/abs/2112.09133
Masked Feature Prediction for Self-Supervised Visual Pre-Training (Chen Wei, Haoqi Fan, Saining Xie, Chao-Yuan Wu, Alan Yuille, Christoph Feichtenhofer)
mask prediction + hog feature. 마스킹된 입력을 주고 hog feature를 예측하도록 모델 학습. fair에서 이미 이것저것 다 해본 것 같군요.
#self_supervised #pretraining