https://arxiv.org/pdf/2105.04553.pdf
Self-Supervised Learning with Swin Transformers (Zhenda Xie, Yutong Lin, Zhuliang Yao, Zheng Zhang, Qi Dai, Yue Cao, Han Hu)
요즘은 모델을 만들면 self supervision으로 학습시켜보는 것이 정석이죠.
#vision_transformer #contrastive_learning