https://arxiv.org/abs/2012.13915
SG-Net: Syntax Guided Transformer for Language Representation (Zhuosheng Zhang, Yuwei Wu, Junru Zhou, Sufeng Duan, Hai Zhao, Rui Wang)
이쪽도 트랜스포머 attention에 syntax를 결합.
[[201227 Syntax-Enhanced Pre-trained Model]]
#syntax #transformer #attention