210216 Non-Autoregressive Text Generation with Pre-trained Language Models.md

https://arxiv.org/abs/2102.08220

Non-Autoregressive Text Generation with Pre-trained Language Models (Yixuan Su, Deng Cai, Yan Wang, David Vandyke, Simon Baker, Piji Li, Nigel Collier)

놓친 논문인데...non autoregressive generation 방법으로서 흥미롭군요. crf를 붙이고 새로운 디코딩 방식을 사용했네요.

#non-autoregressive #language_model #text_generation