Encoder-only and Encoder-Decoder variants have been particularly effective for use cases where we finetune a pretrained model for a specific downstream task (s). However, when it comes to zero-shot ...

While pretrained encoders have achieved success in various natural language understanding (NLU) tasks, there is a gap between these pretrained encoders and natural language generation (NLG). NLG tasks ...