In this project we built a sentence VAE using the Transformer encoder-decoder architecture presented in "Attention Is All You Need" by Vaswani, Ashish, et al.

Implementation of a self-made Encoder-Decoder Transformer in PyTorch (Multi-Head Attention is implemented too), inspired by "Attention is All You Need." Primarily designed for Neural Machine ...

On this basis, we introduce the Transformer encoder-decoder architecture to expand the size of receptive ... Transformer is used to realize the detection of glass objects in the Pytorch environment, ...