The decoder, however, receives a masked version of the output string, one word at a time, and tries to establish the mappings between the encoded attention vector and the expected outcome.

The encoded representations—often called embeddings or feature vectors—typically reduce raw input data by orders of magnitude (e.g., a 1080p video frame of 2.1 million pixels might be ...