Facts Behind Encoder and Decoder Models!