2 Matching Annotations
  1. Jan 2022
    1. While in BERT the de-coder can be trivial (an MLP) [14], we found that for im-ages, the decoder design plays a key role in determining thesemantic level of the learned latent representations.

      Impact of semantic information on the channel?