Please enable JavaScript.
Coggle requires JavaScript to display documents.
Response Diversity (Modifying Beam Search (:check:Generating Long and…
Response Diversity
Modifying Beam Search
:check:A Simple, Fast Diverse Decoding Algorithm for Neural Generation
-
-
-
-
-
-
-
-
-
-
Diversity
Sequence to Backward and Forward Sequences: A Content-Introducing Approach to Generative Short-Text Conversation
-
-
-
-
Observations
However, as observed empirically by us and (Li et al. 2015), initial words tend to disproportionately impact the diversity of the resulting sequences – suggesting that later words may not be important for inducing diversity.
Shao et al. (2016) find that in response generation, standard beam search works well for short responses but deteriorates as the sequence gets longer, while Vijayakumar et al. (2016) argue in image caption generation that diverse decoding is beneficial for images with many objects, but not images with few objects
