Skip to content

puklkit007/Decoding_methods_for_natural_language_generation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

Decoding_methods_for_natural_language_generation

• Validated claims made in the paper The Curious Case Of Neural Text DeGeneration (https://arxiv.org/pdf/1904.09751.pdf).

• Explored text generation coherence and diversity for top-p (nucleus sampling), beam search and pure sampling.

• Applied aforementioned decoding strategies on a pretrained transformer-based GPT2 model to depict superior performance of nucleus sampling.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published