Beam Search Decoding With Configurable Search Width And Length Normalization

via “beam-search-decoding-with-length-penalty”

translation model by undefined. 3,88,860 downloads.

Unique: Implements standard T5 beam search with length normalization to address the length bias problem in sequence-to-sequence models; integrates with HuggingFace generate() API for configurable beam_width, num_beams, and length_penalty parameters

vs others: Produces higher-quality translations than greedy decoding at the cost of latency; more practical than exhaustive search while maintaining reasonable quality-latency tradeoffs