Raw beam search favours short outputs, because every extra token adds a negative log-probability. Hugging Face's beam scorer divides the summed log-probability by a length penalty:
Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.
Start 7-day free trial