Knobs to spin:
Max new tokens:
Num beams:
(must be divisible by num_beam_groups)
Num beam groups:
No repeat ngram size:
Length penalty:
Diversity penalty:
Repetition penalty