elineve's picture
Upload 301 files
07423df
raw
history blame
278 Bytes
Determines whether to sample from the next token distribution instead of choosing the token with the highest probability. If turned **On**, the next token in a predicted sequence is sampled based on the probabilities. If turned **Off**, the highest probability is always chosen.