Temperature
Definition
A parameter scaling token probability distributions during inference, controlling output randomness/creativity.
Example Case
Setting temperature to 0.0 for deterministic code output.
A parameter scaling token probability distributions during inference, controlling output randomness/creativity.