Softmax Temperature Scaling
Warm-upDerivationsoftmaxtemperatureprobability
Related module: Learning from data and backpropagation
Problem statement
The softmax function with temperature is:
- What happens as ?
- What happens as ?
- For logits , compute the softmax output for and .