GoKawiilExplainer details math behind the Softmax function and its derivative
A technical post explains the Softmax function, which converts an N-dimensional vector of real numbers into another N-dimensional vector of values between 0 and 1 that sum to 1. Using worked numeric examples, it shows how Softmax acts as a smoothed version of the maximum function, giving the largest input a disproportionately larger share of the output while still assigning smaller shares to other elements.