Softmax (Multinomial) Regression

Logistic regression handles two classes. Softmax regression extends it to $C$ classes with a weight matrix $W$ of shape (d, C) and bias $b$ of shape (C,): $P(y = c \mid x) = \text{softmax}(xW + b)_c$.