Entropy & Cross-Entropy

Entropy, cross-entropy, and KL — why confident wrong guesses cost more than MSE, and how CE relates to train loss.

• Foundations
• Vector Math
• Matrix Multiply
• Inverse Matrix
• Eigenvalues & Eigenvectors
• SVD & Orthogonality
• Derivatives

KousKrab — interactive ML simulations in the browser.