Information Gain

Information gain step lessons — parent frequencies → H(parent) → feature split → weighted children → IG; bars and mini-tree optional. How decision trees pick splits.

• Foundations
• Vector Math
• Matrix Multiply
• Inverse Matrix
• Eigenvalues & Eigenvectors
• SVD & Orthogonality
• Derivatives

KousKrab — interactive ML simulations in the browser.