Matrix calculus is unnecessary for machine learning and tensor differentiation. Instead of learning complex matrix calculus rules, physicists discovered a simpler approach: write out index notation and use ordinary differentiation, which is faster, more intuitive, and always works.