The Apple M4 chip in the 2024 iPad Pro is the first public device supporting ARM's scalable matrix extension (SME), enabling direct low-level programming of matrix hardware for improved performance in scientific and machine learning tasks. A researcher has created microbenchmarks to explore M4 SME capabilities, measuring compute throughput and memory transfer rates across various matrix and vector operations.
AMD Helios is a GPU platform for AI with 432 GB of HBM4 memory and 40 PFLOPs of FP4 compute. This post presents an educational ladder of BF16 GEMM kernel implementations that progressively optimize for Helios's architectural features, including partitioned LDS, simplified cache hierarchy, and 32-thread waves.