Magnitude is an open-source inference engine that optimizes itself for your hardware, enabling open models to run up to 2x faster than llama.cpp by compiling and tuning kernels on your device. It works across Apple Silicon, NVIDIA, AMD, and CPU-only systems, integrates with popular agents like Pi and Codex, and keeps all data private and offline.