ArtifactBench is a new evaluation framework for AI-generated music detectors that accounts for distribution shifts, generator lineage, and real-world audio variations. The benchmark reveals significant performance gaps across detectors, with ArtifactNet achieving 0.982 AUROC while public detectors like Deezer's drop to 0.761 under shifted conditions.