A system sonifies transformer audio encoder attention by playing back audio sections that attention heads focus on, mimicking tape head playback. The author tested this on models like wav2vec 2.0, HuBERT, and MuQ across various audio inputs, revealing patterns in how transformers process audio while acknowledging the sonification is exploratory rather than musical.