Claude's tokenizer uses a proprietary minimum-piece tokenization scheme rather than standard BPE, with vocabulary sizes around 49-55k for v3-v4.6 and 16-20k after. Key innovations include boundary markers wrapping word and punctuation spans, space-efficient encoding where spaces between marked boundaries are removed, and capitalization handling via shift markers for title-case and all-caps text.