From 2018 to 2022, language models exhibited emergent capabilities including natural language understanding, translation, arithmetic, code generation, and instruction-following. These abilities arose unexpectedly without task-specific training, with performance improving dramatically as model scale increased.