A developer explores encoding country flags in just 11 bits by breaking them down into common design elements like stripes, shapes, and colors. Using a layered approach inspired by matrix compression and image editing software, the encoding scheme prioritizes recognizability over exact accuracy, handling aspect ratios, color palettes, and repeated elements like stars and crescents.
TurboCrypt is switching from Base91 to Base84 encoding for encrypted file names to support Windows alongside Unix systems. Base84 uses 84 filesystem-safe ASCII characters that work across Linux, macOS, and Windows, achieving about 25% expansion on random input while avoiding Windows-reserved device names.
A 2023 computer science paper demonstrates that language model tokenizers create unfairness across languages by producing drastically different tokenization lengths for the same text translated into different languages—up to 15 times longer in some cases. These disparities affect cost, processing time, and context length for commercial language services, persisting even in intentionally multilingual tokenizers. The authors argue for developing multilingually fair subword tokenizers for future language models.