A high-performance LLM serving scheduler written in Rust achieves 191k tokens/second on a single vCPU using continuous batching, paged KV cache allocation, and lock-free scheduling. The repository includes formal SMT Z3 mathematical verification, an independent anti-cheat auditor, and a reproducible benchmark harness under strict hardware isolation.
SmarterPlaylists, a visual programming tool for creating custom Spotify playlists, ran for a decade as a side project launched July 25, 2015, accumulating 262,000 logged-in users who created 278,600 programs and executed them over 9 million times. The service demonstrated strong organic adoption driven by word-of-mouth, with a scheduler feature enabling over 50,000 automated playlist updates still active at shutdown, and a power-law user distribution where the top 0.2% of users were prolific creators.
A tutorial on building a minimal concurrency scheduler from scratch using single-threaded deterministic execution. The article uses a bakery POS system as a practical example to demonstrate how concurrent tasks can be managed without actual parallelism or I/O operations.