A developer questions why complex document formats aren't loaded via OS memory-mapping instead of parsing, describing their 2000s Java-based office suite that used 3D coordinate storage to open 50,000-page documents in 8 seconds. They explore using memory-mapped files with OpenJDK and CRaC to eliminate parsing overhead entirely, but encounter JVM runtime complications.
Jinfer is an AI inference engine for the JVM that enables running large language models, text-to-speech, audio transcription, and vision capabilities directly on Java using a modular, composable architecture. Distributed as lightweight dependencies, it allows developers to build AI applications with jbang scripts without external services.
JEP 544 introduces ahead-of-time (AOT) code compilation for Java's HotSpot JVM to improve startup and warmup times by pre-compiling application code to native code during a training run and caching it for production use. The system dynamically regenerates native code if workloads change, combining AOT and JIT compilation benefits without requiring application code changes or new workflows.