NobodyWho is an inference engine for running large language models locally and offline across multiple platforms including Android, iOS, and desktop. It supports various LLMs in GGUF format with features like multimodal input, text-to-speech, speech-to-text, and GPU acceleration via Vulkan or Metal. The tool provides SDKs for Kotlin, Swift, Python, Flutter, React Native, Expo, and Godot.
A developer chose Laya, an open-weight decision model, over TypeSafe's hosted Jev service for a coding agent's small classification tasks. Laya runs locally on a Mac Studio with privacy and control benefits, while Jev offers a managed API with lower operational overhead but higher costs and less customization.