Verdict is an open-source, self-hosted alternative to Typesafe's Jev system that runs on existing Llama servers. It answers multiple-choice questions by reading model logits at a single position rather than generating text, providing deterministic results with confidence signals called option mass.
Mini-Jev demonstrates an alternative to grammar-constrained JSON generation for structured classification on frozen language models. Instead of generating JSON tokens, the method reads next-token logits to classify against schema fields as multiple-choice options, achieving comparable quality while reducing decode costs on Qwen3-4B.