source&pool
A daily wire of long-form journalism, video, and discourse — filed, tagged, and laid out flat.
VOL. I·NO. 01
FRIDAY, OCTOBER 9, 2026
  1. 001Hacker NewsOCT · 08English

    Vosti: Specifying, Implementing, and Verifying Deterministic LLM Inference

    Vosti is a formally verified LLM inference engine that ensures deterministic outputs by producing bitwise-identical logits across different execution variations. The system addresses limitations in production systems like vLLM and SGLang by formalizing deterministic inference specifications and proving correctness through decomposed proofs at the engine and GPU kernel boundaries.

    By Qin; Jianxing; Du; Alexander; Zhang; Danfeng; Lentz; Matthew; Zhuo; Danyang