A developer created a tool called 'reroll' that generates LLM responses five times to test consistency and analyze variation patterns. The tool uses Haiku to categorize differences—whether answers are uniform, mostly uniform, split, or highly divergent—and identifies whether variations stem from different interpretations, different next moves, or contradictions that suggest hallucinations.