MOLT is a thermally aware, memory-efficient QLoRA fine-tuning tool for consumer NVIDIA GPUs on Windows, enabling local language model fine-tuning with hardware telemetry and thermal controls. Version 0.12.0 includes experimental optimizations for low-overhead update attribution and thermal pacing, with installation via a single PowerShell command and support for Windows 10/11 with Python 3.12.
A researcher at AI2 describes their transition from quantization research to coding agents, detailing how a small team of five researchers and 32 GPUs developed Sera, a method to finetune large language models on private codebases for efficient coding agent deployment. The work eventually scaled to 96 GPUs and enables cheap specialization of models rivaling larger teacher models on private data.