Training-free interpolation restores large-k diversity in Qwen2.5-7B
An engineer tested training-free linear weight interpolation between a base model and its RLVR-tuned reasoning model to recover generation diversity. The author found that mixing weights at specific alpha values successfully recovers the base model's large-k pass performance while retaining a significant portion of reinforcement learning gains. Open article →