Verify, Then Vote — Grainulation Blog

Researchers tested a verification method called Verify, Then Vote, which uses a hosted model to check the cited sources of answers from five local models and applies a fixed rule to break ties. Tested on 1,000 questions, the approach raised majority-vote accuracy from 77.1% to 85.0% by checking whether passages supported the answers. The authors found that keeping answers that already had a supported source further improved performance while keeping error rates within set limits. Open article →