Cline-Bench releases 47-task agent evaluation benchmark
Cline-Bench evaluates 47 single-turn coding tasks to assess how well AI agents carry out real user requests across existing repositories. The benchmark measures models using pass@1 success rates, inference costs, runtime duration, and assistant turns while employing isolated verification environments to prevent test tampering. Open article →