Cline-Bench releases 47-task agent evaluation benchmark

cline.ghost.io22 min read

Cline-Bench evaluates 47 single-turn coding tasks to assess how well AI agents carry out real user requests across existing repositories. The benchmark measures models using pass@1 success rates, inference costs, runtime duration, and assistant turns while employing isolated verification environments to prevent test tampering. Open article →