Hospital-bench: New Agent Benchmark for Hospital Operations
Hospital-bench, a new agent benchmark from zavoai, tests AI agent performance on hospital operations workflows such as coverage checks, claims, and records requests within a simulated health system. In evaluations across 48 tasks, models struggled with safety challenges like disclosing restricted patient records and acting beyond their authority, highlighting ongoing difficulties in executing complex multi-system workflows reliably. Open article →