Researchers introduce TLAPS-Bench for TLA+ proof automation
Researchers and developers introduced TLAPS-Bench and the Tilapia harness to evaluate how effectively AI models can carry out complex TLA+ proof obligations for real-world distributed system specifications. In evaluations, the best-performing models completed less than half of the benchmark's hardest targets, revealing significant room for improvement in automated formal verification. Open article →