NVIDIA/SkillEvaluator: Framework for evaluating AI agent skills
NVIDIA has released SkillEvaluator, a multi-tier framework for evaluating AI agent skills through quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent testing. The framework offers a CLI to run static checks, model-backed rubric evaluations via NVIDIA Build, and sandboxed live agent evaluations to measure how skills affect task results. It is available under the Apache License 2.0 with experimental support. Open article →