jackulau/coding.sh: Local tool for recording and evaluating AI coding agents

github.com7 min read

coding.sh is a local tool that records, measures, and evaluates AI coding agent sessions, tracking prompts, model and tool calls, file changes, and costs. Running locally with session data stored in SQLite, it provides a CLI, local viewer, and MCP server to turn failures into evals and run benchmarks. The tool is MIT licensed and operates without a remote account unless sinks are explicitly configured. Open article →