Reading JSON at 277 GB/s in Python

lemire.me2 min read

The author demonstrates how the fastsimdjson library, combined with Python 3.14's free-threaded build, can parse NDJSON data at exceptionally high speeds across multiple CPU cores. Tested on an AWS instance with 192 cores, the threaded approach processed GitHub star events and other multi-gigabyte datasets at rates reaching up to 277 GB/s. Open article →