Polars Nanook benchmarks outpace Databricks Photon

Polars has announced a new benchmark showing that its distributed engine, Polars Nanook, achieves a 6x speed-up compared to open source Spark and outperforms the Databricks Photon engine on 17 out of 22 queries. The company attributes these performance gains to major architectural improvements over the past year, including the introduction of a cost-based planner, a work-stealing task scheduler, and runtime bloom filters. Open article →