Confluent checkpointing framework cuts controller restarts to 1 minute

developer.confluent.io20 min read

Engineers at Confluent developed a checkpointing framework for Kubernetes-style controllers to eliminate cold start bottlenecks caused by reading millions of state objects from a database upon restart. By tracking watch stream continue tokens, unfinished queue requests, and in-memory state in a specific order, the framework guarantees at-least-once delivery while reducing restart times for the largest controllers from six hours to one minute. Open article →