Datadog scales metrics aggregation by moving state to storage
Datadog describes the three-generation evolution of its metrics aggregation system to overcome scaling and state-management constraints. Moving from static partitioning and local RocksDB storage to transferable state and ultimately delegating durable state reconciliation to the storage layer allowed the streaming tier to resume at the live edge without restoring hours of historical state. Open article →