Uber Redesigns M3DB Sharding with Subclusters to Limit Failure Impact

Leela Kumili — Mon, 21 Sep 2026 14:37:00 GMT

Uber has redesigned shard placement in M3DB with fixed size subclusters to limit the impact of node failures, maintenance, and cluster scaling. The approach bounds shard dependencies, preserves replica isolation, and uses a greedy algorithm to select shard migrations while avoiding a separate rebalancing pass and unnecessary data movement.

By Leela Kumili

Netflix Reworks Conductor for 420 Million Monthly Workflow Executions and 10X Larger Workflows

Leela Kumili — Fri, 11 Sep 2026 14:17:00 GMT

Netflix has reworked its Conductor workflow orchestration engine to handle larger workloads, increasing supported workflow size from about 2,500 to 30,000 tasks and reducing p99 workflow evaluation latency by about 40%. Conductor 4.0 separates workflow metadata from task data, moves evaluation to asynchronous processing, and introduces dynamic worker allocation and concurrency controls.

By Leela Kumili

InfoQ - Scalability

Uber Redesigns M3DB Sharding with Subclusters to Limit Failure Impact

Netflix Reworks Conductor for 420 Million Monthly Workflow Executions and 10X Larger Workflows