https://www.infoq.com InfoQ Partitioning feed https://www.infoq.com/articles/spring-batch-without-broker/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Partitioning <img src="https://res.infoq.com/articles/spring-batch-without-broker/en/headerimage/Distributed-Spring-Batch-Without-a-Message-Broker-header-1792419294298.jpg"/><p>Distributed Spring Batch partitioning already needs a shared, persistent job repository. This article makes that database the whole coordination plane and drops the message broker, sizing work to the live node count, a per-job master with no standing coordinator, compare-and-set claiming that prevents double-execution, two-phase heartbeat failover, and where a broker is still the right choice.</p> <i>By Janardhan Reddy Chejarla</i> Data Partitioning Spring Batch Java Messaging Distributed Systems Development Architecture & Design article Wed, 21 Oct 2026 09:00:00 GMT https://www.infoq.com/articles/spring-batch-without-broker/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Partitioning Janardhan Reddy Chejarla 2026-10-21T09:00:00Z /articles/spring-batch-without-broker/en https://www.infoq.com/news/2026/10/pinterest-event-time-partition/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Partitioning <img src="https://res.infoq.com/news/2026/10/pinterest-event-time-partition/en/headerimage/generatedHeaderImage-1791063877867.jpg"/><p>Pinterest has introduced event time-based partition finalization for its database ingestion framework. The mechanism uses Apache Flink to track event time and Apache Iceberg metadata to publish a non-regressing watermark, helping downstream jobs determine when continuously ingested CDC data is sufficiently complete for processing.</p> <i>By Leela Kumili</i> Change Data Capture Apache Kafka Data Partitioning Partitioning Data Lake Event Driven Architecture Apache Spark Streaming Apache Iceberg Apache Flink Distributed Systems Architecture & Design Development news Mon, 19 Oct 2026 14:37:00 GMT https://www.infoq.com/news/2026/10/pinterest-event-time-partition/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Partitioning Leela Kumili 2026-10-19T14:37:00Z /news/2026/10/pinterest-event-time-partition/en