InfoQ - Apache Kafka - Articles https://www.infoq.com InfoQ Apache Kafka Articles feed Article: Architecting Cloud-Native Kafka: from Tiered Storage towards a Diskless Future https://www.infoq.com/articles/architecting-cloud-native-kafka/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Apache+Kafka-articles <img src="https://res.infoq.com/articles/architecting-cloud-native-kafka/en/headerimage/architecting-cloud-native-kafka-header-1779433382367.jpg"/><p>This article explores Kafka's transition toward a cloud-native architecture, examining how tiered storage, FinOps telemetry, elastic consumer scaling, virtual clusters, and Share Groups reshape the operational and economic model of event streaming platforms. It also analyzes emerging diskless-storage proposals and their architectural trade-offs.</p> <i>By Viquar Khan</i> Kafka Streams Apache Kafka Cloud-Native AI, ML & Data Engineering Development Architecture & Design article Tue, 26 May 2026 09:00:00 GMT https://www.infoq.com/articles/architecting-cloud-native-kafka/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Apache+Kafka-articles Viquar Khan 2026-05-26T09:00:00Z /articles/architecting-cloud-native-kafka/en Article: The Schema Proliferation Problem in Kafka and Flink Pipelines: How to Solve It https://www.infoq.com/articles/schema-proliferation-problem/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Apache+Kafka-articles <img src="https://res.infoq.com/articles/schema-proliferation-problem/en/headerimage/schema-proliferation-problem-header-1779270222602.jpg"/><p>Schema proliferation builds slowly and gets expensive fast. One schema per event type feels right until there are ten tables, union queries spanning all of them, and a single field rename touching every schema. Discriminator-based schema consolidation collapses that to two tables, turning multi-table unions into a single query, while new variants are additive and don't break existing consumers.</p> <i>By Spoorthi Basu</i> Schema Apache Iceberg Apache Flink Apache Kafka Java Development Architecture & Design article Mon, 25 May 2026 13:00:00 GMT https://www.infoq.com/articles/schema-proliferation-problem/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Apache+Kafka-articles Spoorthi Basu 2026-05-25T13:00:00Z /articles/schema-proliferation-problem/en