InfoQ - Apache Kafka - Articles https://www.infoq.com InfoQ Apache Kafka Articles feed Article: Beyond Offset Lag: Computing Time in Queue for Apache Hudi Data Lake Pipelines at Petabyte Scale https://www.infoq.com/articles/beyond-offset-lag-kafka-apache-hudi/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Apache+Kafka-articles <img src="https://res.infoq.com/articles/beyond-offset-lag-kafka-apache-hudi/en/headerimage/beyond-offset-lag-kafka-apache-hudi-header-1787577734265.jpg"/><p>In this article, author Srikanth Mamidala discusses the data lake architecture used for analytics, reporting, and machine learning and shows how to manage the consumer lag metrics when using Kafka and Apache Hudi.</p> <i>By Srikanth Mamidala</i> Data Lake Messaging Data Pipelines Streaming Apache Kafka AI, ML & Data Engineering article Wed, 26 Aug 2026 09:00:00 GMT https://www.infoq.com/articles/beyond-offset-lag-kafka-apache-hudi/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=Apache+Kafka-articles Srikanth Mamidala 2026-08-26T09:00:00Z /articles/beyond-offset-lag-kafka-apache-hudi/en