News, guides, and engineering deep dives.
Practical guidance on Kafka, Flink, Iceberg, and real-time data.
What is a data governance policy?
A data governance policy is an enforceable rule for how data is structured, accessed, retained and traced. On Kafka it is implemented as configuration and code, not documents.
What is envelope encryption?
Envelope encryption encrypts data with a local data key, then wraps that key with a KMS-held key. On Kafka it is the pattern that makes per-field encryption work at full throughput.
What is Kafka Connect?
Kafka Connect streams data between Kafka and other systems as managed, fault-tolerant tasks. The internal architecture, production scaling, error handling and custom development.
What is Kafka rebalancing?
Kafka rebalancing redistributes a consumer group's partitions when membership changes. The triggers, the three timeouts, cooperative rebalancing, KIP-848 and the metrics that explain incidents.
What is RabbitMQ?
RabbitMQ explained for Kafka operators: the AMQP queue model, broker-side routing, push delivery, streams, and where it fits beside a Kafka deployment.
What is Redpanda?
Redpanda reimplements the Kafka wire protocol in a single C++ binary. The architecture, the drop-in compatibility boundaries, and how to evaluate it against tiered-storage Kafka.
Kafka: The Complete Guide
Apache Kafka is a distributed event streaming platform that stores ordered, replayable records in partitioned topics. This hub covers Kafka fundamentals, operations, governance and tooling.
Apache Kafka architecture: a complete guide
A complete guide to Apache Kafka architecture: internals, components, KRaft, replication, consumers, Connect, Streams, and deployment options.
Kafka brokers in production: configuration, troubleshooting and metrics
A Kafka broker stores partition logs and serves client requests. Broker configuration, bootstrap timeouts, crash loops and the JMX metrics to watch.