Message Queues

Why asynchronous messaging exists, queue vs. pub-sub/log models, delivery semantics, backpressure, idempotency, ordering, and the trade-offs introduced by a broker.

How to preserve per-entity message order through partitioning, producer sequencing, consumer concurrency control, and idempotent version checks.

A version-neutral Kafka local setup guide that distinguishes modern KRaft deployments from historical ZooKeeper-based instructions.

Kafka as a distributed durable event log for messaging, storage, replay, and stream processing.

A compact Kafka workflow for topics, producers, consumers, groups, offsets, and administration without freezing the note to one old CLI syntax.

Kafka producers, partition leaders/followers, brokers, consumers, KRaft metadata quorum, replication, failover, and partitioned scaling.

Kafka producer batching, serialization, partitioning, acknowledgements, retries, idempotent production, transactions, and their exact scope.

Kafka broker responsibilities, modern controllers, ISR/min.insync.replicas, producer acknowledgements, leader election, and durability trade-offs.

Kafka consumer groups, partition assignment, offsets, rebalancing, at-least-once processing, idempotency, and modern cooperative rebalancing considerations.

Kafka partition log segments, sparse indexes, retention vs. compaction, page cache, sequential I/O, batching, and zero-copy-related transport efficiency.