1.8 Cluster Metadata Management

This is a historical learning note and may contain outdated or incomplete understanding.

1. What Is Cluster Metadata?

Application data is the content a system is designed to store. Metadata describes how that data and the cluster itself are organized—for example partition placement, replica membership, leaders, epochs, access rules, or file-block locations.

2. Why Metadata Matters

A client or server cannot route a key to the correct partition unless it knows the current mapping from data to partitions and from partitions to nodes. Stale metadata can therefore cause redirects, failed requests, or inconsistent routing decisions.

3. Management Models

3.1 Centralized Coordination

A coordination subsystem maintains authoritative metadata or the state needed to elect an authority. ZooKeeper is a classic example.

3.2 Distributed / Peer-to-Peer

Nodes exchange and maintain cluster information themselves. Redis Cluster is one example of a system whose nodes exchange topology information directly.

Gossip

Gossip is one way to disseminate membership and topology metadata without a single broadcast source.