Back to Milvus

Shard Management

docs/agent_guides/streaming-system/wal/shard-management.md

3.0.0821 B
Original Source

Shard Management

The Shard interceptor manages per-PChannel collection/partition/segment in-memory metadata and assigns each incoming DML message to a growing segment. All state is purely in-memory, should always keep consistent with underlying-WAL; on WAL open, it is recovered from the RecoveryStorage snapshot.

See Collection Messages for per-message semantics and the messages handled by this interceptor.

Seal Policies

Growing segments are sealed when any registered policy triggers. See internal/streamingnode/server/wal/interceptors/shard/policy/seal_policy.go for the full list of policies.

Key Packages

  • internal/streamingnode/server/wal/interceptors/shard/ — Shard interceptor, ShardManager, seal policies, segment stats