Skip to content

feat: add client metadata rebuild for master high availability. - #1

Open
ShuweiShen772 wants to merge 4 commits into
xLLM-AI:v0.3.12_xllm_patchfrom
ShuweiShen772:v0.3.12_xllm_patch
Open

feat: add client metadata rebuild for master high availability.#1
ShuweiShen772 wants to merge 4 commits into
xLLM-AI:v0.3.12_xllm_patchfrom
ShuweiShen772:v0.3.12_xllm_patch

Conversation

@ShuweiShen772

Copy link
Copy Markdown

Enable the master to rebuild its metadata from client-side state after a
restart, so that a fresh master process can recover segment and object
location information without recomputation.

  • mooncake-store: add rebuild flow across client_service, master_service,
    master_client, rpc_service, segment and allocator
  • add rebuild_types.h defining the rebuild request/response types
  • add client_metadata_rebuild unit test and ha live-recovery test harness

Co-Authored-By: Claude noreply@anthropic.com

ShuweiShen772 and others added 4 commits July 28, 2026 14:16
Enable the master to rebuild its metadata from client-side state after a
restart, so that a fresh master process can recover segment and object
location information without recomputation.

- mooncake-store: add rebuild flow across client_service, master_service,
  master_client, rpc_service, segment and allocator
- add rebuild_types.h defining the rebuild request/response types
- add client_metadata_rebuild unit test and ha live-recovery test harness

Co-Authored-By: Claude <noreply@anthropic.com>
Strip references to internal design/impl docs (section numbers like
"impl doc §4.1" and internal .md filenames) from the HA rebuild code
comments, so the comments are self-contained for public review.
Comment-only change; no code logic modified.

Co-Authored-By: Claude <noreply@anthropic.com>
Translate the remaining Chinese comments and assertion messages in the HA
rebuild unit test to English, and replace the draft-era changelog header
with a concise English summary of the seven tests, so the file is ready
for public review. Also apply clang-format (ColumnLimit 80) across the HA
rebuild files to satisfy the format check. Comment, message, and whitespace
only; no test or code logic changed, and all seven unit tests still pass.

Co-Authored-By: Claude <noreply@anthropic.com>
Add a standalone scale benchmark for the HA metadata rebuild feature that
measures rebuild latency, scale across a key-count sweep, and recovery-window
read latency and availability. Includes the benchmark client, its driver
script, and a report of the measured results.

Co-Authored-By: Claude <noreply@anthropic.com>
@Kang-Meng
Kang-Meng self-requested a review July 28, 2026 06:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant