Skip to content

Keep remote compaction stats serialization compatible with 11.1#14712

Closed
xingbowang wants to merge 1 commit into
facebook:mainfrom
xingbowang:2026_05_06_offload_compaction_fix
Closed

Keep remote compaction stats serialization compatible with 11.1#14712
xingbowang wants to merge 1 commit into
facebook:mainfrom
xingbowang:2026_05_06_offload_compaction_fix

Conversation

@xingbowang

Copy link
Copy Markdown
Contributor

Summary:

  • Reapply c494176 so remote compaction serializes InternalStats::CompactionStats::counts with the pre-11.2 compaction-reason count.
  • Keep remote compaction result metadata compatible with 11.1 readers and writers until the stats serialization path has version-aware array handling.

Test Plan:

  • make format-auto
  • make -j$(sysctl -n hw.ncpu) compaction_job_test compaction_service_test
  • /usr/local/bin/timeout 60 ./compaction_job_test --gtest_filter=CompactionJobTest.ResultSerialization
  • /usr/local/bin/timeout 60 ./compaction_service_test --gtest_filter=CompactionServiceTest.VerifyStats
Reapply c494176 so remote compaction serializes InternalStats::CompactionStats::counts with the pre-11.2 compaction-reason count.

Using the full 11.2 CompactionReason range changes the serialized array length, which breaks compatibility with 11.1 readers and writers. Keep the temporary 11.1-compatible size until the stats serialization path has version-aware array handling.
@meta-cla meta-cla Bot added the CLA Signed label May 6, 2026
@meta-codesync

meta-codesync Bot commented May 6, 2026

Copy link
Copy Markdown

@xingbowang has imported this pull request. If you are a Meta employee, you can view this in D104130456.

@github-actions

github-actions Bot commented May 6, 2026

Copy link
Copy Markdown

✅ clang-tidy: No findings on changed lines

Completed in 40.2s.

@joshkang97 joshkang97 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review automatically exported from Phabricator review in Meta.

@meta-codesync

meta-codesync Bot commented May 7, 2026

Copy link
Copy Markdown

@xingbowang merged this pull request in e0d549f.

xingbowang added a commit to xingbowang/rocksdb that referenced this pull request May 7, 2026
…book#14712)

Summary:
- Reapply c494176 so remote compaction serializes InternalStats::CompactionStats::counts with the pre-11.2 compaction-reason count.
- Keep remote compaction result metadata compatible with 11.1 readers and writers until the stats serialization path has version-aware array handling.

Pull Request resolved: facebook#14712

Test Plan:
- make format-auto
- make -j$(sysctl -n hw.ncpu) compaction_job_test compaction_service_test
- /usr/local/bin/timeout 60 ./compaction_job_test --gtest_filter=CompactionJobTest.ResultSerialization
- /usr/local/bin/timeout 60 ./compaction_service_test --gtest_filter=CompactionServiceTest.VerifyStats

Reviewed By: joshkang97, jaykorean

Differential Revision: D104130456

Pulled By: xingbowang

fbshipit-source-id: e9e92cb044253edbec0fc79b92c3efff53f01d8b
xingbowang added a commit to xingbowang/rocksdb that referenced this pull request May 7, 2026
…book#14712)

Summary:
- Reapply c494176 so remote compaction serializes InternalStats::CompactionStats::counts with the pre-11.2 compaction-reason count.
- Keep remote compaction result metadata compatible with 11.1 readers and writers until the stats serialization path has version-aware array handling.

Pull Request resolved: facebook#14712

Test Plan:
- make format-auto
- make -j$(sysctl -n hw.ncpu) compaction_job_test compaction_service_test
- /usr/local/bin/timeout 60 ./compaction_job_test --gtest_filter=CompactionJobTest.ResultSerialization
- /usr/local/bin/timeout 60 ./compaction_service_test --gtest_filter=CompactionServiceTest.VerifyStats

Reviewed By: joshkang97, jaykorean

Differential Revision: D104130456

Pulled By: xingbowang

fbshipit-source-id: e9e92cb044253edbec0fc79b92c3efff53f01d8b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

3 participants