-
Notifications
You must be signed in to change notification settings - Fork 863
Backport release/v6.3: feat: add configurable I/O rate limiting for snapshot writes
#2825
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: release/v6.3
Are you sure you want to change the base?
Conversation
|
Please cherry-pick the changes locally and resolve any conflicts. git fetch origin backport-2816-to-release/v6.3
git worktree add --checkout .worktree/backport-2816-to-release/v6.3 backport-2816-to-release/v6.3
cd .worktree/backport-2816-to-release/v6.3
git reset --hard HEAD^
git cherry-pick -x 28bc1c02ca94b9233c0be8f5fdd2ff94eb124622
git push --force-with-lease |
|
The latest Buf updates on your PR. Results from workflow Buf / buf (pull_request).
|
Codecov Report❌ Patch coverage is Additional details and impacted files@@ Coverage Diff @@
## release/v6.3 #2825 +/- ##
================================================
+ Coverage 43.36% 43.39% +0.02%
================================================
Files 1866 1866
Lines 155344 155399 +55
================================================
+ Hits 67368 67437 +69
+ Misses 81959 81951 -8
+ Partials 6017 6011 -6
Flags with carried forward coverage won't be shown. Click here to find out more.
🚀 New features to boost your workflow:
|
Add global rate limiting for snapshot write operations to prevent page cache eviction on machines with limited RAM. Changes: - Add SnapshotWriteRateMBps config field (default 100 MB/s) - Implement rateLimitedWriter with token bucket (shared across all trees) - Remove sc-snapshot-writer-limit from TOML template (hardcoded to 4, backward-compatible) - Add tests for rate limiter correctness, large writes, context cancellation, and config defaults - Update toml_test to verify new config field and absence of removed field - Switch back MADV_RANDOM after background snapshot load (cherry picked from commit 28bc1c0)
959e865 to
67747ed
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 67747ed4bc
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
Backport of #2816 to
release/v6.3.