[RW Separation] Support scale down without search replica#20939
Conversation
Signed-off-by: guojialiang <guojialiang.2012@bytedance.com>
PR Reviewer Guide 🔍(Review updated until commit 0de1581)Here are some key observations to aid the review process:
|
PR Code Suggestions ✨Latest suggestions up to 0de1581 Explore these optional code suggestions:
Previous suggestionsSuggestions up to commit 64c4a8d
Suggestions up to commit 2a68185
Suggestions up to commit f44aa13
Suggestions up to commit ae9eb21
Suggestions up to commit 6cca949
|
|
❌ Gradle check result for 2eba0ca: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
|
Persistent review updated to latest commit 8332429 |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #20939 +/- ##
============================================
- Coverage 73.21% 73.18% -0.03%
- Complexity 72620 72726 +106
============================================
Files 5849 5859 +10
Lines 332066 332461 +395
Branches 47951 48000 +49
============================================
+ Hits 243109 243314 +205
- Misses 69456 69646 +190
Partials 19501 19501 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
…n_without_search_replica
|
Persistent review updated to latest commit 6cca949 |
|
❌ Gradle check result for 6cca949: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
|
Persistent review updated to latest commit ae9eb21 |
|
❌ Gradle check result for ae9eb21: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
ae9eb21 to
f44aa13
Compare
|
Persistent review updated to latest commit f44aa13 |
|
❌ Gradle check result for f44aa13: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
f44aa13 to
2a68185
Compare
PR Code Analyzer ❗AI-powered 'Code-Diff-Analyzer' found issues on commit 2a68185.
The table above displays the top 10 most important findings. Pull Requests Author(s): Please update your Pull Request according to the report above. Repository Maintainer(s): You can Thanks. |
|
Persistent review updated to latest commit 2a68185 |
|
❌ Gradle check result for 2a68185: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
2a68185 to
64c4a8d
Compare
|
Persistent review updated to latest commit 64c4a8d |
|
❌ Gradle check result for 64c4a8d: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
Signed-off-by: guojialiang <guojialiang.2012@bytedance.com>
64c4a8d to
9926ceb
Compare
|
Failed to generate code suggestions for PR |
|
❌ Gradle check result for 9926ceb: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
…n_without_search_replica
|
Persistent review updated to latest commit 0de1581 |
|
❕ Gradle check result for 0de1581: UNSTABLE Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure. |
|
@vinaykpud Can you review this? Thanks! |
|
@prudhvigodithi can you help taking look on this |
|
Thanks @guojialiang92, I understood the change and one question I want to see reporting GREEN for an index that can't serve any requests is ok? Operators relying on cluster health for monitoring/alerting would have no signal that something needs attention. Should there be any warning or indication like index will be unsearchable until search replicas are added?. I'm fine we take up this incrementally and updating the documentation https://docs.opensearch.org/latest/tuning-your-cluster/separate-index-and-search-workloads/. |
|
Thank you for your attention @vinaykpud :).
Agree. We will subsequently promote the development of these capabilities, and our preliminary plan is to introduce the following methods.
The detailed implementation method will be discussed in subsequent issues. |
Nice, so after scale down with 0 replicas (including search) now on search scale the search replicas back to the actual replica count. Just curious have you tested with query wait behavior while the search replicas are up and running? |
Overall LGTM. |
@prudhvigodithi Additional waiting time is expected, along with additional rerouting and the process of downloading data from remote storage. Therefore, this configuration is dynamically configured according to business needs. However, within ByteDance, we have already implemented a storage-computation separation architecture where only partial data is stored locally. The process of reloading search only shard will be very fast. Of course, a technology similar to #13149 is an orthogonal technology. |
Merging code requires the approval of at least one core maintainer. |
…-project#20939) * support scale down without search replica Signed-off-by: guojialiang <guojialiang.2012@bytedance.com> * fix test Signed-off-by: guojialiang <guojialiang.2012@bytedance.com> * for test coverage Signed-off-by: guojialiang <guojialiang.2012@bytedance.com> --------- Signed-off-by: guojialiang <guojialiang.2012@bytedance.com>
…-project#20939) * support scale down without search replica Signed-off-by: guojialiang <guojialiang.2012@bytedance.com> * fix test Signed-off-by: guojialiang <guojialiang.2012@bytedance.com> * for test coverage Signed-off-by: guojialiang <guojialiang.2012@bytedance.com> --------- Signed-off-by: guojialiang <guojialiang.2012@bytedance.com> Signed-off-by: Aparajita Pandey <aparajita31pandey@gmail.com>
…-project#20939) * support scale down without search replica Signed-off-by: guojialiang <guojialiang.2012@bytedance.com> * fix test Signed-off-by: guojialiang <guojialiang.2012@bytedance.com> * for test coverage Signed-off-by: guojialiang <guojialiang.2012@bytedance.com> --------- Signed-off-by: guojialiang <guojialiang.2012@bytedance.com>
Description
The main changes in the PR are as follows
Related Issues
Resolves #[20938]
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.