Support index level allocation filtering for searchable snapshot index

[bugmakerrrrrr]

Description

Two changes here:

1. Support index level allocation filtering for searchable snapshot index: filter out the shards that cannot remain on the current node and prioritize moving them to eligible nodes before considering moving shards on excluded nodes;
2. Eliminate the logic of swapping primary with replica, as a shard cannot be transitioned from primary to replica mode.
   

   OpenSearch/server/src/main/java/org/opensearch/index/shard/IndexShard.java

   Line 604 in 6bb53de

   if (currentRouting.primary() && newRouting.primary() == false) {

Related Issues

Resolves #11468

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Failing checks are inspected and point to the corresponding known issue(s) (See: Troubleshooting Failing Builds)
• Commits are signed per the DCO using --signoff
• Commit changes are listed out in CHANGELOG.md file (See: Changelog)
• Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[github-actions]

❌ Gradle check result for 15d2358: null

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

[github-actions]

❕ Gradle check result for 1997226: UNSTABLE

• TEST FAILURES:

      2 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.classMethod
      1 org.opensearch.snapshots.CloneSnapshotIT.testCloneShallowSnapshotIndex
      1 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshAfterCommit

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Attention: 18 lines in your changes are missing coverage. Please review.

Comparison is base (5dd4b61) 71.38% compared to head (1997226) 70.70%.
Report is 1 commits behind head on main.

❗ Current head 1997226 differs from pull request most recent head 9925816. Consider uploading reports for the commit 9925816 to get more accurate results

Files	Patch %	Lines
...ing/allocation/allocator/RemoteShardsBalancer.java	53.84%	12 Missing and 6 partials ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main   #11563      +/-   ##
============================================
- Coverage     71.38%   70.70%   -0.68%     
+ Complexity    59354    58774     -580     
============================================
  Files          4923     4911      -12     
  Lines        279095   278674     -421     
  Branches      40559    40534      -25     
============================================
- Hits         199228   197043    -2185     
- Misses        63292    65191    +1899     
+ Partials      16575    16440     -135     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[bugmakerrrrrr]

@kotwanikunal Could you please have a look?

[kotwanikunal]

Rest LGTM.

[github-actions]

❌ Gradle check result for 1a59be8: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

[bugmakerrrrrr]

Rest LGTM.

@kotwanikunal all relevant issues fixed

[andrross]

I just pushed a rebase from main and fixed the conflict in the changelog

[github-actions]

❌ Gradle check result for 1a59be8: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

[github-actions]

❕ Gradle check result for 9925816: UNSTABLE

• TEST FAILURES:

      2 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.classMethod
      1 org.opensearch.snapshots.DedicatedClusterSnapshotRestoreIT.testSnapshotDeleteRelocatingPrimaryIndex
      1 org.opensearch.snapshots.DedicatedClusterSnapshotRestoreIT.classMethod
      1 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshAfterCommit

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.