[Backport 2.x] [Remote Store] Optimize segments metadata upload (#7905)

[ashking94]

Description

Backports #7905 to 2.x branch.

Related Issues

Resolves #7443

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed per the DCO using --signoff
• Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18958/
• CommitID: 15175bb
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18963/
• CommitID: fe64b47
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/18985/
• CommitID: fe64b47
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[Rishikesh1159]

@ashking94 can you please rebase your branch with latest 2.x changes

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: SUCCESS ✅
• URL: https://build.ci.opensearch.org/job/gradle-check/19011/
• CommitID: 637a9e0

[codecov]

Codecov Report

Merging #8410 (637a9e0) into 2.x (0342349) will increase coverage by 0.07%.
The diff coverage is 77.77%.

@@             Coverage Diff              @@
##                2.x    #8410      +/-   ##
============================================
+ Coverage     70.53%   70.60%   +0.07%     
- Complexity    56892    56943      +51     
============================================
  Files          4717     4717              
  Lines        269782   269783       +1     
  Branches      39887    39888       +1     
============================================
+ Hits         190298   190490     +192     
+ Misses        63114    62963     -151     
+ Partials      16370    16330      -40     

Impacted Files	Coverage Δ
...search/index/shard/RemoteStoreRefreshListener.java	89.94% <77.77%> (-0.46%)	⬇️

... and 451 files with indirect coverage changes