[RemoteRoutingTable] Reduce number of remote download call for Indices Routing #15125
Description
Is your feature request related to a problem? Please describe
In the event of a node drop, read calls to indices files would be proportional to number of index changed multiplied by number of nodes in the cluster. We need to reduce the number of downloads required for node drop scenarios.
Describe the solution you'd like
To reduce the number of indices file downloads required to construct the updated routing table, we will upload/download a new routing table diff file. This file will store the incremental differences between the previous routing table and the new routing table. This approach will reduce the number of reads to 1 per node in the cluster during node drop scenarios.
Related component
ShardManagement:Resiliency
Describe alternatives you've considered
No response
Additional context
No response